-- Logs begin at Sun 2022-07-24 00:10:20 UTC, end at Sun 2022-07-24 01:31:38 UTC. -- Jul 24 00:57:13.610253 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 24 00:57:13.619473 dv-cinder-master-3-smb devstack@keystone.service[80509]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 24 00:57:13.621503 dv-cinder-master-3-smb devstack@keystone.service[80509]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Jul 24 00:57:13 2022] *** Jul 24 00:57:13.621503 dv-cinder-master-3-smb devstack@keystone.service[80509]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 24 00:57:13.621503 dv-cinder-master-3-smb devstack@keystone.service[80509]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 24 00:57:13.621503 dv-cinder-master-3-smb devstack@keystone.service[80509]: nodename: dv-cinder-master-3-smb Jul 24 00:57:13.621503 dv-cinder-master-3-smb devstack@keystone.service[80509]: machine: x86_64 Jul 24 00:57:13.621503 dv-cinder-master-3-smb devstack@keystone.service[80509]: clock source: unix Jul 24 00:57:13.621503 dv-cinder-master-3-smb devstack@keystone.service[80509]: pcre jit disabled Jul 24 00:57:13.621503 dv-cinder-master-3-smb devstack@keystone.service[80509]: detected number of CPU cores: 4 Jul 24 00:57:13.621503 dv-cinder-master-3-smb devstack@keystone.service[80509]: current working directory: / Jul 24 00:57:13.621503 dv-cinder-master-3-smb devstack@keystone.service[80509]: detected binary path: /usr/bin/uwsgi-core Jul 24 00:57:13.622049 dv-cinder-master-3-smb devstack@keystone.service[80509]: your processes number limit is 47680 Jul 24 00:57:13.622049 dv-cinder-master-3-smb devstack@keystone.service[80509]: your memory page size is 4096 bytes Jul 24 00:57:13.622049 dv-cinder-master-3-smb devstack@keystone.service[80509]: detected max file descriptor number: 2048 Jul 24 00:57:13.622049 dv-cinder-master-3-smb devstack@keystone.service[80509]: lock engine: pthread robust mutexes Jul 24 00:57:13.622049 dv-cinder-master-3-smb devstack@keystone.service[80509]: thunder lock: enabled Jul 24 00:57:13.622049 dv-cinder-master-3-smb devstack@keystone.service[80509]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 24 00:57:13.622049 dv-cinder-master-3-smb devstack@keystone.service[80509]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 24 00:57:13.664851 dv-cinder-master-3-smb devstack@keystone.service[80509]: Python main interpreter initialized at 0x55f58d7589c0 Jul 24 00:57:13.664851 dv-cinder-master-3-smb devstack@keystone.service[80509]: python threads support enabled Jul 24 00:57:13.664851 dv-cinder-master-3-smb devstack@keystone.service[80509]: your server socket listen backlog is limited to 100 connections Jul 24 00:57:13.664851 dv-cinder-master-3-smb devstack@keystone.service[80509]: your mercy for graceful operations on workers is 90 seconds Jul 24 00:57:13.665201 dv-cinder-master-3-smb devstack@keystone.service[80509]: mapped 403077 bytes (393 KB) for 2 cores Jul 24 00:57:13.665260 dv-cinder-master-3-smb devstack@keystone.service[80509]: *** Operational MODE: preforking *** Jul 24 00:57:13.665524 dv-cinder-master-3-smb devstack@keystone.service[80509]: *** uWSGI is running in multiple interpreter mode *** Jul 24 00:57:13.665524 dv-cinder-master-3-smb devstack@keystone.service[80509]: spawned uWSGI master process (pid: 80509) Jul 24 00:57:13.665722 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 24 00:57:13.666761 dv-cinder-master-3-smb devstack@keystone.service[80509]: spawned uWSGI worker 1 (pid: 80519, cores: 1) Jul 24 00:57:13.666761 dv-cinder-master-3-smb devstack@keystone.service[80509]: spawned uWSGI worker 2 (pid: 80520, cores: 1) Jul 24 00:57:13.666761 dv-cinder-master-3-smb devstack@keystone.service[80509]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 24 00:57:18.990223 dv-cinder-master-3-smb devstack@keystone.service[80519]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:57:18.990223 dv-cinder-master-3-smb devstack@keystone.service[80519]: from cryptography.utils import int_from_bytes Jul 24 00:57:18.991062 dv-cinder-master-3-smb devstack@keystone.service[80520]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:57:18.991062 dv-cinder-master-3-smb devstack@keystone.service[80520]: from cryptography.utils import int_from_bytes Jul 24 00:57:18.991062 dv-cinder-master-3-smb devstack@keystone.service[80520]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:57:18.991062 dv-cinder-master-3-smb devstack@keystone.service[80520]: from cryptography.utils import int_from_bytes Jul 24 00:57:18.991594 dv-cinder-master-3-smb devstack@keystone.service[80519]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 24 00:57:18.991594 dv-cinder-master-3-smb devstack@keystone.service[80519]: from cryptography.utils import int_from_bytes Jul 24 00:57:19.039052 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 24 00:57:19.039245 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 24 00:57:19.039351 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 24 00:57:19.039435 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 24 00:57:19.039503 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] command line args: [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 24 00:57:19.039569 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] command line args: [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 24 00:57:19.039755 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 24 00:57:19.039851 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 24 00:57:19.039925 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ================================================================================ {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 24 00:57:19.039990 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ================================================================================ {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 24 00:57:19.040251 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] admin_token = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.040370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] admin_token = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.040459 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] config_dir = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.040528 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] config_dir = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.040656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.040735 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.040871 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] config_source = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.041029 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] config_source = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.041029 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] debug = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.041179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] debug = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.041241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.041441 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.041542 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.041610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.041773 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.041859 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.041956 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.042040 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.042225 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.042341 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.042409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] list_limit = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.042479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.042606 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] log_config_append = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.042696 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] log_config_append = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.042765 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.042829 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.042948 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] log_dir = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.043030 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] log_dir = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.043101 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] log_file = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.043173 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] log_file = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.043346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.043430 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.043598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.043688 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.043894 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.043985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.044142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.044256 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.044334 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.044409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.044481 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.044561 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.044694 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.044798 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.044947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.045036 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.045160 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.045243 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.045420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.045536 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.045603 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.045673 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.045861 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.045944 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.046086 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.046176 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.046338 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.046441 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.046598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.046689 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.047105 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.047278 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.047446 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] publish_errors = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.047570 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] publish_errors = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.047686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.047800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.047936 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.047936 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.048144 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.048261 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.048380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.048521 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.048645 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.048750 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] standard_threads = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.048861 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.048978 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.049148 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] standard_threads = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.049270 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.049386 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.049498 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.049498 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] use_journal = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.049709 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.049830 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] use_json = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.049952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.050073 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] use_stderr = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.050186 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] use_journal = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.050298 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] use_syslog = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.050409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] use_json = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.050409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] use_stderr = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.050633 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.050751 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] use_syslog = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.050864 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.050977 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 24 00:57:19.051090 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.051209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.051355 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.051480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.051594 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.051705 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.051823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.051944 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.052058 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.052172 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.052283 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.052401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.052513 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.052633 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.052745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.052858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.052970 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.053081 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.053194 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.053314 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.053427 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.053544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.053659 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.053772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.053890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.054011 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.054130 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.054244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.054356 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.054474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.054592 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.054789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.054906 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.055024 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.055142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.055254 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.055397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.055397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.055644 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.055644 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.055857 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.055969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.056085 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.056209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.056322 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.056322 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.056549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.056662 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.056788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.056908 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.057020 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.057138 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.057258 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.057370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.057492 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.057605 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.057717 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.057835 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.057947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.058059 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.058179 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.058291 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.058403 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.058515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.058627 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.058738 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.058857 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.058970 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.059087 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.059199 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.059335 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.059450 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.059579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.059699 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.059812 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.059924 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.060035 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.060146 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.060336 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.060454 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.060574 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.060686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.060797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.060908 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.061028 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.061141 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.061309 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.061425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.061538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.061656 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.061779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.061893 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.062010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.062133 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.062245 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.062363 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.062487 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.062601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.062713 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.062825 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.062943 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.063055 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.063175 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.063312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.063468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.063590 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.063710 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.063860 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.063971 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.064068 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.064164 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.064259 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.064353 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.064448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.064557 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.064654 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.064750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.064845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.064955 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.065076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.065190 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.065312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.065435 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.065551 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.065666 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.065791 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.065905 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.066028 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.066152 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.066266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.066390 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.066503 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.066616 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.066729 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.066843 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.066956 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.067069 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.067182 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.067316 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.067445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.067561 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.067673 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.067792 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.067906 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.068019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.068139 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.068253 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.068358 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.068512 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.068620 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.068733 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.068854 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.068854 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.069069 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.069182 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.069315 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.069430 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.069554 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.069669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.069783 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.069895 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.070008 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.070127 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.070249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.070363 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.070485 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.070599 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.070720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.070833 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.070954 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.071069 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.071185 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.071354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.071471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.071585 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.071786 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.071907 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.072377 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.072495 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.072607 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.072720 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.072841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.072965 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.073095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.073212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.073325 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.073437 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.073550 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.073666 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.073787 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.073902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.074015 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.074130 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.074244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.074365 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.074485 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.074605 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.074760 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.074877 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.075080 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.075203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.075337 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.075453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.075567 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.075680 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.external = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.075793 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.075921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.076044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.076158 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.076281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.076402 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.076516 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] auth.external = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.076664 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.password = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.076794 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.076918 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] auth.token = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.077034 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.077148 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.077262 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.077377 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.077490 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] auth.password = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.077613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.077734 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] auth.token = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.077849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.077963 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.078076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.078190 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.078313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.078429 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.078543 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.078657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.078772 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.078886 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.079012 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.079127 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.079241 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.079376 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.079492 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.079607 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] credential.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.079733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.079849 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.079964 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.080079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.080201 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.080316 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.080439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.080555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.080670 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.080784 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.080898 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.081012 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.081139 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.081255 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.081370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.081484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.081599 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.081712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.081835 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.081941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.082053 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.082167 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.082281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.082395 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.082517 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.082639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.082754 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.082868 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.082987 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.083102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.083227 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.083368 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.083496 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.083614 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.083731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.083845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.083969 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.084084 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.084199 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.084313 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.084426 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.084540 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.084664 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.084780 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.084893 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.085007 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.085121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.085243 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.085369 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.085484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.085599 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.085714 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.085828 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.086025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.086144 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.086258 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.086379 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.086494 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.086608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.086729 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.086845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.086959 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.087073 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.087187 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.087317 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.087447 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.087563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.087677 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.087792 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.087931 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.088045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.088045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.088274 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.088390 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.088504 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.088618 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.088738 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.088738 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.088966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.089080 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.089194 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.089308 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.089421 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.089544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.089669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.089783 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.089898 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.090012 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.090126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.090126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.090354 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.090468 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.090582 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.090701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.090816 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.090938 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.091060 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.091175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.091280 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.091455 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.091569 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.091696 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.091813 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.091927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.092042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.092155 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.092267 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.092390 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.092504 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.092618 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.092732 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.092845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.092958 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.093081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.093196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.093309 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.093423 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.093535 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.093651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.093778 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.093893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.094006 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.094121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.094234 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.094347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.094469 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.094584 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.094698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.094813 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.094927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.095041 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.095164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.095279 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.095414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.095528 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.095642 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.095755 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.095881 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.095997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.096111 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.096226 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.096340 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.096453 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.096575 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.096690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.096803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.096917 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.097030 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.097153 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.097268 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.097382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.097496 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.097610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.097726 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.097851 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.097966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.098080 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.098193 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.098307 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.098419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.098541 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.098656 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.098769 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.098888 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.099002 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.099116 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.099238 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.099375 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.099490 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.099603 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.099603 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.099817 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.099943 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.100060 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.100173 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.100286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.100286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.100501 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.100627 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.100743 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.100856 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.100970 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.101084 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.101197 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.101319 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.101435 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.101549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.101662 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.101662 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.101875 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.101997 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.102113 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.102226 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.102340 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.102454 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.102568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.102690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.102805 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.102919 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.103033 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.103147 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.103260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.103419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.103538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.103652 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.103771 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.103884 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.103997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.104119 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.104234 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.104348 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.104461 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.104575 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.104688 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.104810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.104925 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.105039 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.105178 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.105294 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.105408 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.105531 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.105647 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.105761 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.105874 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.105988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.106102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.106225 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.106374 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.106489 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.106603 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.106719 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.106832 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.106960 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.107076 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.107190 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.107367 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.107486 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.107601 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.107728 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.107845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.107960 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.108074 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.108188 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] role.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.108301 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.108489 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] role.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.108607 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.108722 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.108836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.108950 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.109064 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.109187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.109303 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.109417 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.109531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] role.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.109644 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.109767 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] role.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.109883 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.109998 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.110112 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.110226 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.110340 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.110462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.110578 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.110692 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.110806 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.110921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.111037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.111159 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.111275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.111474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.111589 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.111702 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.111816 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.112277 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.112404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.112519 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.112634 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.112749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.112863 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.112988 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.113104 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.113219 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.113335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.113448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.113563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.113690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.113807 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.113922 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.114037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.114151 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.114266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.114266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.114493 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.114606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.114720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.114834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.114948 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.115071 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.115187 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.115319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.115436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.115551 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.115678 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.115795 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.115909 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.116023 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.116138 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.116251 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.116374 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.116490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.116604 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.116717 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.116831 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.116945 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.117067 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.117183 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.117297 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.117411 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.117525 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.117638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.117760 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.117883 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.117998 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.118111 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.118226 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] token.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.118340 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.118461 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.118576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.118690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.118804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.118918 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.119031 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.119153 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.119270 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.119403 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.119517 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.119631 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.119745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.119870 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.119987 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.120102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.120216 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.120331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.120445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.120567 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.120682 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.120796 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.120909 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.connection = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.121031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.121155 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.121271 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.121393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.121509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.121622 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.121736 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.121875 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.121990 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.122114 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.122236 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.122351 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.122465 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.connection = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.122588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.122712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.122826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.122941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.123064 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.123180 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.123332 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.123452 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.123568 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.123686 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.123815 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.123932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.124047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.124161 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.124275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.124389 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.124513 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.124628 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.124743 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.124858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.124972 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.125086 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.125209 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.125325 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.125440 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 24 00:57:19.125556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.125556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.125556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.125556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.125556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.125556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 24 00:57:19.125556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 24 00:57:19.152583 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.152813 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.153064 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.153161 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.153334 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.153560 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.161384 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.161926 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.189294 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.189531 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.189779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.190017 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.334850 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.335049 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.383636 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.383784 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.383864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.383967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.447561 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.447764 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.448010 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.448135 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.448233 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.448314 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.448380 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.448546 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.448674 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.448755 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.448968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.449185 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.473200 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.473457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.473568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.473684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.473811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.473896 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.473961 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.474042 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.474208 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.474304 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.474412 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.474503 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.474656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.474832 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.485536 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.485829 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.498445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.498653 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.498750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.498852 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.498933 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.499090 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.499218 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.499318 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.499412 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.499493 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.499557 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.499722 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80520) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.499850 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.499944 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80519) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 24 00:57:19.516775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.516908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.516989 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 24 00:57:19.517058 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 24 00:57:19.517287 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.517431 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.517514 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 24 00:57:19.517594 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 24 00:57:19.517760 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.517887 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.517980 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.518059 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.518251 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.518378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.518457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.518535 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.529612 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.529738 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.529863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.529958 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.530152 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.530298 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.530380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.530485 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.538486 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.538615 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.541773 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.541902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.542026 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.542119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.542321 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.542446 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.542707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.542834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.542993 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.543117 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.543198 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.543310 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.543511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.543637 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.543809 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.543935 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.544089 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.544236 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.544323 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.544399 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.544604 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.544731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.570637 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.570780 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.572623 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.572751 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.572876 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.572989 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.578127 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.578255 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.578381 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.578474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.578678 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.578806 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.585925 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.586048 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.586129 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.586206 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.590747 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.590876 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.591031 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.591158 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.591278 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.591414 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.591607 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.591733 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.591855 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.591948 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.592149 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.592274 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.592386 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.592477 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.592679 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.592806 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.611184 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.611330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.611463 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.611547 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.616034 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.616180 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.619625 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.619755 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.619897 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.619979 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.624973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.625101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.628556 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.628690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.632281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.632430 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.632572 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.632655 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.632859 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.632988 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.633142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.633228 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.633379 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.633473 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.633677 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.633818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.652365 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.652492 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.652734 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.652861 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.653035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.653183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.653267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.653377 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.661176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.661363 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.662860 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.662988 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.663112 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.663200 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.666156 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.666284 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.666410 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.666503 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.666722 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.666850 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.667010 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.667149 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.667263 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.667373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.680537 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.680664 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.680769 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.681270 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.681410 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.681491 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.681578 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.681655 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.681731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.681806 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.681881 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.681997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.682090 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.682301 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.701404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.701722 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.704653 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.705007 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.707935 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.708294 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.709542 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.709885 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.711147 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.711443 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.711569 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.711732 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.711860 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.712064 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.719088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.719486 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.720700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.721095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.723982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.724265 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.724392 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.724547 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.724675 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.724827 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.724968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.725114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.733974 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.734220 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.734344 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.734525 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.734672 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.734846 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.742285 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80520) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.742535 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.742660 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80519) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 24 00:57:19.742842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.742969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.743084 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.743178 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.743378 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.743490 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.743674 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.743802 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.743949 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.744077 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.744187 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.744294 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.744453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.744547 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.744721 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.744870 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.745018 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.745144 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.745228 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.745293 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.745524 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.745652 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.745737 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80520) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.745814 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.746043 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80519) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 24 00:57:19.783080 dv-cinder-master-3-smb devstack@keystone.service[80520]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f58d7589c0 pid: 80520 (default app) Jul 24 00:57:19.783392 dv-cinder-master-3-smb devstack@keystone.service[80519]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f58d7589c0 pid: 80519 (default app) Jul 24 00:57:19.786409 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eba6f-293d-4551-ad7e-524e6c5e734c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:19.786699 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eba6f-293d-4551-ad7e-524e6c5e734c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:19.786977 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20eba6f-293d-4551-ad7e-524e6c5e734c None None] PATH_INFO: `/v3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:19.791232 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Sun Jul 24 00:57:19 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:27.447616 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292aff5-3afa-40a6-9bc2-0cb2177d5008 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:27.448522 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292aff5-3afa-40a6-9bc2-0cb2177d5008 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:27.448522 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2292aff5-3afa-40a6-9bc2-0cb2177d5008 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:27.453446 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:27.459533 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fad7f-cb4a-4b31-b699-cc6b87cebc9a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:27.459960 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fad7f-cb4a-4b31-b699-cc6b87cebc9a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:27.460057 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515fad7f-cb4a-4b31-b699-cc6b87cebc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:27.529365 dv-cinder-master-3-smb devstack@keystone.service[80520]: INFO dbcounter [None req-515fad7f-cb4a-4b31-b699-cc6b87cebc9a None None] Registered counter for database keystone Jul 24 00:57:27.554135 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG oslo_db.sqlalchemy.engines [None req-515fad7f-cb4a-4b31-b699-cc6b87cebc9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 00:57:27.563861 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writer thread running {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 00:57:27.744731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG passlib.handlers.bcrypt [None req-515fad7f-cb4a-4b31-b699-cc6b87cebc9a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80520) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 24 00:57:27.745291 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG passlib.handlers.bcrypt [None req-515fad7f-cb4a-4b31-b699-cc6b87cebc9a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80520) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 24 00:57:27.801188 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-515fad7f-cb4a-4b31-b699-cc6b87cebc9a None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:27.802836 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-515fad7f-cb4a-4b31-b699-cc6b87cebc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:27.928839 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 470 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 24 00:57:28.148969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292aff5-3afa-40a6-9bc2-0cb2177d5008 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:28.219229 dv-cinder-master-3-smb devstack@keystone.service[80519]: INFO dbcounter [None req-2292aff5-3afa-40a6-9bc2-0cb2177d5008 None None] Registered counter for database keystone Jul 24 00:57:28.240740 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG oslo_db.sqlalchemy.engines [None req-2292aff5-3afa-40a6-9bc2-0cb2177d5008 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 24 00:57:28.252595 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writer thread running {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 24 00:57:28.373636 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2292aff5-3afa-40a6-9bc2-0cb2177d5008 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:28.379099 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e83e3-15cb-4d7b-bef6-741077f8f4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:28.379795 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e83e3-15cb-4d7b-bef6-741077f8f4c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:28.380080 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e83e3-15cb-4d7b-bef6-741077f8f4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:28.380355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e83e3-15cb-4d7b-bef6-741077f8f4c0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:28.389394 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e83e3-15cb-4d7b-bef6-741077f8f4c0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:28.443251 dv-cinder-master-3-smb devstack@keystone.service[80519]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8b1e83e3-15cb-4d7b-bef6-741077f8f4c0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 24 00:57:28.443611 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e83e3-15cb-4d7b-bef6-741077f8f4c0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:28.455073 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Sun Jul 24 00:57:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 00:57:28.463580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fad7f-cb4a-4b31-b699-cc6b87cebc9a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:28.478361 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515fad7f-cb4a-4b31-b699-cc6b87cebc9a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:28.484809 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a774e739-aad2-46e5-b11f-80a4cd3dfbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:28.485949 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774e739-aad2-46e5-b11f-80a4cd3dfbef admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:28.486236 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774e739-aad2-46e5-b11f-80a4cd3dfbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:28.486510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a774e739-aad2-46e5-b11f-80a4cd3dfbef admin admin] PATH_INFO: `/v3/projects/05a6eda2714c497da6528545bd5b3ebc` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:28.490793 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774e739-aad2-46e5-b11f-80a4cd3dfbef admin admin] RBAC: Authorizing `identity:get_project(project_id=05a6eda2714c497da6528545bd5b3ebc)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:28.541093 dv-cinder-master-3-smb devstack@keystone.service[80520]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a774e739-aad2-46e5-b11f-80a4cd3dfbef admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 24 00:57:28.541428 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a774e739-aad2-46e5-b11f-80a4cd3dfbef admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:28.546136 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Sun Jul 24 00:57:28 2022] GET /identity/v3/projects/05a6eda2714c497da6528545bd5b3ebc => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:30.522438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a88f00-12ef-4b88-8d79-002de11087aa None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:30.523001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a88f00-12ef-4b88-8d79-002de11087aa None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:30.523001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a88f00-12ef-4b88-8d79-002de11087aa None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:30.527123 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:30.534035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5e73a-0f74-42b4-89ff-77730a67ee90 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:30.534759 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5e73a-0f74-42b4-89ff-77730a67ee90 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:30.534881 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5e73a-0f74-42b4-89ff-77730a67ee90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:30.558994 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5ff5e73a-0f74-42b4-89ff-77730a67ee90 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:30.560566 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5ff5e73a-0f74-42b4-89ff-77730a67ee90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:30.571091 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 24 00:57:30.601417 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a88f00-12ef-4b88-8d79-002de11087aa None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:30.622056 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a88f00-12ef-4b88-8d79-002de11087aa None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:30.627753 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac61ec7-5e63-49f2-b6de-757938205134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:30.628386 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac61ec7-5e63-49f2-b6de-757938205134 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:30.628667 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac61ec7-5e63-49f2-b6de-757938205134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:30.628949 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac61ec7-5e63-49f2-b6de-757938205134 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:30.637503 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac61ec7-5e63-49f2-b6de-757938205134 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:30.639337 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac61ec7-5e63-49f2-b6de-757938205134 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:30.648788 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Sun Jul 24 00:57:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 00:57:30.654440 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5e73a-0f74-42b4-89ff-77730a67ee90 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:30.663646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5e73a-0f74-42b4-89ff-77730a67ee90 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:30.669426 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd3ffd-86a5-448d-bbad-ccccb2b0eab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:30.670302 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd3ffd-86a5-448d-bbad-ccccb2b0eab8 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:30.670586 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd3ffd-86a5-448d-bbad-ccccb2b0eab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:30.670860 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd3ffd-86a5-448d-bbad-ccccb2b0eab8 admin admin] PATH_INFO: `/v3/users/bd7e825180504b9cb4f914bcf260106f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:30.672396 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd3ffd-86a5-448d-bbad-ccccb2b0eab8 admin admin] RBAC: Authorizing `identity:get_user(user_id=bd7e825180504b9cb4f914bcf260106f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:30.674259 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd3ffd-86a5-448d-bbad-ccccb2b0eab8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:30.675869 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Sun Jul 24 00:57:30 2022] GET /identity/v3/users/bd7e825180504b9cb4f914bcf260106f => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:32.724355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1e59c-705a-4287-8995-c1efaeeb2e9c None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:32.724902 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1e59c-705a-4287-8995-c1efaeeb2e9c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:32.724902 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1e59c-705a-4287-8995-c1efaeeb2e9c None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:32.726256 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:32.731811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28affc-ecd6-4ae9-b226-a531c9dba613 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:32.732258 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28affc-ecd6-4ae9-b226-a531c9dba613 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:32.732481 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b28affc-ecd6-4ae9-b226-a531c9dba613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:32.749420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2b28affc-ecd6-4ae9-b226-a531c9dba613 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:32.750584 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2b28affc-ecd6-4ae9-b226-a531c9dba613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:32.768899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd858dd1-88fe-428c-8723-b5740a06d979 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:32.769185 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd858dd1-88fe-428c-8723-b5740a06d979 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:32.769463 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd858dd1-88fe-428c-8723-b5740a06d979 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:32.770833 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:32.775859 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df5b2d-526d-4b35-bee8-e49c12fbe3ae None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:32.776146 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df5b2d-526d-4b35-bee8-e49c12fbe3ae None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:32.776422 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df5b2d-526d-4b35-bee8-e49c12fbe3ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:32.816415 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG passlib.handlers.bcrypt [None req-29df5b2d-526d-4b35-bee8-e49c12fbe3ae None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80519) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 24 00:57:32.816834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG passlib.handlers.bcrypt [None req-29df5b2d-526d-4b35-bee8-e49c12fbe3ae None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80519) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 24 00:57:32.833819 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:57:32.856883 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28affc-ecd6-4ae9-b226-a531c9dba613 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:32.862540 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-29df5b2d-526d-4b35-bee8-e49c12fbe3ae None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:32.864159 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-29df5b2d-526d-4b35-bee8-e49c12fbe3ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:32.881096 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:32.964160 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b28affc-ecd6-4ae9-b226-a531c9dba613 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:32.967767 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:32.988801 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df5b2d-526d-4b35-bee8-e49c12fbe3ae None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:32.997465 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c7aa8-1a06-4061-b275-4cb7b878ed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:32.998280 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c7aa8-1a06-4061-b275-4cb7b878ed74 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:32.998555 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c7aa8-1a06-4061-b275-4cb7b878ed74 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:32.998870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c7aa8-1a06-4061-b275-4cb7b878ed74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:33.010398 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c7aa8-1a06-4061-b275-4cb7b878ed74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-7f3c7aa8-1a06-4061-b275-4cb7b878ed74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:33.021750 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:33.022712 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:33.023596 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:33.023596 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:33.023596 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:33.023596 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:33.023596 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:33.023596 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:33.023596 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:33.023596 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:33.023596 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:33.023596 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:33.023596 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:57:33.023596 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:57:33.023596 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:57:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:33.029164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c7aa8-1a06-4061-b275-4cb7b878ed74 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:33.086982 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df5b2d-526d-4b35-bee8-e49c12fbe3ae None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:33.089207 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:33.108902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:33.123171 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beb179-8052-47b2-a5f8-fcfaefd25527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:33.124124 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beb179-8052-47b2-a5f8-fcfaefd25527 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:33.124413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beb179-8052-47b2-a5f8-fcfaefd25527 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:33.124692 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3beb179-8052-47b2-a5f8-fcfaefd25527 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:33.127439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c7aa8-1a06-4061-b275-4cb7b878ed74 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:33.160881 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2272f4-756b-40b4-8755-29616da4c3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:33.161676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2272f4-756b-40b4-8755-29616da4c3fb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:33.161966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2272f4-756b-40b4-8755-29616da4c3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:33.162237 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2272f4-756b-40b4-8755-29616da4c3fb None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:33.162994 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2272f4-756b-40b4-8755-29616da4c3fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:33.163532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2272f4-756b-40b4-8755-29616da4c3fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:33.165054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2272f4-756b-40b4-8755-29616da4c3fb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:33.176745 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:57:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:57:33.182425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2272f4-756b-40b4-8755-29616da4c3fb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:33.190379 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beb179-8052-47b2-a5f8-fcfaefd25527 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:33.192025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3beb179-8052-47b2-a5f8-fcfaefd25527 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:33.278595 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2272f4-756b-40b4-8755-29616da4c3fb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:33.288655 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:57:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:57:33.294557 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beb179-8052-47b2-a5f8-fcfaefd25527 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:33.297624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:33.312614 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2888881-bf67-4e2a-b713-ad58e95bf761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:33.313504 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2888881-bf67-4e2a-b713-ad58e95bf761 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:33.313790 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2888881-bf67-4e2a-b713-ad58e95bf761 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:33.314068 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2888881-bf67-4e2a-b713-ad58e95bf761 None admin] PATH_INFO: `/v3/users/bd7e825180504b9cb4f914bcf260106f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:33.315284 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2888881-bf67-4e2a-b713-ad58e95bf761 None admin] RBAC: Authorizing `identity:get_user(user_id=bd7e825180504b9cb4f914bcf260106f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:33.316797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2888881-bf67-4e2a-b713-ad58e95bf761 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:33.318505 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:33 2022] GET /identity/v3/users/bd7e825180504b9cb4f914bcf260106f => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:57:33.324187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2888881-bf67-4e2a-b713-ad58e95bf761 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:33.338185 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:33.391010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3beb179-8052-47b2-a5f8-fcfaefd25527 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:33.420507 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2888881-bf67-4e2a-b713-ad58e95bf761 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:33.425660 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377a8c0-b79e-469a-a03d-47538e325014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:33.426473 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377a8c0-b79e-469a-a03d-47538e325014 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:33.426758 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377a8c0-b79e-469a-a03d-47538e325014 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:33.427064 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377a8c0-b79e-469a-a03d-47538e325014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:33.447280 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377a8c0-b79e-469a-a03d-47538e325014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:33.449040 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b377a8c0-b79e-469a-a03d-47538e325014 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:33.457274 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9923f-33ac-4a90-919b-b7ed5497825b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:33.458088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9923f-33ac-4a90-919b-b7ed5497825b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:33.458367 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9923f-33ac-4a90-919b-b7ed5497825b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:33.458642 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9923f-33ac-4a90-919b-b7ed5497825b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:33.459884 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9923f-33ac-4a90-919b-b7ed5497825b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:33.461342 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9923f-33ac-4a90-919b-b7ed5497825b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:33.462934 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:57:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:57:33.468875 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9923f-33ac-4a90-919b-b7ed5497825b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:33.469267 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-b377a8c0-b79e-469a-a03d-47538e325014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:57:33.469267 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:33.469267 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:33.469267 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:33.469267 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:33.469267 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:33.469267 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:33.469267 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:33.469267 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:33.469267 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:33.469267 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:33.469267 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:33.469267 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:57:33.469267 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:57:33.469267 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:33.470070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:33.470888 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:57:33.470888 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:57:33.470888 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:57:33.470888 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:57:33.470888 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:57:33.476057 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377a8c0-b79e-469a-a03d-47538e325014 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:33.530244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:33.551164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:33.569375 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9923f-33ac-4a90-919b-b7ed5497825b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:33.571994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b377a8c0-b79e-469a-a03d-47538e325014 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:33.602922 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465e269-b6cc-469a-8fdf-bf36771df542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:33.603631 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465e269-b6cc-469a-8fdf-bf36771df542 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:33.603914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465e269-b6cc-469a-8fdf-bf36771df542 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:33.604193 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465e269-b6cc-469a-8fdf-bf36771df542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:33.604373 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a52bd-05f7-4b36-bf36-a85bf86d584b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:33.605022 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465e269-b6cc-469a-8fdf-bf36771df542 None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.domain.id=default, user.id=bd7e825180504b9cb4f914bcf260106f) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:33.605124 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a52bd-05f7-4b36-bf36-a85bf86d584b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:33.605303 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a52bd-05f7-4b36-bf36-a85bf86d584b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:33.605401 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465e269-b6cc-469a-8fdf-bf36771df542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:33.605621 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a52bd-05f7-4b36-bf36-a85bf86d584b None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:33.606342 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a52bd-05f7-4b36-bf36-a85bf86d584b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:33.606647 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a52bd-05f7-4b36-bf36-a85bf86d584b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:33.606804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465e269-b6cc-469a-8fdf-bf36771df542 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:33.608061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a52bd-05f7-4b36-bf36-a85bf86d584b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:33.613668 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1322 bytes} [Sun Jul 24 00:57:33 2022] GET /identity/v3/role_assignments?user.id=bd7e825180504b9cb4f914bcf260106f&scope.domain.id=default&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 233 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:57:33.626072 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:57:36.093319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3170198-ee1b-4e2f-810e-42c36013a82d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:36.093812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3170198-ee1b-4e2f-810e-42c36013a82d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:36.093812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3170198-ee1b-4e2f-810e-42c36013a82d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:36.095364 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:36.100578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fc20f-a932-4083-8843-c6ecb3bbccc9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:36.101385 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fc20f-a932-4083-8843-c6ecb3bbccc9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:36.101872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fc20f-a932-4083-8843-c6ecb3bbccc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:36.128283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-809fc20f-a932-4083-8843-c6ecb3bbccc9 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:36.129832 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-809fc20f-a932-4083-8843-c6ecb3bbccc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:36.147397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05159dd1-93fa-44a7-8440-602750119ba3 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:36.148015 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05159dd1-93fa-44a7-8440-602750119ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:36.148513 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05159dd1-93fa-44a7-8440-602750119ba3 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:36.150106 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 13/23] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:57:36.158811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c73ca1-b7e6-4912-8473-a208ba3cc128 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:36.159395 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c73ca1-b7e6-4912-8473-a208ba3cc128 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:36.159875 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c73ca1-b7e6-4912-8473-a208ba3cc128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:36.193520 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-60c73ca1-b7e6-4912-8473-a208ba3cc128 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:36.196762 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-60c73ca1-b7e6-4912-8473-a208ba3cc128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:36.271630 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 11/24] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:36.273340 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f719bbd-599b-45ba-91e8-8811655a655a None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:36.273833 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f719bbd-599b-45ba-91e8-8811655a655a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:36.274329 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f719bbd-599b-45ba-91e8-8811655a655a None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:36.275894 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 12/25] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:36.281548 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9d125-288e-4308-b873-40e70f8ced39 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:36.282095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9d125-288e-4308-b873-40e70f8ced39 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:36.282568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba9d125-288e-4308-b873-40e70f8ced39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:36.310582 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fba9d125-288e-4308-b873-40e70f8ced39 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:36.312946 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fba9d125-288e-4308-b873-40e70f8ced39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:36.337162 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 14/26] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:57:36.337162 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c73ca1-b7e6-4912-8473-a208ba3cc128 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:36.393201 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:36.438160 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:36.444706 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 13/27] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:36.445864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9d125-288e-4308-b873-40e70f8ced39 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:36.464371 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c73ca1-b7e6-4912-8473-a208ba3cc128 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:36.507095 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad07b24-8ad9-477d-b725-f76e2a244f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:36.507820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad07b24-8ad9-477d-b725-f76e2a244f1f None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:36.508113 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad07b24-8ad9-477d-b725-f76e2a244f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:36.508740 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad07b24-8ad9-477d-b725-f76e2a244f1f None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:36.509512 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad07b24-8ad9-477d-b725-f76e2a244f1f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:36.511623 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad07b24-8ad9-477d-b725-f76e2a244f1f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:36.576069 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba9d125-288e-4308-b873-40e70f8ced39 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:36.612851 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902a02c-b884-4aa4-b51f-2e55684debf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:36.613962 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902a02c-b884-4aa4-b51f-2e55684debf9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:36.614415 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902a02c-b884-4aa4-b51f-2e55684debf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:36.614834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902a02c-b884-4aa4-b51f-2e55684debf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:36.627154 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902a02c-b884-4aa4-b51f-2e55684debf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-4902a02c-b884-4aa4-b51f-2e55684debf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:36.636459 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:36.637554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:36.638525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:36.638525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:36.638525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:36.638525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:36.638525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:36.638525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:36.638525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:36.638525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:36.638525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:36.638525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:36.638525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:57:36.638525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:57:36.640622 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 14/28] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:57:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:36.642265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ed7d4-c28d-4ea1-8192-0d4b94219639 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:36.642701 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ed7d4-c28d-4ea1-8192-0d4b94219639 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:36.643134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0ed7d4-c28d-4ea1-8192-0d4b94219639 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:36.648689 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 15/30] 10.222.0.42 () {60 vars in 1131 bytes} [Sun Jul 24 00:57:36 2022] POST /identity/v3/roles => generated 219 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:57:36.648689 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad07b24-8ad9-477d-b725-f76e2a244f1f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:36.648868 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:36.648868 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ed7d4-c28d-4ea1-8192-0d4b94219639 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:36.702389 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:36.766340 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad07b24-8ad9-477d-b725-f76e2a244f1f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:36.803188 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0ed7d4-c28d-4ea1-8192-0d4b94219639 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:36.832100 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf69f6-45f6-4932-992a-cbd6607eaa84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:36.832944 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf69f6-45f6-4932-992a-cbd6607eaa84 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:36.833294 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf69f6-45f6-4932-992a-cbd6607eaa84 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:36.833576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbf69f6-45f6-4932-992a-cbd6607eaa84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:36.843269 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:36.852447 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a330d9-f60f-4247-b00c-7e8e930d7e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:36.853470 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a330d9-f60f-4247-b00c-7e8e930d7e05 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:36.853959 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a330d9-f60f-4247-b00c-7e8e930d7e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:36.854456 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a330d9-f60f-4247-b00c-7e8e930d7e05 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:36.855499 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a330d9-f60f-4247-b00c-7e8e930d7e05 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:36.856017 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a330d9-f60f-4247-b00c-7e8e930d7e05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:36.858173 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a330d9-f60f-4247-b00c-7e8e930d7e05 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:36.861956 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf69f6-45f6-4932-992a-cbd6607eaa84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:36.863702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbf69f6-45f6-4932-992a-cbd6607eaa84 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:36.874066 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 16/31] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:57:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:36.875975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639b041-ec4f-437b-81a0-74c3fbef3296 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:36.876472 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639b041-ec4f-437b-81a0-74c3fbef3296 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:36.876944 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0639b041-ec4f-437b-81a0-74c3fbef3296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:36.897987 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0639b041-ec4f-437b-81a0-74c3fbef3296 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:36.899903 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0639b041-ec4f-437b-81a0-74c3fbef3296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:36.901350 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-3fbf69f6-45f6-4932-992a-cbd6607eaa84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:57:36.901350 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:36.901350 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:36.901350 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:36.901350 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:36.901350 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:36.901350 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:36.901350 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:36.901350 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:36.901350 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:36.901350 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:36.901350 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:36.901350 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:57:36.901350 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:57:36.901350 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:36.902643 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:36.903883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:57:36.903883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:57:36.903883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:57:36.903883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:57:36.903883 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 16/32] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:36.903883 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf69f6-45f6-4932-992a-cbd6607eaa84 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:36.998497 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 17/33] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:36.999529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639b041-ec4f-437b-81a0-74c3fbef3296 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:37.041996 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:37.078455 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbf69f6-45f6-4932-992a-cbd6607eaa84 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:37.116896 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0ae45-8d3c-47ea-b5c2-724b5d14fbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:37.117795 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0ae45-8d3c-47ea-b5c2-724b5d14fbba None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:37.118083 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0ae45-8d3c-47ea-b5c2-724b5d14fbba None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:37.118382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f0ae45-8d3c-47ea-b5c2-724b5d14fbba None admin] PATH_INFO: `/v3/users/bd7e825180504b9cb4f914bcf260106f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:37.119693 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0ae45-8d3c-47ea-b5c2-724b5d14fbba None admin] RBAC: Authorizing `identity:get_user(user_id=bd7e825180504b9cb4f914bcf260106f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:37.121247 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f0ae45-8d3c-47ea-b5c2-724b5d14fbba None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:37.122892 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 17/34] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:36 2022] GET /identity/v3/users/bd7e825180504b9cb4f914bcf260106f => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:37.123694 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0ae45-8d3c-47ea-b5c2-724b5d14fbba None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:37.138869 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0639b041-ec4f-437b-81a0-74c3fbef3296 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:37.178993 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0513f3-6f5c-422b-a730-55edd96662aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:37.180044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0513f3-6f5c-422b-a730-55edd96662aa None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:37.180528 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0513f3-6f5c-422b-a730-55edd96662aa None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:37.181300 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:37.181518 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0513f3-6f5c-422b-a730-55edd96662aa None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:37.182870 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0513f3-6f5c-422b-a730-55edd96662aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:37.186123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0513f3-6f5c-422b-a730-55edd96662aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:37.188114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0513f3-6f5c-422b-a730-55edd96662aa None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:37.201870 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 18/35] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:37.203231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0513f3-6f5c-422b-a730-55edd96662aa None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:37.228273 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f0ae45-8d3c-47ea-b5c2-724b5d14fbba None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:37.264272 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7cc44-ddc1-42a6-9eeb-c5048718cfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:37.264969 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7cc44-ddc1-42a6-9eeb-c5048718cfe2 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:37.265259 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7cc44-ddc1-42a6-9eeb-c5048718cfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:37.265543 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7cc44-ddc1-42a6-9eeb-c5048718cfe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:37.266394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7cc44-ddc1-42a6-9eeb-c5048718cfe2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:37.267765 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7cc44-ddc1-42a6-9eeb-c5048718cfe2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:37.283285 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 18/36] 10.222.0.42 () {60 vars in 1131 bytes} [Sun Jul 24 00:57:37 2022] POST /identity/v3/roles => generated 225 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:57:37.283987 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7cc44-ddc1-42a6-9eeb-c5048718cfe2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:37.312048 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:37.339077 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0513f3-6f5c-422b-a730-55edd96662aa None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:37.389581 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e2e66-0619-4cc7-84a0-2b6923e5d24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:37.390412 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e2e66-0619-4cc7-84a0-2b6923e5d24d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:37.390695 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e2e66-0619-4cc7-84a0-2b6923e5d24d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:37.391407 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e2e66-0619-4cc7-84a0-2b6923e5d24d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:37.393190 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e2e66-0619-4cc7-84a0-2b6923e5d24d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:37.394690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e2e66-0619-4cc7-84a0-2b6923e5d24d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:37.396922 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 19/37] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:57:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:37.398734 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51dee0-e56d-4d3c-bfaa-73f429ce8e24 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:37.399054 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51dee0-e56d-4d3c-bfaa-73f429ce8e24 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:37.399575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51dee0-e56d-4d3c-bfaa-73f429ce8e24 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:37.400974 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 20/38] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:37.402528 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51dee0-e56d-4d3c-bfaa-73f429ce8e24 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:37.442053 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7cc44-ddc1-42a6-9eeb-c5048718cfe2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:37.463757 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:37.487388 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5765fe-6f12-4015-858d-c82e5a964304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:37.488072 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5765fe-6f12-4015-858d-c82e5a964304 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:37.490003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5765fe-6f12-4015-858d-c82e5a964304 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:37.490003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5765fe-6f12-4015-858d-c82e5a964304 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:37.490003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5765fe-6f12-4015-858d-c82e5a964304 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:37.490902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5765fe-6f12-4015-858d-c82e5a964304 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:37.529011 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Jul 24 00:57:37 2022] POST /identity/v3/projects => generated 301 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:57:37.530753 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d047f-4303-4ed2-b63e-1190ffcb18be None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:37.530753 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d047f-4303-4ed2-b63e-1190ffcb18be None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:37.531084 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8d047f-4303-4ed2-b63e-1190ffcb18be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:37.539189 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51dee0-e56d-4d3c-bfaa-73f429ce8e24 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:37.550421 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0d8d047f-4303-4ed2-b63e-1190ffcb18be None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:37.552177 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0d8d047f-4303-4ed2-b63e-1190ffcb18be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:37.590130 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685665b-132c-446f-a141-7625fb3e4aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:37.591217 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685665b-132c-446f-a141-7625fb3e4aca None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:37.591528 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685665b-132c-446f-a141-7625fb3e4aca None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:37.591809 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685665b-132c-446f-a141-7625fb3e4aca None admin] PATH_INFO: `/v3/domains/default/users/bd7e825180504b9cb4f914bcf260106f/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:37.594464 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685665b-132c-446f-a141-7625fb3e4aca None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bd7e825180504b9cb4f914bcf260106f, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:37.596824 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685665b-132c-446f-a141-7625fb3e4aca None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:37.640353 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 20/40] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:37.665762 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d047f-4303-4ed2-b63e-1190ffcb18be None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:37.734616 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 21/41] 10.222.0.42 () {58 vars in 1361 bytes} [Sun Jul 24 00:57:37 2022] PUT /identity/v3/domains/default/users/bd7e825180504b9cb4f914bcf260106f/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:57:37.736560 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b593c2f-516b-4074-bb9f-880112bf3e60 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:37.736865 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b593c2f-516b-4074-bb9f-880112bf3e60 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:37.737154 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b593c2f-516b-4074-bb9f-880112bf3e60 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:37.741879 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 22/42] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:37.748448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5cf34-c564-4c06-ad0d-2c2af7ddb2e6 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:37.748744 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5cf34-c564-4c06-ad0d-2c2af7ddb2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:37.749020 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5cf34-c564-4c06-ad0d-2c2af7ddb2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:37.770892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2fa5cf34-c564-4c06-ad0d-2c2af7ddb2e6 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:37.772568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2fa5cf34-c564-4c06-ad0d-2c2af7ddb2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:37.782039 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:37.789333 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:37.789634 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8d047f-4303-4ed2-b63e-1190ffcb18be None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:37.835897 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e3467-b675-4cbb-aa3a-a0e64847b25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:37.836603 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e3467-b675-4cbb-aa3a-a0e64847b25b None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:37.836885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e3467-b675-4cbb-aa3a-a0e64847b25b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:37.837166 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1e3467-b675-4cbb-aa3a-a0e64847b25b None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:37.837974 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e3467-b675-4cbb-aa3a-a0e64847b25b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:37.839443 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1e3467-b675-4cbb-aa3a-a0e64847b25b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:37.855153 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 21/43] 10.222.0.42 () {60 vars in 1131 bytes} [Sun Jul 24 00:57:37 2022] POST /identity/v3/roles => generated 223 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:57:37.871060 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 23/44] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:37.894905 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e3467-b675-4cbb-aa3a-a0e64847b25b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:38.117624 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1e3467-b675-4cbb-aa3a-a0e64847b25b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:38.152170 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754dfecb-14b5-40e5-9923-6cd0bc5d9708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:38.153041 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dfecb-14b5-40e5-9923-6cd0bc5d9708 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:38.153325 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dfecb-14b5-40e5-9923-6cd0bc5d9708 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:38.153601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754dfecb-14b5-40e5-9923-6cd0bc5d9708 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:38.154824 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754dfecb-14b5-40e5-9923-6cd0bc5d9708 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:38.156329 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754dfecb-14b5-40e5-9923-6cd0bc5d9708 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:38.157960 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 22/45] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:57:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:38.163740 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5cf34-c564-4c06-ad0d-2c2af7ddb2e6 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:38.264293 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5cf34-c564-4c06-ad0d-2c2af7ddb2e6 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:38.408901 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea74ec-2d33-4c3f-8548-da351dc67502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:38.409481 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea74ec-2d33-4c3f-8548-da351dc67502 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:38.409766 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea74ec-2d33-4c3f-8548-da351dc67502 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:38.410045 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea74ec-2d33-4c3f-8548-da351dc67502 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:38.410779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea74ec-2d33-4c3f-8548-da351dc67502 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:38.412409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbea74ec-2d33-4c3f-8548-da351dc67502 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:38.435394 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:38.455927 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Jul 24 00:57:38 2022] POST /identity/v3/projects => generated 312 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:57:39.784423 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab021a97-dfb3-425e-a3ef-66829e9678b4 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:39.784940 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab021a97-dfb3-425e-a3ef-66829e9678b4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:39.785022 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab021a97-dfb3-425e-a3ef-66829e9678b4 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:39.786393 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 23/47] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:39.791984 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7009e11-6e3d-469b-ba42-9c6a063b0ffa None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:39.792378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7009e11-6e3d-469b-ba42-9c6a063b0ffa None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:39.792579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7009e11-6e3d-469b-ba42-9c6a063b0ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:39.809629 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f7009e11-6e3d-469b-ba42-9c6a063b0ffa None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:39.810841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f7009e11-6e3d-469b-ba42-9c6a063b0ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:39.878119 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:39.900723 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab021a97-dfb3-425e-a3ef-66829e9678b4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:39.928213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:40.009401 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab021a97-dfb3-425e-a3ef-66829e9678b4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:40.043259 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb96560-e393-4995-bd04-20638c36a4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:40.044087 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb96560-e393-4995-bd04-20638c36a4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:40.044375 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb96560-e393-4995-bd04-20638c36a4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:40.044655 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb96560-e393-4995-bd04-20638c36a4d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:40.055951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb96560-e393-4995-bd04-20638c36a4d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-beb96560-e393-4995-bd04-20638c36a4d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:40.063764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:40.064770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:40.065651 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:40.065651 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:40.065651 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:40.065651 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:40.065651 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:40.065651 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:40.065651 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:40.065651 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:40.065651 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:40.065651 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:40.065651 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:57:40.065651 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:57:40.065651 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 24/49] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:57:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:40.071434 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7009e11-6e3d-469b-ba42-9c6a063b0ffa None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:40.176429 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7009e11-6e3d-469b-ba42-9c6a063b0ffa None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:40.203073 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:40.211656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915baf54-5ff9-4e7b-bf7b-eaf01557c29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:40.212339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915baf54-5ff9-4e7b-bf7b-eaf01557c29d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:40.212631 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915baf54-5ff9-4e7b-bf7b-eaf01557c29d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:40.212903 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915baf54-5ff9-4e7b-bf7b-eaf01557c29d None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:40.213679 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915baf54-5ff9-4e7b-bf7b-eaf01557c29d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:40.213990 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915baf54-5ff9-4e7b-bf7b-eaf01557c29d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:40.215471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915baf54-5ff9-4e7b-bf7b-eaf01557c29d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:40.223956 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 26/50] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:57:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:40.229866 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb96560-e393-4995-bd04-20638c36a4d5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:40.314364 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:40.337048 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb96560-e393-4995-bd04-20638c36a4d5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:40.371284 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0125df-2b2d-472b-9df6-e38226af42fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:40.372198 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0125df-2b2d-472b-9df6-e38226af42fe None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:40.372502 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0125df-2b2d-472b-9df6-e38226af42fe None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:40.372756 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0125df-2b2d-472b-9df6-e38226af42fe None admin] PATH_INFO: `/v3/users/bd7e825180504b9cb4f914bcf260106f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:40.373981 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0125df-2b2d-472b-9df6-e38226af42fe None admin] RBAC: Authorizing `identity:get_user(user_id=bd7e825180504b9cb4f914bcf260106f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:40.375476 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0125df-2b2d-472b-9df6-e38226af42fe None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:40.377100 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 25/51] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:40 2022] GET /identity/v3/users/bd7e825180504b9cb4f914bcf260106f => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:40.382720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915baf54-5ff9-4e7b-bf7b-eaf01557c29d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:40.439186 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e0459-f228-4764-8b7e-173f458390a3 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:40.439542 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e0459-f228-4764-8b7e-173f458390a3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:40.439822 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e0459-f228-4764-8b7e-173f458390a3 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:40.441208 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 26/52] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:40.446524 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853df6c2-f2e3-48dc-ace0-b7d4d5e00981 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:40.446814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853df6c2-f2e3-48dc-ace0-b7d4d5e00981 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:40.447093 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853df6c2-f2e3-48dc-ace0-b7d4d5e00981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:40.464793 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-853df6c2-f2e3-48dc-ace0-b7d4d5e00981 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:40.466294 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-853df6c2-f2e3-48dc-ace0-b7d4d5e00981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:40.487241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915baf54-5ff9-4e7b-bf7b-eaf01557c29d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:40.522924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaddab4-1c9a-4083-8d0c-e316af1c356d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:40.523865 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaddab4-1c9a-4083-8d0c-e316af1c356d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:40.524283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaddab4-1c9a-4083-8d0c-e316af1c356d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:40.524566 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaddab4-1c9a-4083-8d0c-e316af1c356d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:40.525899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaddab4-1c9a-4083-8d0c-e316af1c356d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:40.527651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaddab4-1c9a-4083-8d0c-e316af1c356d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:40.529399 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:57:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:40.535619 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaddab4-1c9a-4083-8d0c-e316af1c356d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:40.541144 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 27/54] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:40.566495 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853df6c2-f2e3-48dc-ace0-b7d4d5e00981 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:40.597663 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:40.640031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaddab4-1c9a-4083-8d0c-e316af1c356d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:40.645001 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:40.662907 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853df6c2-f2e3-48dc-ace0-b7d4d5e00981 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:40.672999 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231cc65-5a78-4f45-9e92-ee6d441bd5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:40.673663 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231cc65-5a78-4f45-9e92-ee6d441bd5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:40.673947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231cc65-5a78-4f45-9e92-ee6d441bd5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:40.674227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231cc65-5a78-4f45-9e92-ee6d441bd5f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:40.675064 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231cc65-5a78-4f45-9e92-ee6d441bd5f0 None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.domain.id=default, user.id=bd7e825180504b9cb4f914bcf260106f) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:40.675401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231cc65-5a78-4f45-9e92-ee6d441bd5f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:40.676877 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231cc65-5a78-4f45-9e92-ee6d441bd5f0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:40.684715 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1322 bytes} [Sun Jul 24 00:57:40 2022] GET /identity/v3/role_assignments?user.id=bd7e825180504b9cb4f914bcf260106f&scope.domain.id=default&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:40.696502 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9802f18d-b092-4f67-a18b-a7ea99a20623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:40.697356 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802f18d-b092-4f67-a18b-a7ea99a20623 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:40.697645 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802f18d-b092-4f67-a18b-a7ea99a20623 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:40.697930 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9802f18d-b092-4f67-a18b-a7ea99a20623 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:40.699327 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802f18d-b092-4f67-a18b-a7ea99a20623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:40.700837 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9802f18d-b092-4f67-a18b-a7ea99a20623 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:40.702572 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 28/56] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:57:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:57:40.708720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231cc65-5a78-4f45-9e92-ee6d441bd5f0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:40.820520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231cc65-5a78-4f45-9e92-ee6d441bd5f0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:40.844463 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:40.856789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53b150-2520-4119-b11b-559969554875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:40.857471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53b150-2520-4119-b11b-559969554875 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:40.857756 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53b150-2520-4119-b11b-559969554875 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:40.858059 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53b150-2520-4119-b11b-559969554875 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:40.858763 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53b150-2520-4119-b11b-559969554875 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:40.860261 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53b150-2520-4119-b11b-559969554875 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:40.886100 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 29/57] 10.222.0.42 () {60 vars in 1140 bytes} [Sun Jul 24 00:57:40 2022] POST /identity/v3/projects => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:57:42.883196 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081604e-940b-49c8-a5e6-61cf328e2902 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:42.884021 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081604e-940b-49c8-a5e6-61cf328e2902 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:42.884135 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081604e-940b-49c8-a5e6-61cf328e2902 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:42.886332 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 29/58] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:42.894215 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24082d4-9abb-486e-8f0d-f5aa0f7d1924 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:42.894642 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24082d4-9abb-486e-8f0d-f5aa0f7d1924 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:42.894727 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24082d4-9abb-486e-8f0d-f5aa0f7d1924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:42.912687 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e24082d4-9abb-486e-8f0d-f5aa0f7d1924 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:42.913890 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e24082d4-9abb-486e-8f0d-f5aa0f7d1924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:42.991652 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 30/59] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:43.016771 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081604e-940b-49c8-a5e6-61cf328e2902 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:43.130121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081604e-940b-49c8-a5e6-61cf328e2902 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:43.167328 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b4e999-2770-4da7-b67b-498fa4d38e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:43.168185 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4e999-2770-4da7-b67b-498fa4d38e07 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:43.168470 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4e999-2770-4da7-b67b-498fa4d38e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:43.168751 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b4e999-2770-4da7-b67b-498fa4d38e07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:43.170063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4e999-2770-4da7-b67b-498fa4d38e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:43.171569 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b4e999-2770-4da7-b67b-498fa4d38e07 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:43.173166 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 30/60] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:57:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:43.181298 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24082d4-9abb-486e-8f0d-f5aa0f7d1924 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:43.285465 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24082d4-9abb-486e-8f0d-f5aa0f7d1924 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:43.288045 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:43.326745 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0245823-960f-4b7a-8493-4cf3c9d4ad93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:43.327460 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0245823-960f-4b7a-8493-4cf3c9d4ad93 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:43.327749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0245823-960f-4b7a-8493-4cf3c9d4ad93 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:43.328030 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0245823-960f-4b7a-8493-4cf3c9d4ad93 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:43.328752 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0245823-960f-4b7a-8493-4cf3c9d4ad93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:43.330239 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0245823-960f-4b7a-8493-4cf3c9d4ad93 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:43.362206 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 31/61] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 00:57:43 2022] POST /identity/v3/users => generated 275 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:57:46.449191 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda97782-87ef-4c1c-9814-52d87cc9931c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:46.450216 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda97782-87ef-4c1c-9814-52d87cc9931c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:46.450722 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda97782-87ef-4c1c-9814-52d87cc9931c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:46.452364 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 31/62] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:46.457864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917152c6-f53d-4b83-87b7-6b5c3b0fdc63 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:46.458707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917152c6-f53d-4b83-87b7-6b5c3b0fdc63 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:46.459185 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917152c6-f53d-4b83-87b7-6b5c3b0fdc63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:46.484313 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-917152c6-f53d-4b83-87b7-6b5c3b0fdc63 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:46.485860 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-917152c6-f53d-4b83-87b7-6b5c3b0fdc63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:46.573748 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 32/63] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:46.620861 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda97782-87ef-4c1c-9814-52d87cc9931c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:46.632018 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf8e17-90ef-4888-92b4-f50e9efd669f None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:46.634294 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf8e17-90ef-4888-92b4-f50e9efd669f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:46.634997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf8e17-90ef-4888-92b4-f50e9efd669f None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:46.637746 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 33/64] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:46.644707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04c9e1-dc60-4ca1-9341-2df491f2fd0a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:46.644992 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04c9e1-dc60-4ca1-9341-2df491f2fd0a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:46.645271 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04c9e1-dc60-4ca1-9341-2df491f2fd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:46.654184 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:46.675033 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9a04c9e1-dc60-4ca1-9341-2df491f2fd0a None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:46.676290 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9a04c9e1-dc60-4ca1-9341-2df491f2fd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:46.791366 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda97782-87ef-4c1c-9814-52d87cc9931c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:46.841260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7eee42-ff47-4bf6-8c47-087628a14d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:46.842323 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7eee42-ff47-4bf6-8c47-087628a14d2b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:46.842752 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7eee42-ff47-4bf6-8c47-087628a14d2b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:46.843171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7eee42-ff47-4bf6-8c47-087628a14d2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:46.843651 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 34/65] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:57:46.857685 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7eee42-ff47-4bf6-8c47-087628a14d2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:46.872365 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70c244-5da1-4226-8674-3bbb63ddb5f3 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:46.872654 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70c244-5da1-4226-8674-3bbb63ddb5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:46.872938 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70c244-5da1-4226-8674-3bbb63ddb5f3 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ab7eee42-ff47-4bf6-8c47-087628a14d2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:46.873770 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:46.874802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:46.875901 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:46.875901 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:46.875901 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:46.875901 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:46.875901 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:46.875901 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:46.875901 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:46.875901 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:46.875901 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:46.875901 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:46.875901 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:57:46.875901 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:57:46.876637 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 35/66] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:57:46.876723 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70c244-5da1-4226-8674-3bbb63ddb5f3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:46.878531 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 32/67] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:57:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:46.882196 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531214d-44c2-4ebe-988b-96264c9e42d9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:46.882655 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531214d-44c2-4ebe-988b-96264c9e42d9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:46.883092 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531214d-44c2-4ebe-988b-96264c9e42d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:46.903708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d531214d-44c2-4ebe-988b-96264c9e42d9 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:46.905146 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d531214d-44c2-4ebe-988b-96264c9e42d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:46.947719 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:46.975274 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 33/68] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:57:46.983599 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531214d-44c2-4ebe-988b-96264c9e42d9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:46.997042 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:47.003244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70c244-5da1-4226-8674-3bbb63ddb5f3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:47.037634 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448c987-d6ff-4e50-b3c7-72171ab8288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:47.038455 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c987-d6ff-4e50-b3c7-72171ab8288a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.038749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c987-d6ff-4e50-b3c7-72171ab8288a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.039029 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448c987-d6ff-4e50-b3c7-72171ab8288a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.048914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448c987-d6ff-4e50-b3c7-72171ab8288a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-5448c987-d6ff-4e50-b3c7-72171ab8288a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:47.056677 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:47.057525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:47.058763 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:47.058763 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:47.058763 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:47.058763 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:47.058763 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:47.058763 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:47.058763 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:47.058763 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:47.058763 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:47.058763 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:47.058763 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:57:47.058763 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:57:47.058763 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 36/69] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:57:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:47.059696 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58d2b6-2d37-48b1-8dce-d6a0d228fc7a None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.059696 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58d2b6-2d37-48b1-8dce-d6a0d228fc7a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.059832 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58d2b6-2d37-48b1-8dce-d6a0d228fc7a None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.061200 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 37/70] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:47.064084 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58d2b6-2d37-48b1-8dce-d6a0d228fc7a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:47.087289 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d531214d-44c2-4ebe-988b-96264c9e42d9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:47.119994 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64862bed-0335-47b0-8c52-3c845aaff86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:47.120746 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64862bed-0335-47b0-8c52-3c845aaff86b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.121038 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64862bed-0335-47b0-8c52-3c845aaff86b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.121319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64862bed-0335-47b0-8c52-3c845aaff86b None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.122074 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64862bed-0335-47b0-8c52-3c845aaff86b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:47.122389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64862bed-0335-47b0-8c52-3c845aaff86b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:47.123831 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64862bed-0335-47b0-8c52-3c845aaff86b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:47.131909 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 34/71] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:57:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:47.136583 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb02fe-e9f4-48e1-b154-05d846aeb906 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.136583 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb02fe-e9f4-48e1-b154-05d846aeb906 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.136583 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb02fe-e9f4-48e1-b154-05d846aeb906 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.136583 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 35/72] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:47.139852 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb02fe-e9f4-48e1-b154-05d846aeb906 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:47.146987 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:47.167777 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b58d2b6-2d37-48b1-8dce-d6a0d228fc7a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:47.201008 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1198e2e-a32e-4779-aea6-384ec8364712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:47.201827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1198e2e-a32e-4779-aea6-384ec8364712 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.202108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1198e2e-a32e-4779-aea6-384ec8364712 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.202373 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1198e2e-a32e-4779-aea6-384ec8364712 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.209351 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:47.212271 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1198e2e-a32e-4779-aea6-384ec8364712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-c1198e2e-a32e-4779-aea6-384ec8364712 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:47.220515 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:47.221374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:47.222374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:47.222374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:47.222374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:47.222374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:47.222374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:47.222374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:47.222374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:47.222374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:47.222374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:47.222374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:47.222374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:57:47.222374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:57:47.222374 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 38/73] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:57:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:47.223248 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c2e91-cbc2-432f-be9a-ed1634f100da None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.223248 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c2e91-cbc2-432f-be9a-ed1634f100da None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.223508 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621c2e91-cbc2-432f-be9a-ed1634f100da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.240903 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-621c2e91-cbc2-432f-be9a-ed1634f100da None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:47.242076 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-621c2e91-cbc2-432f-be9a-ed1634f100da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:47.244727 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb02fe-e9f4-48e1-b154-05d846aeb906 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:47.277320 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9102dc2-c13b-466d-b344-bba1ffe23550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:47.277985 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9102dc2-c13b-466d-b344-bba1ffe23550 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.278268 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9102dc2-c13b-466d-b344-bba1ffe23550 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.278544 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9102dc2-c13b-466d-b344-bba1ffe23550 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.279286 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9102dc2-c13b-466d-b344-bba1ffe23550 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:47.279625 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9102dc2-c13b-466d-b344-bba1ffe23550 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:47.281019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9102dc2-c13b-466d-b344-bba1ffe23550 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:47.289324 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 36/74] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:57:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:47.292745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9102dc2-c13b-466d-b344-bba1ffe23550 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:47.309344 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 39/75] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:47.310624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68466a41-ca3d-4285-9b7d-d3b31e4168cb None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.310924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68466a41-ca3d-4285-9b7d-d3b31e4168cb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.311206 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68466a41-ca3d-4285-9b7d-d3b31e4168cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.334620 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-68466a41-ca3d-4285-9b7d-d3b31e4168cb None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:47.335857 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-68466a41-ca3d-4285-9b7d-d3b31e4168cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:47.384414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9102dc2-c13b-466d-b344-bba1ffe23550 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:47.397388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:47.415315 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 40/76] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:47.415315 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68466a41-ca3d-4285-9b7d-d3b31e4168cb None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:47.415534 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:47.418514 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8b50e-c581-42e6-be22-96c29cdcaac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:47.419438 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8b50e-c581-42e6-be22-96c29cdcaac5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.419739 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8b50e-c581-42e6-be22-96c29cdcaac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.420003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8b50e-c581-42e6-be22-96c29cdcaac5 None admin] PATH_INFO: `/v3/users/bd7e825180504b9cb4f914bcf260106f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.421206 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8b50e-c581-42e6-be22-96c29cdcaac5 None admin] RBAC: Authorizing `identity:get_user(user_id=bd7e825180504b9cb4f914bcf260106f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:47.422697 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8b50e-c581-42e6-be22-96c29cdcaac5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:47.424630 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 37/77] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:47 2022] GET /identity/v3/users/bd7e825180504b9cb4f914bcf260106f => generated 247 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:47.425394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8b50e-c581-42e6-be22-96c29cdcaac5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:47.518573 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68466a41-ca3d-4285-9b7d-d3b31e4168cb None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:47.525321 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8b50e-c581-42e6-be22-96c29cdcaac5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:47.553103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23202e0-ce80-424f-a271-98456044c10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:47.553785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23202e0-ce80-424f-a271-98456044c10d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.554073 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23202e0-ce80-424f-a271-98456044c10d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.554363 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23202e0-ce80-424f-a271-98456044c10d None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.555122 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23202e0-ce80-424f-a271-98456044c10d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:47.555472 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23202e0-ce80-424f-a271-98456044c10d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:47.556894 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23202e0-ce80-424f-a271-98456044c10d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:47.558058 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4068bf-35c3-4dee-a7d7-178bae31cc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:47.558939 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4068bf-35c3-4dee-a7d7-178bae31cc73 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.559243 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4068bf-35c3-4dee-a7d7-178bae31cc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.559622 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4068bf-35c3-4dee-a7d7-178bae31cc73 None admin] PATH_INFO: `/v3/users/30e9db5e0da449078023b57bb514a0b6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.565129 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 41/78] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:57:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:47.565921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23202e0-ce80-424f-a271-98456044c10d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:47.574235 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4068bf-35c3-4dee-a7d7-178bae31cc73 None admin] RBAC: Authorizing `identity:get_user(user_id=30e9db5e0da449078023b57bb514a0b6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:47.575738 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4068bf-35c3-4dee-a7d7-178bae31cc73 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:47.577424 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 38/79] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:47 2022] GET /identity/v3/users/30e9db5e0da449078023b57bb514a0b6 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:47.578171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4068bf-35c3-4dee-a7d7-178bae31cc73 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:47.629254 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:47.636556 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:47.668480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23202e0-ce80-424f-a271-98456044c10d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:47.677001 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4068bf-35c3-4dee-a7d7-178bae31cc73 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:47.700947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ffc89-db01-45e1-8520-f05da6b4c97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:47.701759 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ffc89-db01-45e1-8520-f05da6b4c97b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.702044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ffc89-db01-45e1-8520-f05da6b4c97b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.702348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ffc89-db01-45e1-8520-f05da6b4c97b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.703537 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ffc89-db01-45e1-8520-f05da6b4c97b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:47.704988 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ffc89-db01-45e1-8520-f05da6b4c97b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:47.706627 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 42/80] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:57:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:47.707420 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ffc89-db01-45e1-8520-f05da6b4c97b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:47.710575 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf948af0-e19b-4e18-9988-d58e2dc18ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:47.711465 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf948af0-e19b-4e18-9988-d58e2dc18ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.711748 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf948af0-e19b-4e18-9988-d58e2dc18ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.712021 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf948af0-e19b-4e18-9988-d58e2dc18ce2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.722007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf948af0-e19b-4e18-9988-d58e2dc18ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-bf948af0-e19b-4e18-9988-d58e2dc18ce2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:47.729756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:47.730717 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:47.731911 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:47.731911 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:47.731911 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:47.731911 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:47.731911 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:47.731911 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:47.731911 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:47.731911 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:47.731911 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:47.731911 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:47.731911 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:57:47.731911 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:57:47.731911 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 39/81] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:57:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:47.731911 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf948af0-e19b-4e18-9988-d58e2dc18ce2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:47.808543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ffc89-db01-45e1-8520-f05da6b4c97b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:47.831723 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf948af0-e19b-4e18-9988-d58e2dc18ce2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:47.838030 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:47.844708 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1c672-8145-4d8e-83c3-1d77cc6d7729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:47.845369 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1c672-8145-4d8e-83c3-1d77cc6d7729 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.845655 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1c672-8145-4d8e-83c3-1d77cc6d7729 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.845929 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1c672-8145-4d8e-83c3-1d77cc6d7729 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.848647 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:47.865679 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d0cc4-b6b9-4169-8cbd-ab753dff7cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:47.866571 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d0cc4-b6b9-4169-8cbd-ab753dff7cdb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:47.866861 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d0cc4-b6b9-4169-8cbd-ab753dff7cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:47.867142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4d0cc4-b6b9-4169-8cbd-ab753dff7cdb None admin] PATH_INFO: `/v3/users/30e9db5e0da449078023b57bb514a0b6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:47.868376 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d0cc4-b6b9-4169-8cbd-ab753dff7cdb None admin] RBAC: Authorizing `identity:get_user(user_id=30e9db5e0da449078023b57bb514a0b6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:47.869862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4d0cc4-b6b9-4169-8cbd-ab753dff7cdb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:47.871631 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 40/82] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:47 2022] GET /identity/v3/users/30e9db5e0da449078023b57bb514a0b6 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:47.876148 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d0cc4-b6b9-4169-8cbd-ab753dff7cdb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:47.911707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1c672-8145-4d8e-83c3-1d77cc6d7729 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:47.913183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1c672-8145-4d8e-83c3-1d77cc6d7729 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:47.971316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4d0cc4-b6b9-4169-8cbd-ab753dff7cdb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:48.005453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf17df-bf3b-45e5-8732-cbef8db5cc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:48.006105 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf17df-bf3b-45e5-8732-cbef8db5cc97 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:48.006396 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf17df-bf3b-45e5-8732-cbef8db5cc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:48.006678 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebf17df-bf3b-45e5-8732-cbef8db5cc97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:48.007526 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 43/83] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:57:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:57:48.008336 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1c672-8145-4d8e-83c3-1d77cc6d7729 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:48.039466 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:48.061369 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:48.074970 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf17df-bf3b-45e5-8732-cbef8db5cc97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:48.076454 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebf17df-bf3b-45e5-8732-cbef8db5cc97 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:48.107783 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1c672-8145-4d8e-83c3-1d77cc6d7729 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:48.140077 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9511374-5d57-4557-a0bd-1745309e9e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:48.140745 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9511374-5d57-4557-a0bd-1745309e9e14 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:48.141021 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9511374-5d57-4557-a0bd-1745309e9e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:48.141306 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9511374-5d57-4557-a0bd-1745309e9e14 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:48.142054 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9511374-5d57-4557-a0bd-1745309e9e14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:48.143540 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9511374-5d57-4557-a0bd-1745309e9e14 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:48.163445 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 44/84] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 00:57:48 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:57:48.172372 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9511374-5d57-4557-a0bd-1745309e9e14 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:48.178670 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 41/85] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:57:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:57:48.178670 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf17df-bf3b-45e5-8732-cbef8db5cc97 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:48.269737 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:48.277040 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:48.289800 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebf17df-bf3b-45e5-8732-cbef8db5cc97 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:48.293289 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9511374-5d57-4557-a0bd-1745309e9e14 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:48.329907 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43820cc8-901a-4199-ab58-d93ff800ab39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:48.330751 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c722e-cb23-428c-a0b7-4b1724ee3727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:48.330889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43820cc8-901a-4199-ab58-d93ff800ab39 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:48.331179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43820cc8-901a-4199-ab58-d93ff800ab39 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:48.331466 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c722e-cb23-428c-a0b7-4b1724ee3727 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:48.331561 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43820cc8-901a-4199-ab58-d93ff800ab39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:48.331753 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c722e-cb23-428c-a0b7-4b1724ee3727 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:48.332048 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c722e-cb23-428c-a0b7-4b1724ee3727 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:48.332789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c722e-cb23-428c-a0b7-4b1724ee3727 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:48.333102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c722e-cb23-428c-a0b7-4b1724ee3727 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:48.334705 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981c722e-cb23-428c-a0b7-4b1724ee3727 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:48.345642 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 45/86] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:57:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:48.346638 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c722e-cb23-428c-a0b7-4b1724ee3727 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:48.414019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43820cc8-901a-4199-ab58-d93ff800ab39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:48.415483 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43820cc8-901a-4199-ab58-d93ff800ab39 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:48.473741 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c722e-cb23-428c-a0b7-4b1724ee3727 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:48.509609 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb7bc3-7a1f-48fa-b762-ed316d678a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:48.510533 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb7bc3-7a1f-48fa-b762-ed316d678a90 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:48.510823 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb7bc3-7a1f-48fa-b762-ed316d678a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:48.511444 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fb7bc3-7a1f-48fa-b762-ed316d678a90 None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:48.512712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb7bc3-7a1f-48fa-b762-ed316d678a90 None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:48.514377 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fb7bc3-7a1f-48fa-b762-ed316d678a90 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:48.516247 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 46/87] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:57:48 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:48.517024 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:48.517162 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb7bc3-7a1f-48fa-b762-ed316d678a90 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:48.538207 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:48.538811 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 42/88] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:57:48.541870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43820cc8-901a-4199-ab58-d93ff800ab39 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:48.633598 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fb7bc3-7a1f-48fa-b762-ed316d678a90 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:48.669196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ed380-c34a-46b5-a4a1-0b382f7df6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:48.670128 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ed380-c34a-46b5-a4a1-0b382f7df6ab None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:48.670417 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ed380-c34a-46b5-a4a1-0b382f7df6ab None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:48.670693 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ed380-c34a-46b5-a4a1-0b382f7df6ab None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:48.671921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ed380-c34a-46b5-a4a1-0b382f7df6ab None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:48.673508 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ed380-c34a-46b5-a4a1-0b382f7df6ab None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:48.675220 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 47/89] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:57:48 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:48.678660 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43820cc8-901a-4199-ab58-d93ff800ab39 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:48.680136 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ed380-c34a-46b5-a4a1-0b382f7df6ab None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:48.726219 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4aaebf-b1fe-46ca-8d1c-f28fa781e11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:48.727115 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4aaebf-b1fe-46ca-8d1c-f28fa781e11d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:48.727428 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4aaebf-b1fe-46ca-8d1c-f28fa781e11d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:48.727706 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4aaebf-b1fe-46ca-8d1c-f28fa781e11d None admin] PATH_INFO: `/v3/users/30e9db5e0da449078023b57bb514a0b6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:48.728908 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4aaebf-b1fe-46ca-8d1c-f28fa781e11d None admin] RBAC: Authorizing `identity:get_user(user_id=30e9db5e0da449078023b57bb514a0b6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:48.730419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4aaebf-b1fe-46ca-8d1c-f28fa781e11d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:48.732309 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 43/90] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:48 2022] GET /identity/v3/users/30e9db5e0da449078023b57bb514a0b6 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:48.733005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4aaebf-b1fe-46ca-8d1c-f28fa781e11d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:48.787837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:48.791948 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:48.817655 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ed380-c34a-46b5-a4a1-0b382f7df6ab None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:48.845513 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4aaebf-b1fe-46ca-8d1c-f28fa781e11d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:48.862883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15257e-80f7-414c-8dd9-3e72bf9ec3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:48.864449 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15257e-80f7-414c-8dd9-3e72bf9ec3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:48.864884 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15257e-80f7-414c-8dd9-3e72bf9ec3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:48.865308 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc15257e-80f7-414c-8dd9-3e72bf9ec3a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:48.866326 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15257e-80f7-414c-8dd9-3e72bf9ec3a0 None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c, user.id=bd7e825180504b9cb4f914bcf260106f) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:48.866798 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15257e-80f7-414c-8dd9-3e72bf9ec3a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:48.869225 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc15257e-80f7-414c-8dd9-3e72bf9ec3a0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:48.877620 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 48/91] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:57:48 2022] GET /identity/v3/role_assignments?user.id=bd7e825180504b9cb4f914bcf260106f&scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:48.878980 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15257e-80f7-414c-8dd9-3e72bf9ec3a0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:48.882246 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21507df1-09b4-417a-a608-4909048b084d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:48.883286 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21507df1-09b4-417a-a608-4909048b084d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:48.883779 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21507df1-09b4-417a-a608-4909048b084d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:48.884057 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21507df1-09b4-417a-a608-4909048b084d None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:48.885463 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21507df1-09b4-417a-a608-4909048b084d None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:48.887167 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21507df1-09b4-417a-a608-4909048b084d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:48.889339 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 44/92] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:57:48 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:48.889977 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21507df1-09b4-417a-a608-4909048b084d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:49.062698 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc15257e-80f7-414c-8dd9-3e72bf9ec3a0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:49.080707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21507df1-09b4-417a-a608-4909048b084d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:49.115660 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:49.125845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80195b-7be1-44f6-b00f-03a3801411a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:49.126528 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80195b-7be1-44f6-b00f-03a3801411a0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:49.126818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80195b-7be1-44f6-b00f-03a3801411a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:49.127103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f80195b-7be1-44f6-b00f-03a3801411a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:49.127983 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80195b-7be1-44f6-b00f-03a3801411a0 None admin] RBAC: Adding query filter params (role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9, scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c, user.id=30e9db5e0da449078023b57bb514a0b6) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:49.128304 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80195b-7be1-44f6-b00f-03a3801411a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:49.129791 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f80195b-7be1-44f6-b00f-03a3801411a0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:49.133634 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeefc74-d7ee-41a9-8c7e-efc473c53d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:49.134357 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeefc74-d7ee-41a9-8c7e-efc473c53d46 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:49.134588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeefc74-d7ee-41a9-8c7e-efc473c53d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:49.134867 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeefc74-d7ee-41a9-8c7e-efc473c53d46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:49.141872 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 49/93] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:57:48 2022] GET /identity/v3/role_assignments?user.id=30e9db5e0da449078023b57bb514a0b6&scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c&role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:49.147286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80195b-7be1-44f6-b00f-03a3801411a0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:49.172812 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:49.271517 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeefc74-d7ee-41a9-8c7e-efc473c53d46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:49.273057 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeefc74-d7ee-41a9-8c7e-efc473c53d46 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:49.373063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f80195b-7be1-44f6-b00f-03a3801411a0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:49.443849 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34828aef-3f02-4589-87fe-040472beaa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:49.444541 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34828aef-3f02-4589-87fe-040472beaa15 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:49.444831 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34828aef-3f02-4589-87fe-040472beaa15 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:49.445116 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34828aef-3f02-4589-87fe-040472beaa15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:49.446343 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34828aef-3f02-4589-87fe-040472beaa15 None admin] RBAC: Adding query filter params (role.id=e7e71ae9fccc4607808005a2e261bab1, scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c, user.id=30e9db5e0da449078023b57bb514a0b6) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:49.446662 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34828aef-3f02-4589-87fe-040472beaa15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:49.448192 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34828aef-3f02-4589-87fe-040472beaa15 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:49.458760 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 50/94] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:57:49 2022] GET /identity/v3/role_assignments?user.id=30e9db5e0da449078023b57bb514a0b6&scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c&role.id=e7e71ae9fccc4607808005a2e261bab1 => generated 259 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:49.490394 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 45/95] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:57:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:57:49.496481 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34828aef-3f02-4589-87fe-040472beaa15 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:49.617297 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:49.654340 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34828aef-3f02-4589-87fe-040472beaa15 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:49.699480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908e625d-f45d-4beb-961f-dca344a35655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:49.700351 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e625d-f45d-4beb-961f-dca344a35655 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:49.700641 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e625d-f45d-4beb-961f-dca344a35655 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:49.700916 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908e625d-f45d-4beb-961f-dca344a35655 None admin] PATH_INFO: `/v3/projects/e612c90e96d445198b08701f2af561b0` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:49.705531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e625d-f45d-4beb-961f-dca344a35655 None admin] RBAC: Authorizing `identity:get_project(project_id=e612c90e96d445198b08701f2af561b0)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:49.707055 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908e625d-f45d-4beb-961f-dca344a35655 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:49.709252 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 51/96] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:57:49 2022] GET /identity/v3/projects/e612c90e96d445198b08701f2af561b0 => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:49.715338 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeefc74-d7ee-41a9-8c7e-efc473c53d46 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:49.758179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:49.864386 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeefc74-d7ee-41a9-8c7e-efc473c53d46 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:49.908920 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9259aa8d-763b-46c9-a7a0-1ad768302200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:49.909600 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259aa8d-763b-46c9-a7a0-1ad768302200 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:49.909891 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259aa8d-763b-46c9-a7a0-1ad768302200 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:49.910167 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9259aa8d-763b-46c9-a7a0-1ad768302200 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:49.911067 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259aa8d-763b-46c9-a7a0-1ad768302200 None admin] RBAC: Adding query filter params (role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9, scope.project.id=e612c90e96d445198b08701f2af561b0, user.id=30e9db5e0da449078023b57bb514a0b6) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:49.911457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259aa8d-763b-46c9-a7a0-1ad768302200 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:49.912980 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9259aa8d-763b-46c9-a7a0-1ad768302200 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:49.919700 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 46/97] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:57:49 2022] GET /identity/v3/role_assignments?user.id=30e9db5e0da449078023b57bb514a0b6&scope.project.id=e612c90e96d445198b08701f2af561b0&role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:50.615179 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30735fce-557a-438b-bff9-993b560aacc0 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:50.615602 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30735fce-557a-438b-bff9-993b560aacc0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:50.615773 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30735fce-557a-438b-bff9-993b560aacc0 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:50.617393 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 52/98] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:50.622933 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efcbc9-5d81-4c69-8a84-9f95f01950a6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:50.623230 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efcbc9-5d81-4c69-8a84-9f95f01950a6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:50.623541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6efcbc9-5d81-4c69-8a84-9f95f01950a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:50.646029 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c6efcbc9-5d81-4c69-8a84-9f95f01950a6 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:50.647275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c6efcbc9-5d81-4c69-8a84-9f95f01950a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:50.733966 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 47/99] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:50.767707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30735fce-557a-438b-bff9-993b560aacc0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:50.939201 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30735fce-557a-438b-bff9-993b560aacc0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:50.944143 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b8078-8a6c-4838-bfc0-b20433789492 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:50.944698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b8078-8a6c-4838-bfc0-b20433789492 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:50.945170 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b8078-8a6c-4838-bfc0-b20433789492 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:50.947267 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 48/100] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:50.961050 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa83b2-31c0-48e0-9063-4cb5f711146d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:50.961636 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa83b2-31c0-48e0-9063-4cb5f711146d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:50.962012 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa83b2-31c0-48e0-9063-4cb5f711146d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:50.974719 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c54e4b-8056-42af-ad81-fa2a36df1b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:50.975799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c54e4b-8056-42af-ad81-fa2a36df1b17 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:50.976246 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c54e4b-8056-42af-ad81-fa2a36df1b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:50.976669 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c54e4b-8056-42af-ad81-fa2a36df1b17 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:50.987709 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c54e4b-8056-42af-ad81-fa2a36df1b17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-24c54e4b-8056-42af-ad81-fa2a36df1b17 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:50.995937 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:50.997023 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:50.998020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:50.998020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:50.998020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:50.998020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:50.998020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:50.998020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:50.998020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:50.998020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:50.998020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:50.998020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:50.998020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:57:50.998020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:57:51.000223 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 53/101] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:57:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:51.004360 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-59fa83b2-31c0-48e0-9063-4cb5f711146d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:51.005866 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-59fa83b2-31c0-48e0-9063-4cb5f711146d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:51.006853 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c54e4b-8056-42af-ad81-fa2a36df1b17 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:51.012428 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:51.031173 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:51.189363 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 49/102] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:57:51.202937 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c54e4b-8056-42af-ad81-fa2a36df1b17 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:51.224474 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa83b2-31c0-48e0-9063-4cb5f711146d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:51.262668 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861b154-2d96-47f8-b15b-79d6bacec2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:51.263375 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861b154-2d96-47f8-b15b-79d6bacec2a5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:51.263665 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861b154-2d96-47f8-b15b-79d6bacec2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:51.263942 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861b154-2d96-47f8-b15b-79d6bacec2a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:51.264704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861b154-2d96-47f8-b15b-79d6bacec2a5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:51.265013 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861b154-2d96-47f8-b15b-79d6bacec2a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:51.266410 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861b154-2d96-47f8-b15b-79d6bacec2a5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:51.279253 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 54/103] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:57:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:51.284865 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861b154-2d96-47f8-b15b-79d6bacec2a5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:51.391738 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:51.407679 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861b154-2d96-47f8-b15b-79d6bacec2a5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:51.447529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686b60a-944f-4160-95c4-438f4e2f50fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:51.448975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686b60a-944f-4160-95c4-438f4e2f50fc None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:51.449479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686b60a-944f-4160-95c4-438f4e2f50fc None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:51.449951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686b60a-944f-4160-95c4-438f4e2f50fc None admin] PATH_INFO: `/v3/users/236f8b4cfa344ad49dfba0bb362a9992` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:51.466745 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686b60a-944f-4160-95c4-438f4e2f50fc None admin] RBAC: Authorizing `identity:get_user(user_id=236f8b4cfa344ad49dfba0bb362a9992)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:51.468620 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686b60a-944f-4160-95c4-438f4e2f50fc None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:51.470648 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 55/104] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:51 2022] GET /identity/v3/users/236f8b4cfa344ad49dfba0bb362a9992 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:57:51.476108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686b60a-944f-4160-95c4-438f4e2f50fc None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:51.506149 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa83b2-31c0-48e0-9063-4cb5f711146d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:51.575758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7669a-3b83-4ad6-99e2-831958f6b4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:51.576972 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7669a-3b83-4ad6-99e2-831958f6b4f3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:51.577453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7669a-3b83-4ad6-99e2-831958f6b4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:51.578825 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7669a-3b83-4ad6-99e2-831958f6b4f3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:51.580613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7669a-3b83-4ad6-99e2-831958f6b4f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:51.584068 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7669a-3b83-4ad6-99e2-831958f6b4f3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:51.590655 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 50/105] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:57:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:57:51.593237 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7669a-3b83-4ad6-99e2-831958f6b4f3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:51.624791 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:51.698697 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686b60a-944f-4160-95c4-438f4e2f50fc None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:51.727609 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7669a-3b83-4ad6-99e2-831958f6b4f3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:51.748588 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:51.767771 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d304be-dd73-409f-ae60-4a56896236d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:51.769134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d304be-dd73-409f-ae60-4a56896236d9 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:51.769611 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d304be-dd73-409f-ae60-4a56896236d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:51.770120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d304be-dd73-409f-ae60-4a56896236d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:51.771061 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d304be-dd73-409f-ae60-4a56896236d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:51.773285 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d304be-dd73-409f-ae60-4a56896236d9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:51.790067 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdca71-99f6-4048-8226-c6ea332740b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:51.791049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdca71-99f6-4048-8226-c6ea332740b6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:51.791357 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdca71-99f6-4048-8226-c6ea332740b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:51.791635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdca71-99f6-4048-8226-c6ea332740b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:51.808245 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 51/106] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Jul 24 00:57:51 2022] POST /identity/v3/projects => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:57:51.903638 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdca71-99f6-4048-8226-c6ea332740b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:51.905158 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdca71-99f6-4048-8226-c6ea332740b6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:52.036229 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 56/107] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:57:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 560 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:57:52.041702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d304be-dd73-409f-ae60-4a56896236d9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:52.116231 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:52.161581 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d304be-dd73-409f-ae60-4a56896236d9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:52.165263 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a99c95-aac5-49a8-bbeb-807459c24584 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:52.165568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a99c95-aac5-49a8-bbeb-807459c24584 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:52.165848 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a99c95-aac5-49a8-bbeb-807459c24584 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:52.167426 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 57/108] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:52.175497 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b54cfc-fbaa-44ea-98d7-86eb5e2e534d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:52.175790 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b54cfc-fbaa-44ea-98d7-86eb5e2e534d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:52.176075 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b54cfc-fbaa-44ea-98d7-86eb5e2e534d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:52.203940 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-52b54cfc-fbaa-44ea-98d7-86eb5e2e534d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:52.206523 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-52b54cfc-fbaa-44ea-98d7-86eb5e2e534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:52.220490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd047f5-c746-49d7-992e-04d99542c7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:52.221716 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd047f5-c746-49d7-992e-04d99542c7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:52.222189 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd047f5-c746-49d7-992e-04d99542c7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:52.222661 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd047f5-c746-49d7-992e-04d99542c7b9 None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:52.224110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd047f5-c746-49d7-992e-04d99542c7b9 None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:52.225788 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd047f5-c746-49d7-992e-04d99542c7b9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:52.228016 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 52/109] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:57:52 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:52.234461 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd047f5-c746-49d7-992e-04d99542c7b9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:52.244247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:52.334754 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 58/110] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:57:52.363256 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836592f-83f8-490d-8964-a7f2a019e044 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:52.363893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836592f-83f8-490d-8964-a7f2a019e044 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:52.364363 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836592f-83f8-490d-8964-a7f2a019e044 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:52.366168 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 59/111] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:52.376653 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4b584-7270-455c-9386-3a2686702a2d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:52.377232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4b584-7270-455c-9386-3a2686702a2d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:52.377702 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4b584-7270-455c-9386-3a2686702a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:52.393438 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd047f5-c746-49d7-992e-04d99542c7b9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:52.397622 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-68b4b584-7270-455c-9386-3a2686702a2d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:52.400157 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-68b4b584-7270-455c-9386-3a2686702a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:52.450418 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6fe22-ea77-43d0-82ab-62dd680f9d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:52.451513 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6fe22-ea77-43d0-82ab-62dd680f9d4e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:52.453144 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6fe22-ea77-43d0-82ab-62dd680f9d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:52.453625 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6fe22-ea77-43d0-82ab-62dd680f9d4e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:52.455487 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6fe22-ea77-43d0-82ab-62dd680f9d4e None admin] RBAC: Adding query filter params (role.id=ac3cef1fcb1744de989fa7f25e7de7b4, scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c, user.id=236f8b4cfa344ad49dfba0bb362a9992) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:52.456035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6fe22-ea77-43d0-82ab-62dd680f9d4e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:52.458521 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec6fe22-ea77-43d0-82ab-62dd680f9d4e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:52.466124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:52.473466 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 53/112] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:57:52 2022] GET /identity/v3/role_assignments?user.id=236f8b4cfa344ad49dfba0bb362a9992&scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c&role.id=ac3cef1fcb1744de989fa7f25e7de7b4 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:57:52.477087 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6fe22-ea77-43d0-82ab-62dd680f9d4e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:52.572923 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 60/113] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:57:52.624052 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b62d92-cc39-4285-aefc-2086e1667318 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:52.624347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b62d92-cc39-4285-aefc-2086e1667318 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:52.624549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b62d92-cc39-4285-aefc-2086e1667318 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:52.626129 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 61/114] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:57:52.632702 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40f1b1-49c0-4cf2-a1fa-607021195c94 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:52.633001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40f1b1-49c0-4cf2-a1fa-607021195c94 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:52.633288 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40f1b1-49c0-4cf2-a1fa-607021195c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:52.655400 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3e40f1b1-49c0-4cf2-a1fa-607021195c94 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:52.657005 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3e40f1b1-49c0-4cf2-a1fa-607021195c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:52.661426 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec6fe22-ea77-43d0-82ab-62dd680f9d4e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:52.726565 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e12599-65e4-4bfa-9b58-309c11b40ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:52.727418 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e12599-65e4-4bfa-9b58-309c11b40ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:52.727707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e12599-65e4-4bfa-9b58-309c11b40ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:52.727988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e12599-65e4-4bfa-9b58-309c11b40ce0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:52.738593 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 62/115] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:57:52.740140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40f1b1-49c0-4cf2-a1fa-607021195c94 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:52.752346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e12599-65e4-4bfa-9b58-309c11b40ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:52.772543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-12e12599-65e4-4bfa-9b58-309c11b40ce0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:52.772734 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:52.774338 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:52.775101 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:52.775101 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:52.775101 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:52.775101 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:52.775101 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:52.775101 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:52.775101 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:52.775101 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:52.775101 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:52.775101 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:52.775101 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:57:52.775101 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:57:52.775101 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 54/116] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:57:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:52.778702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e12599-65e4-4bfa-9b58-309c11b40ce0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:52.901652 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:52.949565 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40f1b1-49c0-4cf2-a1fa-607021195c94 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:52.972311 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e12599-65e4-4bfa-9b58-309c11b40ce0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:53.018864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f5944-9e39-42e8-9255-a60a8eb6938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:53.019717 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f5944-9e39-42e8-9255-a60a8eb6938b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:53.019994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f5944-9e39-42e8-9255-a60a8eb6938b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:53.020270 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f5944-9e39-42e8-9255-a60a8eb6938b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:53.037942 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d16cdf-8660-4670-8feb-287c9fd4f365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:53.038686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d16cdf-8660-4670-8feb-287c9fd4f365 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:53.038971 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d16cdf-8660-4670-8feb-287c9fd4f365 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:53.039251 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d16cdf-8660-4670-8feb-287c9fd4f365 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:53.040088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d16cdf-8660-4670-8feb-287c9fd4f365 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:53.040404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d16cdf-8660-4670-8feb-287c9fd4f365 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:53.041448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f5944-9e39-42e8-9255-a60a8eb6938b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:53.050230 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d16cdf-8660-4670-8feb-287c9fd4f365 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-a07f5944-9e39-42e8-9255-a60a8eb6938b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:53.055398 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:53.056348 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:53.057112 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:53.057112 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:53.057112 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:53.057112 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:53.057112 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:53.057112 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:53.057112 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:53.057112 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:53.057112 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:53.057112 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:53.057112 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:57:53.057112 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:57:53.059755 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 63/117] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:57:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:53.060068 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 55/118] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:57:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:53.061114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f5944-9e39-42e8-9255-a60a8eb6938b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:53.066025 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d16cdf-8660-4670-8feb-287c9fd4f365 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:53.182140 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d16cdf-8660-4670-8feb-287c9fd4f365 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:53.182975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:53.191985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f5944-9e39-42e8-9255-a60a8eb6938b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:53.202685 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:53.224269 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb053f56-4fdd-4dd5-a23d-2726eef22580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:53.225439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb053f56-4fdd-4dd5-a23d-2726eef22580 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:53.225802 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb053f56-4fdd-4dd5-a23d-2726eef22580 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:53.226348 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb053f56-4fdd-4dd5-a23d-2726eef22580 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:53.227115 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb053f56-4fdd-4dd5-a23d-2726eef22580 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:53.227740 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb053f56-4fdd-4dd5-a23d-2726eef22580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:53.229889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb053f56-4fdd-4dd5-a23d-2726eef22580 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:53.235930 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0b657-b3dd-4a1c-a75b-f1aee8ac19f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:53.236843 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0b657-b3dd-4a1c-a75b-f1aee8ac19f2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:53.237196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0b657-b3dd-4a1c-a75b-f1aee8ac19f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:53.237541 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0b657-b3dd-4a1c-a75b-f1aee8ac19f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:53.243374 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 56/119] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:57:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:53.244437 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb053f56-4fdd-4dd5-a23d-2726eef22580 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:53.252975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0b657-b3dd-4a1c-a75b-f1aee8ac19f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-2fa0b657-b3dd-4a1c-a75b-f1aee8ac19f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:53.260845 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:53.261699 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:53.262661 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:53.262661 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:53.262661 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:53.262661 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:53.262661 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:53.262661 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:53.262661 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:53.262661 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:53.262661 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:53.262661 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:53.262661 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:57:53.262661 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:57:53.262661 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 64/120] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:57:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:53.263330 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4660ce-e7ed-49c4-ba11-3d4be6d13027 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:53.264562 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4660ce-e7ed-49c4-ba11-3d4be6d13027 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:53.264562 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4660ce-e7ed-49c4-ba11-3d4be6d13027 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:53.265475 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 65/121] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:53.266171 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4660ce-e7ed-49c4-ba11-3d4be6d13027 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:53.370026 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb053f56-4fdd-4dd5-a23d-2726eef22580 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:53.391334 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4660ce-e7ed-49c4-ba11-3d4be6d13027 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:53.408826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b03ca2-9e61-4dda-925a-5006b6bbee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:53.409964 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03ca2-9e61-4dda-925a-5006b6bbee68 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:53.410257 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03ca2-9e61-4dda-925a-5006b6bbee68 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:53.410547 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b03ca2-9e61-4dda-925a-5006b6bbee68 None admin] PATH_INFO: `/v3/users/30e9db5e0da449078023b57bb514a0b6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:53.411881 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b03ca2-9e61-4dda-925a-5006b6bbee68 None admin] RBAC: Authorizing `identity:get_user(user_id=30e9db5e0da449078023b57bb514a0b6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:53.413560 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b03ca2-9e61-4dda-925a-5006b6bbee68 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:53.415232 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 57/122] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:53 2022] GET /identity/v3/users/30e9db5e0da449078023b57bb514a0b6 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:53.416196 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b03ca2-9e61-4dda-925a-5006b6bbee68 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:53.433974 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a201578-6232-41ea-8fe1-b0fa0e11cd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:53.435666 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a201578-6232-41ea-8fe1-b0fa0e11cd01 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:53.435961 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a201578-6232-41ea-8fe1-b0fa0e11cd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:53.436241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a201578-6232-41ea-8fe1-b0fa0e11cd01 None admin] PATH_INFO: `/v3/users/bd7e825180504b9cb4f914bcf260106f` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:53.437956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a201578-6232-41ea-8fe1-b0fa0e11cd01 None admin] RBAC: Authorizing `identity:get_user(user_id=bd7e825180504b9cb4f914bcf260106f)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:53.439836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a201578-6232-41ea-8fe1-b0fa0e11cd01 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:53.441701 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 66/123] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:53 2022] GET /identity/v3/users/bd7e825180504b9cb4f914bcf260106f => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:53.444601 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfad6b2-d8c3-48a4-8213-759c9c86ce35 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:53.444893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfad6b2-d8c3-48a4-8213-759c9c86ce35 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:53.445227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfad6b2-d8c3-48a4-8213-759c9c86ce35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:53.452585 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:53.469159 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4cfad6b2-d8c3-48a4-8213-759c9c86ce35 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:53.470369 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4cfad6b2-d8c3-48a4-8213-759c9c86ce35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:53.479798 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:53.549904 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b03ca2-9e61-4dda-925a-5006b6bbee68 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:53.550370 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 67/124] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:53.551413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfad6b2-d8c3-48a4-8213-759c9c86ce35 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:53.592279 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66ab47-5308-4596-bb0e-70b2bfbf8e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:53.593023 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66ab47-5308-4596-bb0e-70b2bfbf8e7c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:53.593313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66ab47-5308-4596-bb0e-70b2bfbf8e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:53.593593 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66ab47-5308-4596-bb0e-70b2bfbf8e7c None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:53.594348 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66ab47-5308-4596-bb0e-70b2bfbf8e7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:53.594663 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66ab47-5308-4596-bb0e-70b2bfbf8e7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:53.596767 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66ab47-5308-4596-bb0e-70b2bfbf8e7c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:53.606618 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 58/125] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:57:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:53.607636 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66ab47-5308-4596-bb0e-70b2bfbf8e7c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:53.657306 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfad6b2-d8c3-48a4-8213-759c9c86ce35 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:53.687499 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:53.695110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dec6c5-3d62-4a9f-b8fc-3718c8bc77ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:53.696579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dec6c5-3d62-4a9f-b8fc-3718c8bc77ac None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:53.697038 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dec6c5-3d62-4a9f-b8fc-3718c8bc77ac None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:53.697510 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dec6c5-3d62-4a9f-b8fc-3718c8bc77ac None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:53.698930 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dec6c5-3d62-4a9f-b8fc-3718c8bc77ac None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:53.700770 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dec6c5-3d62-4a9f-b8fc-3718c8bc77ac None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:53.702975 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 68/126] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:57:53 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:53.703972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dec6c5-3d62-4a9f-b8fc-3718c8bc77ac None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:53.728427 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66ab47-5308-4596-bb0e-70b2bfbf8e7c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:53.744510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:53.772411 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023df58-11b0-4988-bf07-058046c9f633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:53.773303 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023df58-11b0-4988-bf07-058046c9f633 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:53.773827 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023df58-11b0-4988-bf07-058046c9f633 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:53.773827 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8023df58-11b0-4988-bf07-058046c9f633 None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:53.775191 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023df58-11b0-4988-bf07-058046c9f633 None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:53.777249 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8023df58-11b0-4988-bf07-058046c9f633 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:53.783402 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 59/127] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:57:53 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:53.784614 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023df58-11b0-4988-bf07-058046c9f633 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:53.818434 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dec6c5-3d62-4a9f-b8fc-3718c8bc77ac None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:53.857402 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672286a9-18bb-4205-bc36-469eaf6912e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:53.858685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672286a9-18bb-4205-bc36-469eaf6912e1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:53.859264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672286a9-18bb-4205-bc36-469eaf6912e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:53.859766 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672286a9-18bb-4205-bc36-469eaf6912e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:53.871638 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672286a9-18bb-4205-bc36-469eaf6912e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-672286a9-18bb-4205-bc36-469eaf6912e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:53.880556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:53.881426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:53.882240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:53.882240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:53.882240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:53.882240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:53.882240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:53.882240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:53.882240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:53.882240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:53.882240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:53.882240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:53.882240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:57:53.882240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:57:53.885326 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 69/128] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:57:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:53.886388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672286a9-18bb-4205-bc36-469eaf6912e1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:53.900933 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8023df58-11b0-4988-bf07-058046c9f633 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:53.934612 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9eee5-6e12-4d9e-b052-f72e60c269cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:53.935541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9eee5-6e12-4d9e-b052-f72e60c269cd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:53.935819 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9eee5-6e12-4d9e-b052-f72e60c269cd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:53.936099 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d9eee5-6e12-4d9e-b052-f72e60c269cd None admin] PATH_INFO: `/v3/users/30e9db5e0da449078023b57bb514a0b6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:53.937313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9eee5-6e12-4d9e-b052-f72e60c269cd None admin] RBAC: Authorizing `identity:get_user(user_id=30e9db5e0da449078023b57bb514a0b6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:53.938846 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d9eee5-6e12-4d9e-b052-f72e60c269cd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:53.940486 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 60/129] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:53 2022] GET /identity/v3/users/30e9db5e0da449078023b57bb514a0b6 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:53.941205 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9eee5-6e12-4d9e-b052-f72e60c269cd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:53.955695 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:53.991175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:53.999760 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672286a9-18bb-4205-bc36-469eaf6912e1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:54.037285 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36774cdb-41d8-4016-9bb0-d8927f048ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:54.038672 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36774cdb-41d8-4016-9bb0-d8927f048ea4 None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:54.039271 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36774cdb-41d8-4016-9bb0-d8927f048ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:54.039771 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36774cdb-41d8-4016-9bb0-d8927f048ea4 None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c/users/30e9db5e0da449078023b57bb514a0b6/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:54.042135 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36774cdb-41d8-4016-9bb0-d8927f048ea4 None admin] RBAC: Authorizing `identity:create_grant(project_id=89fd50ea31554d3f9c9a1d40a0fe059c, user_id=30e9db5e0da449078023b57bb514a0b6, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:54.042342 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d9eee5-6e12-4d9e-b052-f72e60c269cd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:54.044175 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36774cdb-41d8-4016-9bb0-d8927f048ea4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:54.060378 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 70/130] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:57:53 2022] PUT /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c/users/30e9db5e0da449078023b57bb514a0b6/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:57:54.061789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36774cdb-41d8-4016-9bb0-d8927f048ea4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:54.078482 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eeea19-7ba5-4ead-b7d7-667c3981874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:54.079443 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eeea19-7ba5-4ead-b7d7-667c3981874f None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:54.079730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eeea19-7ba5-4ead-b7d7-667c3981874f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:54.080009 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eeea19-7ba5-4ead-b7d7-667c3981874f None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c/users/bd7e825180504b9cb4f914bcf260106f/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:54.082144 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eeea19-7ba5-4ead-b7d7-667c3981874f None admin] RBAC: Authorizing `identity:create_grant(project_id=89fd50ea31554d3f9c9a1d40a0fe059c, user_id=bd7e825180504b9cb4f914bcf260106f, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:54.083621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eeea19-7ba5-4ead-b7d7-667c3981874f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:54.101432 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 61/131] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:57:53 2022] PUT /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c/users/bd7e825180504b9cb4f914bcf260106f/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:57:54.108027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eeea19-7ba5-4ead-b7d7-667c3981874f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:54.184795 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36774cdb-41d8-4016-9bb0-d8927f048ea4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:54.208591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:54.226694 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046a63-8165-4afa-aeed-ff64606b5051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:54.227896 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046a63-8165-4afa-aeed-ff64606b5051 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:54.228467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046a63-8165-4afa-aeed-ff64606b5051 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:54.228968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c046a63-8165-4afa-aeed-ff64606b5051 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:54.230102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c046a63-8165-4afa-aeed-ff64606b5051 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:54.230762 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c046a63-8165-4afa-aeed-ff64606b5051 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:54.232706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c046a63-8165-4afa-aeed-ff64606b5051 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:54.242891 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 71/132] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:57:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:54.248675 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046a63-8165-4afa-aeed-ff64606b5051 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:54.291357 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eeea19-7ba5-4ead-b7d7-667c3981874f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:54.295427 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:54.324965 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced5c85b-0d1b-4c4b-9298-63e5f25e1476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:54.325879 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5c85b-0d1b-4c4b-9298-63e5f25e1476 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:54.326524 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5c85b-0d1b-4c4b-9298-63e5f25e1476 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:54.326790 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced5c85b-0d1b-4c4b-9298-63e5f25e1476 None admin] PATH_INFO: `/v3/projects/e612c90e96d445198b08701f2af561b0` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:54.328242 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5c85b-0d1b-4c4b-9298-63e5f25e1476 None admin] RBAC: Authorizing `identity:get_project(project_id=e612c90e96d445198b08701f2af561b0)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:54.330231 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced5c85b-0d1b-4c4b-9298-63e5f25e1476 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:54.332121 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 62/133] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:57:54 2022] GET /identity/v3/projects/e612c90e96d445198b08701f2af561b0 => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:54.333563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579a009-6fe3-4b64-a2d2-dcd9ae7b0597 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:54.333850 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579a009-6fe3-4b64-a2d2-dcd9ae7b0597 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:54.334130 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3579a009-6fe3-4b64-a2d2-dcd9ae7b0597 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:54.335812 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 63/134] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:54.338354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579a009-6fe3-4b64-a2d2-dcd9ae7b0597 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:54.432612 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c046a63-8165-4afa-aeed-ff64606b5051 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:54.486165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed385c9d-01a1-4ff4-8012-77b8b044edd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:54.486993 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed385c9d-01a1-4ff4-8012-77b8b044edd6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:54.487282 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed385c9d-01a1-4ff4-8012-77b8b044edd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:54.487585 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed385c9d-01a1-4ff4-8012-77b8b044edd6 None admin] PATH_INFO: `/v3/users/30e9db5e0da449078023b57bb514a0b6` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:54.488921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed385c9d-01a1-4ff4-8012-77b8b044edd6 None admin] RBAC: Authorizing `identity:get_user(user_id=30e9db5e0da449078023b57bb514a0b6)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:54.490405 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed385c9d-01a1-4ff4-8012-77b8b044edd6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:54.492457 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 72/135] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:54 2022] GET /identity/v3/users/30e9db5e0da449078023b57bb514a0b6 => generated 275 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:54.493732 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd5131-ea0f-4fc8-ad8d-9476aad601f7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:54.494014 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd5131-ea0f-4fc8-ad8d-9476aad601f7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:54.494300 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fd5131-ea0f-4fc8-ad8d-9476aad601f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:54.495097 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3579a009-6fe3-4b64-a2d2-dcd9ae7b0597 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:54.516631 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-84fd5131-ea0f-4fc8-ad8d-9476aad601f7 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:54.518324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-84fd5131-ea0f-4fc8-ad8d-9476aad601f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:54.572110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:54.587573 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af120c9-2c9b-4eb3-8f83-79dc1ecbb659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:54.588903 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af120c9-2c9b-4eb3-8f83-79dc1ecbb659 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:54.591957 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af120c9-2c9b-4eb3-8f83-79dc1ecbb659 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:54.592404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af120c9-2c9b-4eb3-8f83-79dc1ecbb659 None admin] PATH_INFO: `/v3/projects/e612c90e96d445198b08701f2af561b0/users/30e9db5e0da449078023b57bb514a0b6/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:54.595760 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af120c9-2c9b-4eb3-8f83-79dc1ecbb659 None admin] RBAC: Authorizing `identity:create_grant(project_id=e612c90e96d445198b08701f2af561b0, user_id=30e9db5e0da449078023b57bb514a0b6, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:54.597584 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af120c9-2c9b-4eb3-8f83-79dc1ecbb659 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:54.621834 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 73/136] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:54.622558 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 64/137] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:57:54 2022] PUT /identity/v3/projects/e612c90e96d445198b08701f2af561b0/users/30e9db5e0da449078023b57bb514a0b6/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:57:54.623584 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af120c9-2c9b-4eb3-8f83-79dc1ecbb659 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:54.654104 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd5131-ea0f-4fc8-ad8d-9476aad601f7 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:54.712873 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:54.832444 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af120c9-2c9b-4eb3-8f83-79dc1ecbb659 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:54.844702 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fd5131-ea0f-4fc8-ad8d-9476aad601f7 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:54.867476 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1918c34-4427-48a8-94ac-4bc5eab689ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:54.868131 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1918c34-4427-48a8-94ac-4bc5eab689ca None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:54.868419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1918c34-4427-48a8-94ac-4bc5eab689ca None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:54.868698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1918c34-4427-48a8-94ac-4bc5eab689ca None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:54.869913 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1918c34-4427-48a8-94ac-4bc5eab689ca None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:54.871509 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1918c34-4427-48a8-94ac-4bc5eab689ca None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:54.873405 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 65/138] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:57:54 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:54.879048 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1918c34-4427-48a8-94ac-4bc5eab689ca None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:54.883549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c771cf4-2888-4c20-b7ac-0990526ed7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:54.884544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c771cf4-2888-4c20-b7ac-0990526ed7bd None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:54.884983 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c771cf4-2888-4c20-b7ac-0990526ed7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:54.885412 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c771cf4-2888-4c20-b7ac-0990526ed7bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:54.886773 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c771cf4-2888-4c20-b7ac-0990526ed7bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:54.888536 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c771cf4-2888-4c20-b7ac-0990526ed7bd None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:54.890419 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 74/139] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:57:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:54.896326 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c771cf4-2888-4c20-b7ac-0990526ed7bd None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:54.961588 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:54.982813 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1918c34-4427-48a8-94ac-4bc5eab689ca None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:54.985296 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:55.019529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb7ea83-7a86-4041-8cc5-d5570e601a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:55.020555 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7ea83-7a86-4041-8cc5-d5570e601a6f None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:55.021034 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7ea83-7a86-4041-8cc5-d5570e601a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:55.021233 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb7ea83-7a86-4041-8cc5-d5570e601a6f None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c/users/30e9db5e0da449078023b57bb514a0b6/roles/e7e71ae9fccc4607808005a2e261bab1` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:55.023547 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7ea83-7a86-4041-8cc5-d5570e601a6f None admin] RBAC: Authorizing `identity:create_grant(project_id=89fd50ea31554d3f9c9a1d40a0fe059c, user_id=30e9db5e0da449078023b57bb514a0b6, role_id=e7e71ae9fccc4607808005a2e261bab1)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:55.025166 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb7ea83-7a86-4041-8cc5-d5570e601a6f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:55.027983 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c771cf4-2888-4c20-b7ac-0990526ed7bd None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:55.047493 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 66/140] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:57:54 2022] PUT /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c/users/30e9db5e0da449078023b57bb514a0b6/roles/e7e71ae9fccc4607808005a2e261bab1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:57:55.068811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050ea877-26fb-43ae-bf96-1f33d6276fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:55.069788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ea877-26fb-43ae-bf96-1f33d6276fc8 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:55.070627 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ea877-26fb-43ae-bf96-1f33d6276fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:55.071061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050ea877-26fb-43ae-bf96-1f33d6276fc8 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:55.071992 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ea877-26fb-43ae-bf96-1f33d6276fc8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:55.073815 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050ea877-26fb-43ae-bf96-1f33d6276fc8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:55.114201 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 75/141] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 00:57:54 2022] POST /identity/v3/users => generated 283 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:57:55.176787 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa101d2-8f44-4281-a4d3-36e42f84386f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:55.177079 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa101d2-8f44-4281-a4d3-36e42f84386f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:55.177367 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa101d2-8f44-4281-a4d3-36e42f84386f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:55.178985 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 67/142] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:57:55.185474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce90673-82ec-4b08-8349-192a3b188479 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:55.186015 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce90673-82ec-4b08-8349-192a3b188479 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:55.186437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce90673-82ec-4b08-8349-192a3b188479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:55.213172 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-bce90673-82ec-4b08-8349-192a3b188479 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:55.214713 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bce90673-82ec-4b08-8349-192a3b188479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:55.293180 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 76/143] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:55.317134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa101d2-8f44-4281-a4d3-36e42f84386f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:55.430984 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa101d2-8f44-4281-a4d3-36e42f84386f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:55.474669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc1816-39b8-456a-9fb2-cc1f27a0db8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:55.475664 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc1816-39b8-456a-9fb2-cc1f27a0db8e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:55.476052 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc1816-39b8-456a-9fb2-cc1f27a0db8e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:55.476431 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc1816-39b8-456a-9fb2-cc1f27a0db8e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:55.492705 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc1816-39b8-456a-9fb2-cc1f27a0db8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-82fc1816-39b8-456a-9fb2-cc1f27a0db8e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:55.500933 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:55.502043 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:55.503035 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:55.503035 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:55.503035 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:55.503035 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:55.503035 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:55.503035 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:55.503035 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:55.503035 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:55.503035 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:55.503035 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:55.503035 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:57:55.503035 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:57:55.505123 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 68/144] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:57:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:55.511685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce90673-82ec-4b08-8349-192a3b188479 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:55.558868 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:55.633483 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce90673-82ec-4b08-8349-192a3b188479 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:55.669090 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e95fda-04e2-4ada-89a8-31c3246d5a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:55.670065 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e95fda-04e2-4ada-89a8-31c3246d5a49 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:55.670486 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e95fda-04e2-4ada-89a8-31c3246d5a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:55.670906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e95fda-04e2-4ada-89a8-31c3246d5a49 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:55.671871 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e95fda-04e2-4ada-89a8-31c3246d5a49 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:55.672428 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e95fda-04e2-4ada-89a8-31c3246d5a49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:55.674034 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e95fda-04e2-4ada-89a8-31c3246d5a49 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:55.685291 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 77/145] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:57:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:55.690620 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc1816-39b8-456a-9fb2-cc1f27a0db8e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:55.726874 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:55.826536 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc1816-39b8-456a-9fb2-cc1f27a0db8e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:55.871175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d267cb-f7e6-45bc-bc0a-877a20c4e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:55.872108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d267cb-f7e6-45bc-bc0a-877a20c4e052 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:55.872392 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d267cb-f7e6-45bc-bc0a-877a20c4e052 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:55.872669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d267cb-f7e6-45bc-bc0a-877a20c4e052 None admin] PATH_INFO: `/v3/users/236f8b4cfa344ad49dfba0bb362a9992` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:55.876116 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d267cb-f7e6-45bc-bc0a-877a20c4e052 None admin] RBAC: Authorizing `identity:get_user(user_id=236f8b4cfa344ad49dfba0bb362a9992)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:55.877615 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d267cb-f7e6-45bc-bc0a-877a20c4e052 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:55.879323 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 69/146] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:55 2022] GET /identity/v3/users/236f8b4cfa344ad49dfba0bb362a9992 => generated 289 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:55.885045 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e95fda-04e2-4ada-89a8-31c3246d5a49 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:56.009404 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:56.021878 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e95fda-04e2-4ada-89a8-31c3246d5a49 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:56.063059 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b68694d-ec6b-44e6-8d7a-87f944b65746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:56.064453 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68694d-ec6b-44e6-8d7a-87f944b65746 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:56.064927 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68694d-ec6b-44e6-8d7a-87f944b65746 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:56.065410 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b68694d-ec6b-44e6-8d7a-87f944b65746 None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:56.072022 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68694d-ec6b-44e6-8d7a-87f944b65746 None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:56.073785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b68694d-ec6b-44e6-8d7a-87f944b65746 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:56.075783 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 78/147] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:57:55 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:56.084434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d267cb-f7e6-45bc-bc0a-877a20c4e052 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:56.187049 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:56.196472 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d267cb-f7e6-45bc-bc0a-877a20c4e052 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:56.233044 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d951e47-6dda-4a42-8ebf-daee929ef73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:56.233961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d951e47-6dda-4a42-8ebf-daee929ef73d None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:56.234244 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d951e47-6dda-4a42-8ebf-daee929ef73d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:56.234520 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d951e47-6dda-4a42-8ebf-daee929ef73d None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c/users/236f8b4cfa344ad49dfba0bb362a9992/roles/ac3cef1fcb1744de989fa7f25e7de7b4` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:56.240063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d951e47-6dda-4a42-8ebf-daee929ef73d None admin] RBAC: Authorizing `identity:create_grant(project_id=89fd50ea31554d3f9c9a1d40a0fe059c, user_id=236f8b4cfa344ad49dfba0bb362a9992, role_id=ac3cef1fcb1744de989fa7f25e7de7b4)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:56.241573 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d951e47-6dda-4a42-8ebf-daee929ef73d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:56.269086 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 70/148] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:57:56 2022] PUT /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c/users/236f8b4cfa344ad49dfba0bb362a9992/roles/ac3cef1fcb1744de989fa7f25e7de7b4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:57:56.900247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e960b-0ccc-40f7-bc98-2abb36ca9dcc None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:56.900757 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e960b-0ccc-40f7-bc98-2abb36ca9dcc None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:56.900865 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e960b-0ccc-40f7-bc98-2abb36ca9dcc None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:56.902296 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 79/149] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:56.909084 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f809ac-70fc-4d7a-bfa7-e9fec0edcffc None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:56.909084 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f809ac-70fc-4d7a-bfa7-e9fec0edcffc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:56.909600 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f809ac-70fc-4d7a-bfa7-e9fec0edcffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:56.927700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-17f809ac-70fc-4d7a-bfa7-e9fec0edcffc None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:56.928893 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-17f809ac-70fc-4d7a-bfa7-e9fec0edcffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:57.004132 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 71/150] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:57:57.046543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e960b-0ccc-40f7-bc98-2abb36ca9dcc None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:57.177007 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e960b-0ccc-40f7-bc98-2abb36ca9dcc None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:57.234985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69131ff-9769-477d-adf4-2b92f5de5a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:57.236305 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69131ff-9769-477d-adf4-2b92f5de5a0c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:57.236842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69131ff-9769-477d-adf4-2b92f5de5a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:57.237946 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69131ff-9769-477d-adf4-2b92f5de5a0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:57.257024 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69131ff-9769-477d-adf4-2b92f5de5a0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-e69131ff-9769-477d-adf4-2b92f5de5a0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:57.265465 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:57.266333 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:57.267127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:57.267127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:57.267127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:57.267127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:57.267127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:57.267127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:57.267127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:57.267127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:57.267127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:57.267127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:57.267127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:57:57.267127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:57:57.269557 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 80/151] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:57:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:57.275695 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f809ac-70fc-4d7a-bfa7-e9fec0edcffc None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:57.382206 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:57.403354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f809ac-70fc-4d7a-bfa7-e9fec0edcffc None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:57.447194 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbba61-0b10-4b7b-9e43-41e7d1c2560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:57.447965 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbba61-0b10-4b7b-9e43-41e7d1c2560e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:57.448407 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbba61-0b10-4b7b-9e43-41e7d1c2560e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:57.448683 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbba61-0b10-4b7b-9e43-41e7d1c2560e None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:57.449449 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbba61-0b10-4b7b-9e43-41e7d1c2560e None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:57.449756 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbba61-0b10-4b7b-9e43-41e7d1c2560e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:57.451176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdbba61-0b10-4b7b-9e43-41e7d1c2560e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:57.460582 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 72/152] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:57:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:57.466241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69131ff-9769-477d-adf4-2b92f5de5a0c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:57.514579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:57.599750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69131ff-9769-477d-adf4-2b92f5de5a0c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:57.638883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3dac1-6ec0-40db-9a2d-6291cec1d096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:57.640213 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3dac1-6ec0-40db-9a2d-6291cec1d096 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:57.640765 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3dac1-6ec0-40db-9a2d-6291cec1d096 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:57.641247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3dac1-6ec0-40db-9a2d-6291cec1d096 None admin] PATH_INFO: `/v3/users/30e9db5e0da449078023b57bb514a0b6` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:57.642685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3dac1-6ec0-40db-9a2d-6291cec1d096 None admin] RBAC: Authorizing `identity:get_user(user_id=30e9db5e0da449078023b57bb514a0b6)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:57.644418 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3dac1-6ec0-40db-9a2d-6291cec1d096 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:57.646291 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 81/153] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:57 2022] GET /identity/v3/users/30e9db5e0da449078023b57bb514a0b6 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:57.652349 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbba61-0b10-4b7b-9e43-41e7d1c2560e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:57.776996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbba61-0b10-4b7b-9e43-41e7d1c2560e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:57.821319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525688ef-16cc-4241-a1d0-759251c46899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:57.821988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525688ef-16cc-4241-a1d0-759251c46899 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:57.822271 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525688ef-16cc-4241-a1d0-759251c46899 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:57.822544 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525688ef-16cc-4241-a1d0-759251c46899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:57.849545 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:57.915404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525688ef-16cc-4241-a1d0-759251c46899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:57.916985 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525688ef-16cc-4241-a1d0-759251c46899 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:57.933228 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379de24-aab9-4fce-a58a-05b2383967ba None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:57.934138 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379de24-aab9-4fce-a58a-05b2383967ba None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:57.934625 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9379de24-aab9-4fce-a58a-05b2383967ba None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:57.936904 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 82/154] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:57.949136 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cbdbd-75d4-47c1-a080-6536646407a7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:57.949427 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cbdbd-75d4-47c1-a080-6536646407a7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:57.949708 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0cbdbd-75d4-47c1-a080-6536646407a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:57.981880 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7b0cbdbd-75d4-47c1-a080-6536646407a7 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:57.983110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7b0cbdbd-75d4-47c1-a080-6536646407a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:58.089825 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 83/155] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:57:58.110347 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 73/156] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:57:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:57:58.116295 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cbdbd-75d4-47c1-a080-6536646407a7 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:58.129731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525688ef-16cc-4241-a1d0-759251c46899 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:58.161357 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:58.246008 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:58.276520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0cbdbd-75d4-47c1-a080-6536646407a7 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:58.319842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff9e5ac-9389-47ea-af94-3106d8104344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:58.321903 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9e5ac-9389-47ea-af94-3106d8104344 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:58.322194 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9e5ac-9389-47ea-af94-3106d8104344 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:58.322473 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff9e5ac-9389-47ea-af94-3106d8104344 None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:58.327812 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9e5ac-9389-47ea-af94-3106d8104344 None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:58.329678 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff9e5ac-9389-47ea-af94-3106d8104344 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:58.332069 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 84/157] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:57:58 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:58.338386 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cbaa2-6487-4ba2-9541-e8584f919cde None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:58.338386 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cbaa2-6487-4ba2-9541-e8584f919cde None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:58.338386 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cbaa2-6487-4ba2-9541-e8584f919cde None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:58.338386 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 85/158] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:57:58.339461 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cbaa2-6487-4ba2-9541-e8584f919cde None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:58.373978 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525688ef-16cc-4241-a1d0-759251c46899 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:58.447390 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241c6b8e-e4c4-44bd-8af4-b6f6a29f8841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:58.448667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c6b8e-e4c4-44bd-8af4-b6f6a29f8841 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:58.449149 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c6b8e-e4c4-44bd-8af4-b6f6a29f8841 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:58.449610 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241c6b8e-e4c4-44bd-8af4-b6f6a29f8841 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:58.476208 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241c6b8e-e4c4-44bd-8af4-b6f6a29f8841 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-241c6b8e-e4c4-44bd-8af4-b6f6a29f8841 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:58.484533 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:58.485510 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:58.486306 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:58.486306 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:58.486306 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:58.486306 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:58.486306 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:58.486306 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:58.486306 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:58.486306 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:58.486306 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:58.486306 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:58.486306 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:57:58.486306 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:57:58.493026 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 74/159] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:57:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:58.494563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b144-febb-43f1-876c-13ce66a9e302 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:58.495164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b144-febb-43f1-876c-13ce66a9e302 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:58.495657 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215b144-febb-43f1-876c-13ce66a9e302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:58.520223 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a215b144-febb-43f1-876c-13ce66a9e302 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:58.521764 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a215b144-febb-43f1-876c-13ce66a9e302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:58.549349 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:58.580914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cbaa2-6487-4ba2-9541-e8584f919cde None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:58.632114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5354b6d-0dcd-4b50-97af-c0e60b7f34a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:58.633354 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5354b6d-0dcd-4b50-97af-c0e60b7f34a7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:58.633849 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5354b6d-0dcd-4b50-97af-c0e60b7f34a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:58.634329 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5354b6d-0dcd-4b50-97af-c0e60b7f34a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:58.635416 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5354b6d-0dcd-4b50-97af-c0e60b7f34a7 None admin] RBAC: Adding query filter params (role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9, scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c, user.id=30e9db5e0da449078023b57bb514a0b6) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:58.636004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5354b6d-0dcd-4b50-97af-c0e60b7f34a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:58.637818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5354b6d-0dcd-4b50-97af-c0e60b7f34a7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:58.645139 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 86/160] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:57:58 2022] GET /identity/v3/role_assignments?user.id=30e9db5e0da449078023b57bb514a0b6&scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c&role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 608 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:58.652359 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5354b6d-0dcd-4b50-97af-c0e60b7f34a7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:58.658717 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 75/161] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:57:58.710039 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215b144-febb-43f1-876c-13ce66a9e302 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:58.774012 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:58.796667 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5354b6d-0dcd-4b50-97af-c0e60b7f34a7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:58.846306 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7839e-4565-48de-96d4-1c4bac34a34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:58.847564 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7839e-4565-48de-96d4-1c4bac34a34f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:58.848063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7839e-4565-48de-96d4-1c4bac34a34f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:58.848543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc7839e-4565-48de-96d4-1c4bac34a34f None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:58.849506 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7839e-4565-48de-96d4-1c4bac34a34f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:58.850057 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7839e-4565-48de-96d4-1c4bac34a34f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:58.851837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc7839e-4565-48de-96d4-1c4bac34a34f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:58.867911 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 87/162] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:57:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:58.876468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7839e-4565-48de-96d4-1c4bac34a34f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:58.878738 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215b144-febb-43f1-876c-13ce66a9e302 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:58.902122 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:58.930120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944f291-7f0e-403c-b9b9-7abd94eb518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:58.930959 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944f291-7f0e-403c-b9b9-7abd94eb518b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:58.931221 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944f291-7f0e-403c-b9b9-7abd94eb518b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:58.931526 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7944f291-7f0e-403c-b9b9-7abd94eb518b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:58.942911 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7944f291-7f0e-403c-b9b9-7abd94eb518b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-7944f291-7f0e-403c-b9b9-7abd94eb518b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:57:58.967342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:57:58.968302 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:57:58.969109 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:57:58.969109 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:57:58.969109 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:57:58.969109 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:57:58.969109 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:57:58.969109 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:57:58.969109 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:57:58.969109 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:57:58.969109 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:57:58.969109 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:57:58.969109 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:57:58.969109 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:57:58.969109 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 76/163] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:57:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:57:58.972313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944f291-7f0e-403c-b9b9-7abd94eb518b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:59.034367 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc7839e-4565-48de-96d4-1c4bac34a34f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:59.088200 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298de02-9a90-4f7b-aac7-1d765fd920a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:59.089669 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298de02-9a90-4f7b-aac7-1d765fd920a7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:59.090162 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298de02-9a90-4f7b-aac7-1d765fd920a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:59.090629 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298de02-9a90-4f7b-aac7-1d765fd920a7 None admin] PATH_INFO: `/v3/users/bd7e825180504b9cb4f914bcf260106f` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:59.092229 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298de02-9a90-4f7b-aac7-1d765fd920a7 None admin] RBAC: Authorizing `identity:get_user(user_id=bd7e825180504b9cb4f914bcf260106f)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:59.093970 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298de02-9a90-4f7b-aac7-1d765fd920a7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:59.096193 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 88/164] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:58 2022] GET /identity/v3/users/bd7e825180504b9cb4f914bcf260106f => generated 247 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:59.101521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298de02-9a90-4f7b-aac7-1d765fd920a7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:59.139217 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7944f291-7f0e-403c-b9b9-7abd94eb518b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:59.142165 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:59.205374 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab122f-20e6-4f33-b186-aa4f29020917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:59.206069 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab122f-20e6-4f33-b186-aa4f29020917 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:59.206349 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab122f-20e6-4f33-b186-aa4f29020917 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:59.206620 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab122f-20e6-4f33-b186-aa4f29020917 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:59.207409 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab122f-20e6-4f33-b186-aa4f29020917 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:57:59.207720 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab122f-20e6-4f33-b186-aa4f29020917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:59.209138 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab122f-20e6-4f33-b186-aa4f29020917 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:59.226093 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 77/165] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:57:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:59.228689 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:59.236309 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab122f-20e6-4f33-b186-aa4f29020917 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:59.245739 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298de02-9a90-4f7b-aac7-1d765fd920a7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:59.300039 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69399184-816e-49aa-99fb-fe43dc3990ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:59.300724 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69399184-816e-49aa-99fb-fe43dc3990ca None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:59.301013 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69399184-816e-49aa-99fb-fe43dc3990ca None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:59.301297 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69399184-816e-49aa-99fb-fe43dc3990ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:59.397731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab122f-20e6-4f33-b186-aa4f29020917 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:59.417053 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69399184-816e-49aa-99fb-fe43dc3990ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:59.418913 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69399184-816e-49aa-99fb-fe43dc3990ca None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:59.442562 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ea23e-971c-4cb1-b0d0-0f461b8f565a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:59.443509 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ea23e-971c-4cb1-b0d0-0f461b8f565a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:59.443792 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ea23e-971c-4cb1-b0d0-0f461b8f565a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:59.444078 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ea23e-971c-4cb1-b0d0-0f461b8f565a None admin] PATH_INFO: `/v3/users/30e9db5e0da449078023b57bb514a0b6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:59.446308 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ea23e-971c-4cb1-b0d0-0f461b8f565a None admin] RBAC: Authorizing `identity:get_user(user_id=30e9db5e0da449078023b57bb514a0b6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:59.447838 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ea23e-971c-4cb1-b0d0-0f461b8f565a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:59.449771 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 78/166] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:57:59 2022] GET /identity/v3/users/30e9db5e0da449078023b57bb514a0b6 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:57:59.457786 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ea23e-971c-4cb1-b0d0-0f461b8f565a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:59.507972 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:59.575742 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:59.610101 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 89/167] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:57:59.617829 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69399184-816e-49aa-99fb-fe43dc3990ca None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:57:59.643555 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ea23e-971c-4cb1-b0d0-0f461b8f565a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:59.722615 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ac650-cb10-4753-922c-1404ba99244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:59.723196 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac650-cb10-4753-922c-1404ba99244b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:59.723513 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac650-cb10-4753-922c-1404ba99244b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:59.723782 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ac650-cb10-4753-922c-1404ba99244b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:59.818483 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ac650-cb10-4753-922c-1404ba99244b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:57:59.820019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ac650-cb10-4753-922c-1404ba99244b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:57:59.846165 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:57:59.856752 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69399184-816e-49aa-99fb-fe43dc3990ca None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:57:59.933508 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 79/168] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:57:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:57:59.935334 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020864e-4abe-4339-8fba-bcc53c16997f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:59.935630 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020864e-4abe-4339-8fba-bcc53c16997f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:59.935907 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020864e-4abe-4339-8fba-bcc53c16997f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:59.937254 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 80/169] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:57:59.944934 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d9f57-2e4b-46a5-81d8-10b1ad08ae33 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:59.945577 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d9f57-2e4b-46a5-81d8-10b1ad08ae33 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:59.945854 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d9f57-2e4b-46a5-81d8-10b1ad08ae33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:57:59.964596 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c91d9f57-2e4b-46a5-81d8-10b1ad08ae33 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:57:59.965786 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c91d9f57-2e4b-46a5-81d8-10b1ad08ae33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:57:59.992127 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0f98c-dd3c-4369-8748-050070fea18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:57:59.992956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0f98c-dd3c-4369-8748-050070fea18d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:57:59.993245 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0f98c-dd3c-4369-8748-050070fea18d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:57:59.993523 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa0f98c-dd3c-4369-8748-050070fea18d None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.000025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0f98c-dd3c-4369-8748-050070fea18d None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:00.001526 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa0f98c-dd3c-4369-8748-050070fea18d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:00.003579 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 90/170] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:57:59 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:00.004364 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0f98c-dd3c-4369-8748-050070fea18d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:00.036351 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 81/171] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:57:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:00.038150 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c68cf8-36fc-4ee6-bd46-58536a57561d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.038576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c68cf8-36fc-4ee6-bd46-58536a57561d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.039014 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c68cf8-36fc-4ee6-bd46-58536a57561d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.040813 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 82/172] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:00.041720 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c68cf8-36fc-4ee6-bd46-58536a57561d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:00.115727 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:00.152314 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c68cf8-36fc-4ee6-bd46-58536a57561d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:00.176433 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:00.193967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df14deb-7702-447a-8cb6-25e6695cacbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:00.195009 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df14deb-7702-447a-8cb6-25e6695cacbb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.196563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df14deb-7702-447a-8cb6-25e6695cacbb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.197003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df14deb-7702-447a-8cb6-25e6695cacbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.198103 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df14deb-7702-447a-8cb6-25e6695cacbb None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c, user.id=bd7e825180504b9cb4f914bcf260106f) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:00.198575 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df14deb-7702-447a-8cb6-25e6695cacbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:00.200214 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df14deb-7702-447a-8cb6-25e6695cacbb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:00.208349 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 83/173] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:00 2022] GET /identity/v3/role_assignments?user.id=bd7e825180504b9cb4f914bcf260106f&scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:00.210139 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07699ad7-a71c-47a1-8fd5-c679af5529b4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.210561 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07699ad7-a71c-47a1-8fd5-c679af5529b4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.211122 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07699ad7-a71c-47a1-8fd5-c679af5529b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.232729 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa0f98c-dd3c-4369-8748-050070fea18d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:00.234004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-07699ad7-a71c-47a1-8fd5-c679af5529b4 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:00.235651 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-07699ad7-a71c-47a1-8fd5-c679af5529b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:00.278147 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dffa6-b58d-4c92-9673-65ca8a0485e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:00.279106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dffa6-b58d-4c92-9673-65ca8a0485e8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.279494 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dffa6-b58d-4c92-9673-65ca8a0485e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.279881 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134dffa6-b58d-4c92-9673-65ca8a0485e8 None admin] PATH_INFO: `/v3/projects/e612c90e96d445198b08701f2af561b0` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.281236 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134dffa6-b58d-4c92-9673-65ca8a0485e8 None admin] RBAC: Authorizing `identity:get_project(project_id=e612c90e96d445198b08701f2af561b0)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:00.282917 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134dffa6-b58d-4c92-9673-65ca8a0485e8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:00.289878 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 91/174] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:00 2022] GET /identity/v3/projects/e612c90e96d445198b08701f2af561b0 => generated 312 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:00.289878 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dffa6-b58d-4c92-9673-65ca8a0485e8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:00.329401 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 84/175] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:00.331144 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901c7b9-3ec0-4340-9468-414f04132099 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.331506 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901c7b9-3ec0-4340-9468-414f04132099 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.331865 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901c7b9-3ec0-4340-9468-414f04132099 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.333510 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 85/176] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:00.335512 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4696964-9680-49b3-94c3-acc674c4eb1a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.335512 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4696964-9680-49b3-94c3-acc674c4eb1a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.335512 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4696964-9680-49b3-94c3-acc674c4eb1a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.337186 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 86/177] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:00.338014 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4696964-9680-49b3-94c3-acc674c4eb1a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:00.394722 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:00.419766 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134dffa6-b58d-4c92-9673-65ca8a0485e8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:00.443955 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:00.459052 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4696964-9680-49b3-94c3-acc674c4eb1a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:00.460525 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56056d18-71d7-4218-82ca-9e1a0cd53e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:00.461272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56056d18-71d7-4218-82ca-9e1a0cd53e7d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.461556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56056d18-71d7-4218-82ca-9e1a0cd53e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.461837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56056d18-71d7-4218-82ca-9e1a0cd53e7d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.481038 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56056d18-71d7-4218-82ca-9e1a0cd53e7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-56056d18-71d7-4218-82ca-9e1a0cd53e7d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:00.488944 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:00.489842 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:00.490945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:00.490945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:00.490945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:00.490945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:00.490945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:00.490945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:00.490945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:00.490945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:00.490945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:00.490945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:00.490945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:00.490945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:00.490945 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 92/178] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:58:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:00.495494 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6442b-fa0b-414a-9398-a99e28da9020 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.496234 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6442b-fa0b-414a-9398-a99e28da9020 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.496676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6442b-fa0b-414a-9398-a99e28da9020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.505770 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e997e79-de16-4e01-8981-6e0651c5e5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:00.506445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e997e79-de16-4e01-8981-6e0651c5e5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.506729 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e997e79-de16-4e01-8981-6e0651c5e5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.507008 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e997e79-de16-4e01-8981-6e0651c5e5e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.507888 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e997e79-de16-4e01-8981-6e0651c5e5e8 None admin] RBAC: Adding query filter params (role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9, scope.project.id=e612c90e96d445198b08701f2af561b0, user.id=30e9db5e0da449078023b57bb514a0b6) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:00.508203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e997e79-de16-4e01-8981-6e0651c5e5e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:00.510789 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e997e79-de16-4e01-8981-6e0651c5e5e8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:00.516521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1fb6442b-fa0b-414a-9398-a99e28da9020 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:00.517393 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 87/179] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:00 2022] GET /identity/v3/role_assignments?user.id=30e9db5e0da449078023b57bb514a0b6&scope.project.id=e612c90e96d445198b08701f2af561b0&role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:00.517857 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1fb6442b-fa0b-414a-9398-a99e28da9020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:00.518667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc4427-0fc0-47d2-b19b-3e81c86c61fd None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.518955 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc4427-0fc0-47d2-b19b-3e81c86c61fd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.519243 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bc4427-0fc0-47d2-b19b-3e81c86c61fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.547608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-41bc4427-0fc0-47d2-b19b-3e81c86c61fd None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:00.549371 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-41bc4427-0fc0-47d2-b19b-3e81c86c61fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:00.602189 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 93/180] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:00.603150 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6442b-fa0b-414a-9398-a99e28da9020 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:00.639094 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 88/181] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:00.647480 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc4427-0fc0-47d2-b19b-3e81c86c61fd None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:00.694095 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:00.728188 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6442b-fa0b-414a-9398-a99e28da9020 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:00.740063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:00.759670 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bc4427-0fc0-47d2-b19b-3e81c86c61fd None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:00.772165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d228c4-a8a3-49bc-9946-c0b2b54fe6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:00.772987 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d228c4-a8a3-49bc-9946-c0b2b54fe6ee None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.773274 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d228c4-a8a3-49bc-9946-c0b2b54fe6ee None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.773552 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d228c4-a8a3-49bc-9946-c0b2b54fe6ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.783883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d228c4-a8a3-49bc-9946-c0b2b54fe6ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-92d228c4-a8a3-49bc-9946-c0b2b54fe6ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:00.791603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:00.792558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:00.793372 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:00.793372 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:00.793372 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:00.793372 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:00.793372 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:00.793372 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:00.793372 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:00.793372 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:00.793372 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:00.793372 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:00.793372 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:58:00.793372 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:00.793372 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 94/182] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:58:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:00.794197 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb8837-fa2f-469f-9c21-4cca2a89871e None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.794356 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb8837-fa2f-469f-9c21-4cca2a89871e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.794640 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb8837-fa2f-469f-9c21-4cca2a89871e None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.796078 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 95/183] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:00.796647 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb8837-fa2f-469f-9c21-4cca2a89871e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:00.801648 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29130a82-e99f-4586-a60c-a6696d0cd6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:00.802292 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29130a82-e99f-4586-a60c-a6696d0cd6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.802577 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29130a82-e99f-4586-a60c-a6696d0cd6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.802857 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29130a82-e99f-4586-a60c-a6696d0cd6e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.803672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29130a82-e99f-4586-a60c-a6696d0cd6e5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:00.803980 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29130a82-e99f-4586-a60c-a6696d0cd6e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:00.805405 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29130a82-e99f-4586-a60c-a6696d0cd6e5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:00.818740 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 89/184] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:00.819489 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29130a82-e99f-4586-a60c-a6696d0cd6e5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:00.901322 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb8837-fa2f-469f-9c21-4cca2a89871e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:00.916651 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29130a82-e99f-4586-a60c-a6696d0cd6e5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:00.918927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:00.934857 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a3267-bde8-4874-9f7d-d47c8853bb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:00.935793 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a3267-bde8-4874-9f7d-d47c8853bb75 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.936146 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a3267-bde8-4874-9f7d-d47c8853bb75 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.936414 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4a3267-bde8-4874-9f7d-d47c8853bb75 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.946639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4a3267-bde8-4874-9f7d-d47c8853bb75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:00.950065 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1aa16-6575-4915-a2ee-01ba88b03e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:00.950871 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1aa16-6575-4915-a2ee-01ba88b03e71 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.951150 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1aa16-6575-4915-a2ee-01ba88b03e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.951454 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1aa16-6575-4915-a2ee-01ba88b03e71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.952619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1aa16-6575-4915-a2ee-01ba88b03e71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:00.954085 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1aa16-6575-4915-a2ee-01ba88b03e71 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-9a4a3267-bde8-4874-9f7d-d47c8853bb75 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:00.954491 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:00.955557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:00.956536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:00.956536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:00.956536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:00.956536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:00.956536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:00.956536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:00.956536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:00.956536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:00.956536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:00.956536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:00.956536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:58:00.956536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:00.957142 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 90/185] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:00.957142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eb0dd-e5e8-45a4-a91f-763246c58457 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:00.957142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eb0dd-e5e8-45a4-a91f-763246c58457 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:00.957430 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437eb0dd-e5e8-45a4-a91f-763246c58457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:00.960900 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 96/186] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:00.961484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a3267-bde8-4874-9f7d-d47c8853bb75 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:00.976432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-437eb0dd-e5e8-45a4-a91f-763246c58457 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:00.977639 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-437eb0dd-e5e8-45a4-a91f-763246c58457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:00.991028 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:01.043598 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 91/187] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:01.044261 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437eb0dd-e5e8-45a4-a91f-763246c58457 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:01.059767 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4a3267-bde8-4874-9f7d-d47c8853bb75 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:01.093028 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d10cac-78d4-46a7-8c6b-da8439ebedf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:01.093705 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d10cac-78d4-46a7-8c6b-da8439ebedf4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:01.093994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d10cac-78d4-46a7-8c6b-da8439ebedf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:01.094295 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d10cac-78d4-46a7-8c6b-da8439ebedf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:01.095057 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d10cac-78d4-46a7-8c6b-da8439ebedf4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:01.095403 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d10cac-78d4-46a7-8c6b-da8439ebedf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:01.096800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d10cac-78d4-46a7-8c6b-da8439ebedf4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:01.104842 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 97/188] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:01.105606 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d10cac-78d4-46a7-8c6b-da8439ebedf4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:01.151978 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437eb0dd-e5e8-45a4-a91f-763246c58457 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:01.153471 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:01.187812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f362d45-35be-45f6-928e-a491854e7ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:01.188704 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f362d45-35be-45f6-928e-a491854e7ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:01.188996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f362d45-35be-45f6-928e-a491854e7ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:01.189288 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f362d45-35be-45f6-928e-a491854e7ce1 None admin] PATH_INFO: `/v3/users/30e9db5e0da449078023b57bb514a0b6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:01.190502 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f362d45-35be-45f6-928e-a491854e7ce1 None admin] RBAC: Authorizing `identity:get_user(user_id=30e9db5e0da449078023b57bb514a0b6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:01.192073 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f362d45-35be-45f6-928e-a491854e7ce1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:01.192407 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:01.193907 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 92/189] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:01 2022] GET /identity/v3/users/30e9db5e0da449078023b57bb514a0b6 => generated 275 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:01.194447 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f362d45-35be-45f6-928e-a491854e7ce1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:01.206457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d10cac-78d4-46a7-8c6b-da8439ebedf4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:01.240095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc8b68-7eb5-46a3-8c7f-f64c391b1955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:01.240784 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc8b68-7eb5-46a3-8c7f-f64c391b1955 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:01.241064 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc8b68-7eb5-46a3-8c7f-f64c391b1955 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:01.241324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fc8b68-7eb5-46a3-8c7f-f64c391b1955 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:01.242100 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc8b68-7eb5-46a3-8c7f-f64c391b1955 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:01.242409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc8b68-7eb5-46a3-8c7f-f64c391b1955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:01.243838 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fc8b68-7eb5-46a3-8c7f-f64c391b1955 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:01.251913 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 98/190] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:01.252685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc8b68-7eb5-46a3-8c7f-f64c391b1955 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:01.295422 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f362d45-35be-45f6-928e-a491854e7ce1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:01.328470 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58f074-12b3-4b6a-9b1a-4755fb708f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:01.329069 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58f074-12b3-4b6a-9b1a-4755fb708f3b None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:01.329346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58f074-12b3-4b6a-9b1a-4755fb708f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:01.329615 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58f074-12b3-4b6a-9b1a-4755fb708f3b None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:01.330324 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58f074-12b3-4b6a-9b1a-4755fb708f3b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:01.331821 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58f074-12b3-4b6a-9b1a-4755fb708f3b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:01.351308 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fc8b68-7eb5-46a3-8c7f-f64c391b1955 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:01.357423 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 93/191] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 00:58:01 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:58:01.358234 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58f074-12b3-4b6a-9b1a-4755fb708f3b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:01.387575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054fb28-d9a9-4fd3-965d-55f6520876fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:01.388287 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:01.388420 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054fb28-d9a9-4fd3-965d-55f6520876fd None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:01.388931 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054fb28-d9a9-4fd3-965d-55f6520876fd None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:01.388931 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054fb28-d9a9-4fd3-965d-55f6520876fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:01.402519 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054fb28-d9a9-4fd3-965d-55f6520876fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-6054fb28-d9a9-4fd3-965d-55f6520876fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:01.411018 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:01.412266 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:01.413110 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:01.413110 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:01.413110 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:01.413110 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:01.413110 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:01.413110 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:01.413110 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:01.413110 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:01.413110 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:01.413110 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:01.413110 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:01.413110 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:01.413110 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 99/192] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:58:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:01.413766 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054fb28-d9a9-4fd3-965d-55f6520876fd None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:01.432799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:01.474726 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58f074-12b3-4b6a-9b1a-4755fb708f3b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:01.515334 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd330b-d14f-4c98-80a2-01298dedf962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:01.516445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd330b-d14f-4c98-80a2-01298dedf962 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:01.516734 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd330b-d14f-4c98-80a2-01298dedf962 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:01.517015 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd330b-d14f-4c98-80a2-01298dedf962 None admin] PATH_INFO: `/v3/users/91b9e2cb20a343c18f702505f17e23c5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:01.535156 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd330b-d14f-4c98-80a2-01298dedf962 None admin] RBAC: Authorizing `identity:get_user(user_id=91b9e2cb20a343c18f702505f17e23c5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:01.536823 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054fb28-d9a9-4fd3-965d-55f6520876fd None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:01.536933 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd330b-d14f-4c98-80a2-01298dedf962 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:01.538722 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 94/193] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:01 2022] GET /identity/v3/users/91b9e2cb20a343c18f702505f17e23c5 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:01.538722 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd330b-d14f-4c98-80a2-01298dedf962 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:01.575194 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba3d17-700b-48c6-92db-e8da849178a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:01.575889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba3d17-700b-48c6-92db-e8da849178a2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:01.576268 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba3d17-700b-48c6-92db-e8da849178a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:01.576437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba3d17-700b-48c6-92db-e8da849178a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:01.646079 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:01.665322 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba3d17-700b-48c6-92db-e8da849178a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:01.666873 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ba3d17-700b-48c6-92db-e8da849178a2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:01.667943 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd330b-d14f-4c98-80a2-01298dedf962 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:01.682858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:01.707671 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f23e8c-0be3-41ca-a57a-c10d0e22e8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:01.708569 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f23e8c-0be3-41ca-a57a-c10d0e22e8ca None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:01.708855 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f23e8c-0be3-41ca-a57a-c10d0e22e8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:01.709567 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f23e8c-0be3-41ca-a57a-c10d0e22e8ca None admin] PATH_INFO: `/v3/users/236f8b4cfa344ad49dfba0bb362a9992` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:01.710798 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f23e8c-0be3-41ca-a57a-c10d0e22e8ca None admin] RBAC: Authorizing `identity:get_user(user_id=236f8b4cfa344ad49dfba0bb362a9992)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:01.712997 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f23e8c-0be3-41ca-a57a-c10d0e22e8ca None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:01.715519 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 95/194] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:01 2022] GET /identity/v3/users/236f8b4cfa344ad49dfba0bb362a9992 => generated 289 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:01.716683 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f23e8c-0be3-41ca-a57a-c10d0e22e8ca None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:01.769074 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 100/195] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:01.769872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba3d17-700b-48c6-92db-e8da849178a2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:01.857353 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f23e8c-0be3-41ca-a57a-c10d0e22e8ca None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:01.891657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba3d17-700b-48c6-92db-e8da849178a2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:01.897976 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59d4f9-fc57-4c9a-af65-0b20fb371d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:01.898602 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59d4f9-fc57-4c9a-af65-0b20fb371d58 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:01.898879 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59d4f9-fc57-4c9a-af65-0b20fb371d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:01.899151 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f59d4f9-fc57-4c9a-af65-0b20fb371d58 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:01.900448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59d4f9-fc57-4c9a-af65-0b20fb371d58 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:01.900757 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59d4f9-fc57-4c9a-af65-0b20fb371d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:01.902776 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f59d4f9-fc57-4c9a-af65-0b20fb371d58 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:01.907747 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:01.914784 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 96/196] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:01.915989 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59d4f9-fc57-4c9a-af65-0b20fb371d58 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:01.933970 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de0a01-5ada-419d-90f4-00a0ef9d6151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:01.934485 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:01.934631 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de0a01-5ada-419d-90f4-00a0ef9d6151 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:01.935071 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de0a01-5ada-419d-90f4-00a0ef9d6151 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:01.935532 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6de0a01-5ada-419d-90f4-00a0ef9d6151 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:02.003943 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de0a01-5ada-419d-90f4-00a0ef9d6151 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:02.005435 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6de0a01-5ada-419d-90f4-00a0ef9d6151 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:02.035048 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f59d4f9-fc57-4c9a-af65-0b20fb371d58 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:02.071694 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50220b4-0ab1-4719-863c-cfb5f598cefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:02.072360 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50220b4-0ab1-4719-863c-cfb5f598cefd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:02.072652 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50220b4-0ab1-4719-863c-cfb5f598cefd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:02.072965 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50220b4-0ab1-4719-863c-cfb5f598cefd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:02.124197 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 101/197] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:02.125370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de0a01-5ada-419d-90f4-00a0ef9d6151 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:02.141840 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:02.174121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50220b4-0ab1-4719-863c-cfb5f598cefd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:02.175794 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50220b4-0ab1-4719-863c-cfb5f598cefd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:02.191839 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:02.248957 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6de0a01-5ada-419d-90f4-00a0ef9d6151 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:02.285149 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a3c55-44eb-420a-9907-43ce9f968ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:02.286436 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 97/198] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:02.286630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a3c55-44eb-420a-9907-43ce9f968ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:02.287010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a3c55-44eb-420a-9907-43ce9f968ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:02.287406 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a3c55-44eb-420a-9907-43ce9f968ab8 None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:02.287845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50220b4-0ab1-4719-863c-cfb5f598cefd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:02.288935 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a3c55-44eb-420a-9907-43ce9f968ab8 None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:02.290504 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a3c55-44eb-420a-9907-43ce9f968ab8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:02.297212 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 102/199] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:02 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:02.298154 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a3c55-44eb-420a-9907-43ce9f968ab8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:02.380611 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:02.388812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50220b4-0ab1-4719-863c-cfb5f598cefd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:02.400209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a3c55-44eb-420a-9907-43ce9f968ab8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:02.411662 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:02.425952 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a6892-49b0-4752-99d2-47b81eb4990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:02.426988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a6892-49b0-4752-99d2-47b81eb4990d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:02.427312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a6892-49b0-4752-99d2-47b81eb4990d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:02.427608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a6892-49b0-4752-99d2-47b81eb4990d None admin] PATH_INFO: `/v3/users/91b9e2cb20a343c18f702505f17e23c5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:02.429407 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a6892-49b0-4752-99d2-47b81eb4990d None admin] RBAC: Authorizing `identity:get_user(user_id=91b9e2cb20a343c18f702505f17e23c5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:02.431315 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a6892-49b0-4752-99d2-47b81eb4990d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:02.433686 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 98/200] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:02 2022] GET /identity/v3/users/91b9e2cb20a343c18f702505f17e23c5 => generated 283 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:02.434601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a6892-49b0-4752-99d2-47b81eb4990d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:02.442165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce4112-ad07-4a2f-8d63-2254a41eba67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:02.443371 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce4112-ad07-4a2f-8d63-2254a41eba67 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:02.443825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce4112-ad07-4a2f-8d63-2254a41eba67 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:02.444286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce4112-ad07-4a2f-8d63-2254a41eba67 None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:02.446097 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce4112-ad07-4a2f-8d63-2254a41eba67 None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:02.447820 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce4112-ad07-4a2f-8d63-2254a41eba67 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:02.450101 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 103/201] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:02 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:02.451025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce4112-ad07-4a2f-8d63-2254a41eba67 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:02.558649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a6892-49b0-4752-99d2-47b81eb4990d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:02.567769 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce4112-ad07-4a2f-8d63-2254a41eba67 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:02.598695 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fcc86-ac3e-4511-ad5f-a70dc13efd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:02.599941 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fcc86-ac3e-4511-ad5f-a70dc13efd11 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:02.600480 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fcc86-ac3e-4511-ad5f-a70dc13efd11 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:02.600768 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76fcc86-ac3e-4511-ad5f-a70dc13efd11 None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:02.602143 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fcc86-ac3e-4511-ad5f-a70dc13efd11 None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:02.604394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76fcc86-ac3e-4511-ad5f-a70dc13efd11 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:02.607043 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 99/202] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:02 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:02.607883 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fcc86-ac3e-4511-ad5f-a70dc13efd11 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:02.616805 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f02b3-0c1e-472e-b268-a0bf5772934b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:02.617580 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f02b3-0c1e-472e-b268-a0bf5772934b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:02.617876 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f02b3-0c1e-472e-b268-a0bf5772934b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:02.618145 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07f02b3-0c1e-472e-b268-a0bf5772934b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:02.618994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f02b3-0c1e-472e-b268-a0bf5772934b None admin] RBAC: Adding query filter params (role.id=e7e71ae9fccc4607808005a2e261bab1, scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c, user.id=30e9db5e0da449078023b57bb514a0b6) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:02.619325 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f02b3-0c1e-472e-b268-a0bf5772934b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:02.620949 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07f02b3-0c1e-472e-b268-a0bf5772934b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:02.627741 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 104/203] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:02 2022] GET /identity/v3/role_assignments?user.id=30e9db5e0da449078023b57bb514a0b6&scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c&role.id=e7e71ae9fccc4607808005a2e261bab1 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:02.628693 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f02b3-0c1e-472e-b268-a0bf5772934b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:02.646611 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:02.677135 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:02.724687 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76fcc86-ac3e-4511-ad5f-a70dc13efd11 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:02.762576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca3bc6-8a1d-4a79-8424-8171bc9c8c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:02.763275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca3bc6-8a1d-4a79-8424-8171bc9c8c1b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:02.763598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca3bc6-8a1d-4a79-8424-8171bc9c8c1b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:02.763893 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeca3bc6-8a1d-4a79-8424-8171bc9c8c1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:02.836782 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca3bc6-8a1d-4a79-8424-8171bc9c8c1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:02.838337 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeca3bc6-8a1d-4a79-8424-8171bc9c8c1b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:02.873427 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07f02b3-0c1e-472e-b268-a0bf5772934b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:02.890912 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:02.911577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959af38-813d-4322-89e8-dedbdb107371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:02.912343 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959af38-813d-4322-89e8-dedbdb107371 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:02.912630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959af38-813d-4322-89e8-dedbdb107371 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:02.912932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959af38-813d-4322-89e8-dedbdb107371 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:02.913882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959af38-813d-4322-89e8-dedbdb107371 None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=60e98823de624a7fa1c311b6f19b75a3, user.id=91b9e2cb20a343c18f702505f17e23c5) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:02.914234 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959af38-813d-4322-89e8-dedbdb107371 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:02.915930 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959af38-813d-4322-89e8-dedbdb107371 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:02.922743 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 105/204] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:02 2022] GET /identity/v3/role_assignments?user.id=91b9e2cb20a343c18f702505f17e23c5&scope.project.id=60e98823de624a7fa1c311b6f19b75a3&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 259 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:02.923821 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959af38-813d-4322-89e8-dedbdb107371 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:02.947018 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 100/205] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:02.953804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca3bc6-8a1d-4a79-8424-8171bc9c8c1b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:03.063575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:03.078916 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeca3bc6-8a1d-4a79-8424-8171bc9c8c1b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:03.110518 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959af38-813d-4322-89e8-dedbdb107371 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:03.121427 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70584d47-f806-499f-979f-eb84944e8107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:03.123103 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70584d47-f806-499f-979f-eb84944e8107 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:03.123594 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70584d47-f806-499f-979f-eb84944e8107 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:03.124049 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70584d47-f806-499f-979f-eb84944e8107 None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:03.125520 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70584d47-f806-499f-979f-eb84944e8107 None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:03.127770 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70584d47-f806-499f-979f-eb84944e8107 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:03.129800 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 101/206] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:02 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:03.136766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70584d47-f806-499f-979f-eb84944e8107 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:03.157350 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860248c2-38c4-4dd3-81d4-8015fe6e0327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:03.158372 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860248c2-38c4-4dd3-81d4-8015fe6e0327 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:03.158876 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860248c2-38c4-4dd3-81d4-8015fe6e0327 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:03.159342 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860248c2-38c4-4dd3-81d4-8015fe6e0327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:03.160382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860248c2-38c4-4dd3-81d4-8015fe6e0327 None admin] RBAC: Adding query filter params (role.id=ac3cef1fcb1744de989fa7f25e7de7b4, scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c, user.id=236f8b4cfa344ad49dfba0bb362a9992) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:03.160867 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860248c2-38c4-4dd3-81d4-8015fe6e0327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:03.162332 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:03.163937 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860248c2-38c4-4dd3-81d4-8015fe6e0327 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:03.171205 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 106/207] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:02 2022] GET /identity/v3/role_assignments?user.id=236f8b4cfa344ad49dfba0bb362a9992&scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c&role.id=ac3cef1fcb1744de989fa7f25e7de7b4 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:03.267929 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70584d47-f806-499f-979f-eb84944e8107 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:03.307641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d4e191-4323-4f8e-be88-cb07adba3895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:03.308328 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e191-4323-4f8e-be88-cb07adba3895 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:03.308617 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e191-4323-4f8e-be88-cb07adba3895 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:03.308900 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d4e191-4323-4f8e-be88-cb07adba3895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:03.309877 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4e191-4323-4f8e-be88-cb07adba3895 None admin] RBAC: Adding query filter params (role.id=e7e71ae9fccc4607808005a2e261bab1, scope.project.id=60e98823de624a7fa1c311b6f19b75a3, user.id=91b9e2cb20a343c18f702505f17e23c5) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:03.310202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4e191-4323-4f8e-be88-cb07adba3895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:03.311736 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d4e191-4323-4f8e-be88-cb07adba3895 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:03.318460 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 102/208] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:03 2022] GET /identity/v3/role_assignments?user.id=91b9e2cb20a343c18f702505f17e23c5&scope.project.id=60e98823de624a7fa1c311b6f19b75a3&role.id=e7e71ae9fccc4607808005a2e261bab1 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:03.595177 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1961a-a982-49ac-bf90-4d241663eb38 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:03.595690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1961a-a982-49ac-bf90-4d241663eb38 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:03.595690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af1961a-a982-49ac-bf90-4d241663eb38 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:03.597199 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 107/209] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:03.602431 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8363470-5416-4fb4-aa46-ac039aef2208 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:03.602723 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8363470-5416-4fb4-aa46-ac039aef2208 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:03.603003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8363470-5416-4fb4-aa46-ac039aef2208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:03.621735 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b8363470-5416-4fb4-aa46-ac039aef2208 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:03.622947 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b8363470-5416-4fb4-aa46-ac039aef2208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:03.700025 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 103/210] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:03.724312 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1961a-a982-49ac-bf90-4d241663eb38 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:03.809562 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332b26c-8d36-4586-a206-236cfc4c68dd None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:03.809874 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332b26c-8d36-4586-a206-236cfc4c68dd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:03.810135 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332b26c-8d36-4586-a206-236cfc4c68dd None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:03.811828 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 104/211] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:03.817247 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ba893-f27e-49d9-9a9b-19ca33252cda None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:03.817537 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ba893-f27e-49d9-9a9b-19ca33252cda None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:03.817817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8ba893-f27e-49d9-9a9b-19ca33252cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:03.835905 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8e8ba893-f27e-49d9-9a9b-19ca33252cda None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:03.837360 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8e8ba893-f27e-49d9-9a9b-19ca33252cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:03.844503 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af1961a-a982-49ac-bf90-4d241663eb38 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:03.849613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:03.879807 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8102122-f615-4b35-a3af-ecc7a25b9a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:03.880626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8102122-f615-4b35-a3af-ecc7a25b9a4e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:03.880910 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8102122-f615-4b35-a3af-ecc7a25b9a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:03.881181 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8102122-f615-4b35-a3af-ecc7a25b9a4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:03.891811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8102122-f615-4b35-a3af-ecc7a25b9a4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-b8102122-f615-4b35-a3af-ecc7a25b9a4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:03.899659 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:03.900562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:03.901433 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:03.901433 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:03.901433 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:03.901433 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:03.901433 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:03.901433 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:03.901433 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:03.901433 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:03.901433 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:03.901433 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:03.901433 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:03.901433 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:03.901433 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 108/212] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:03.908365 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8102122-f615-4b35-a3af-ecc7a25b9a4e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:03.911898 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:03.927274 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 105/213] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:58:03.951281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ba893-f27e-49d9-9a9b-19ca33252cda None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:04.039863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8102122-f615-4b35-a3af-ecc7a25b9a4e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:04.074469 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3c577-d53e-4673-b96d-e8c98058a72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:04.074890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8ba893-f27e-49d9-9a9b-19ca33252cda None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:04.075424 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3c577-d53e-4673-b96d-e8c98058a72b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:04.075801 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3c577-d53e-4673-b96d-e8c98058a72b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:04.076170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f3c577-d53e-4673-b96d-e8c98058a72b None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:04.077072 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3c577-d53e-4673-b96d-e8c98058a72b None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:04.077409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3c577-d53e-4673-b96d-e8c98058a72b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:04.078957 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f3c577-d53e-4673-b96d-e8c98058a72b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:04.088573 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 109/214] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:04.094182 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3c577-d53e-4673-b96d-e8c98058a72b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:04.121889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beceedc4-7da3-48ba-a68f-b75f5b0be64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:04.123547 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beceedc4-7da3-48ba-a68f-b75f5b0be64d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:04.124202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beceedc4-7da3-48ba-a68f-b75f5b0be64d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:04.125034 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beceedc4-7da3-48ba-a68f-b75f5b0be64d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:04.126630 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beceedc4-7da3-48ba-a68f-b75f5b0be64d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:04.129318 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beceedc4-7da3-48ba-a68f-b75f5b0be64d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:04.136911 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 106/215] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:04.138219 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beceedc4-7da3-48ba-a68f-b75f5b0be64d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:04.153832 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:04.166883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:04.217231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f3c577-d53e-4673-b96d-e8c98058a72b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:04.256305 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beceedc4-7da3-48ba-a68f-b75f5b0be64d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:04.264761 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94ec56-316a-4658-a409-82600b204512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:04.265874 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94ec56-316a-4658-a409-82600b204512 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:04.266799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94ec56-316a-4658-a409-82600b204512 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:04.267255 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94ec56-316a-4658-a409-82600b204512 None admin] PATH_INFO: `/v3/users/65a06df50e5247309ac62286cc4baa6c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:04.287092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94ec56-316a-4658-a409-82600b204512 None admin] RBAC: Authorizing `identity:get_user(user_id=65a06df50e5247309ac62286cc4baa6c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:04.289440 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94ec56-316a-4658-a409-82600b204512 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:04.291384 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161982a4-d80e-48f2-b5f9-846a5ded4a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:04.292260 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 110/216] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:04 2022] GET /identity/v3/users/65a06df50e5247309ac62286cc4baa6c => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:04.293350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161982a4-d80e-48f2-b5f9-846a5ded4a8d None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:04.293725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161982a4-d80e-48f2-b5f9-846a5ded4a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:04.294066 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161982a4-d80e-48f2-b5f9-846a5ded4a8d None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:04.298180 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161982a4-d80e-48f2-b5f9-846a5ded4a8d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:04.299683 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161982a4-d80e-48f2-b5f9-846a5ded4a8d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:04.300018 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94ec56-316a-4658-a409-82600b204512 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:04.326398 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 107/217] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 00:58:04 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:58:04.423753 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94ec56-316a-4658-a409-82600b204512 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:04.451053 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:04.464132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4a916-8a31-4858-92cf-74e9d2a42a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:04.465437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4a916-8a31-4858-92cf-74e9d2a42a59 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:04.466254 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4a916-8a31-4858-92cf-74e9d2a42a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:04.466685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4a916-8a31-4858-92cf-74e9d2a42a59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:04.543507 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4a916-8a31-4858-92cf-74e9d2a42a59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:04.544985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4a916-8a31-4858-92cf-74e9d2a42a59 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:04.651757 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 111/218] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:04.658080 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161982a4-d80e-48f2-b5f9-846a5ded4a8d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:04.738211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:04.775443 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161982a4-d80e-48f2-b5f9-846a5ded4a8d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:04.811705 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf51f1d-1949-4aed-bb35-f66c4ee2709e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:04.812976 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf51f1d-1949-4aed-bb35-f66c4ee2709e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:04.813936 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf51f1d-1949-4aed-bb35-f66c4ee2709e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:04.813936 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf51f1d-1949-4aed-bb35-f66c4ee2709e None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:04.818430 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf51f1d-1949-4aed-bb35-f66c4ee2709e None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:04.818430 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf51f1d-1949-4aed-bb35-f66c4ee2709e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:04.818430 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 108/219] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:04 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:04.824651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4a916-8a31-4858-92cf-74e9d2a42a59 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:04.848706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:04.973765 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4a916-8a31-4858-92cf-74e9d2a42a59 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:05.019368 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc829ef-6ad7-4aff-a94f-978f33416cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:05.023746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc829ef-6ad7-4aff-a94f-978f33416cf6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:05.024318 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc829ef-6ad7-4aff-a94f-978f33416cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:05.024598 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc829ef-6ad7-4aff-a94f-978f33416cf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:05.025463 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc829ef-6ad7-4aff-a94f-978f33416cf6 None admin] RBAC: Adding query filter params (role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9, scope.project.id=60e98823de624a7fa1c311b6f19b75a3, user.id=65a06df50e5247309ac62286cc4baa6c) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:05.025779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc829ef-6ad7-4aff-a94f-978f33416cf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:05.027341 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc829ef-6ad7-4aff-a94f-978f33416cf6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:05.033884 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 112/220] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:04 2022] GET /identity/v3/role_assignments?user.id=65a06df50e5247309ac62286cc4baa6c&scope.project.id=60e98823de624a7fa1c311b6f19b75a3&role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:05.492657 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9367a33-5a86-49b2-b899-1ccdb8063dd2 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:05.493649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9367a33-5a86-49b2-b899-1ccdb8063dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:05.494169 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9367a33-5a86-49b2-b899-1ccdb8063dd2 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:05.496079 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 109/221] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:05.501092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3173f-1bd9-43dd-9606-81eeb80c92ac None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:05.501384 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3173f-1bd9-43dd-9606-81eeb80c92ac None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:05.501660 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3173f-1bd9-43dd-9606-81eeb80c92ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:05.526844 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e2d3173f-1bd9-43dd-9606-81eeb80c92ac None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:05.528065 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e2d3173f-1bd9-43dd-9606-81eeb80c92ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:05.609728 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 113/222] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:05.633039 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b3eb4-5bd2-49f6-a0f5-5afdfb721e87 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:05.633616 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b3eb4-5bd2-49f6-a0f5-5afdfb721e87 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:05.634086 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005b3eb4-5bd2-49f6-a0f5-5afdfb721e87 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:05.636028 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 110/223] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:05.641526 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3c027-55cd-4cad-ad53-f1a4f754f454 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:05.642054 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3c027-55cd-4cad-ad53-f1a4f754f454 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:05.642523 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c3c027-55cd-4cad-ad53-f1a4f754f454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:05.648538 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b3eb4-5bd2-49f6-a0f5-5afdfb721e87 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:05.682601 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-85c3c027-55cd-4cad-ad53-f1a4f754f454 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:05.684486 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-85c3c027-55cd-4cad-ad53-f1a4f754f454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:05.707646 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:05.815702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005b3eb4-5bd2-49f6-a0f5-5afdfb721e87 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:05.831951 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 114/224] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:58:05.856713 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd25c4-bc89-4db3-a3e8-f95b1ee48bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:05.857548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd25c4-bc89-4db3-a3e8-f95b1ee48bdf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:05.857828 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd25c4-bc89-4db3-a3e8-f95b1ee48bdf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:05.858100 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dd25c4-bc89-4db3-a3e8-f95b1ee48bdf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:05.860114 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:05.871609 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dd25c4-bc89-4db3-a3e8-f95b1ee48bdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-b5dd25c4-bc89-4db3-a3e8-f95b1ee48bdf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:05.880703 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:05.881648 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:05.882663 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:05.882663 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:05.882663 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:05.882663 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:05.882663 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:05.882663 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:05.882663 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:05.882663 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:05.882663 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:05.882663 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:05.882663 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:05.882663 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:05.882663 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 111/225] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:58:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:58:05.889483 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3c027-55cd-4cad-ad53-f1a4f754f454 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:05.903819 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd25c4-bc89-4db3-a3e8-f95b1ee48bdf None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:06.017924 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dd25c4-bc89-4db3-a3e8-f95b1ee48bdf None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:06.066207 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9115f51-2a16-47fd-8582-200337123573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:06.067411 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9115f51-2a16-47fd-8582-200337123573 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:06.069183 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9115f51-2a16-47fd-8582-200337123573 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:06.071281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9115f51-2a16-47fd-8582-200337123573 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:06.092783 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9115f51-2a16-47fd-8582-200337123573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:06.108000 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c3c027-55cd-4cad-ad53-f1a4f754f454 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d9115f51-2a16-47fd-8582-200337123573 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:06.113693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:06.114828 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:06.115874 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:06.115874 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:06.115874 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:06.115874 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:06.115874 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:06.115874 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:06.115874 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:06.115874 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:06.115874 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:06.115874 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:06.115874 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:58:06.115874 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:06.118259 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 112/226] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:58:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:58:06.140356 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9115f51-2a16-47fd-8582-200337123573 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:06.160093 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7a755-61e8-4674-922d-938c52ef9c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:06.160839 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7a755-61e8-4674-922d-938c52ef9c05 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:06.161470 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7a755-61e8-4674-922d-938c52ef9c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:06.161752 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7a755-61e8-4674-922d-938c52ef9c05 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:06.162515 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7a755-61e8-4674-922d-938c52ef9c05 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:06.162820 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7a755-61e8-4674-922d-938c52ef9c05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:06.164247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e7a755-61e8-4674-922d-938c52ef9c05 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:06.183438 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 115/227] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:06.187834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7a755-61e8-4674-922d-938c52ef9c05 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:06.207054 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:06.245967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:06.291277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9115f51-2a16-47fd-8582-200337123573 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:06.335948 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d914b7-6c2d-40a6-8ffb-b9a0161c987d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:06.337085 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d914b7-6c2d-40a6-8ffb-b9a0161c987d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:06.337579 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d914b7-6c2d-40a6-8ffb-b9a0161c987d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:06.338041 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d914b7-6c2d-40a6-8ffb-b9a0161c987d None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:06.339040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d914b7-6c2d-40a6-8ffb-b9a0161c987d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:06.339559 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d914b7-6c2d-40a6-8ffb-b9a0161c987d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:06.341342 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d914b7-6c2d-40a6-8ffb-b9a0161c987d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:06.350720 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 113/228] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:06.356529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d914b7-6c2d-40a6-8ffb-b9a0161c987d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:06.375530 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7a755-61e8-4674-922d-938c52ef9c05 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:06.450163 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca830241-d460-42c8-be8c-8569953e30c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:06.451076 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca830241-d460-42c8-be8c-8569953e30c2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:06.451580 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca830241-d460-42c8-be8c-8569953e30c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:06.452001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca830241-d460-42c8-be8c-8569953e30c2 None admin] PATH_INFO: `/v3/users/91b9e2cb20a343c18f702505f17e23c5` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:06.456012 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca830241-d460-42c8-be8c-8569953e30c2 None admin] RBAC: Authorizing `identity:get_user(user_id=91b9e2cb20a343c18f702505f17e23c5)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:06.457643 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca830241-d460-42c8-be8c-8569953e30c2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:06.459789 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 116/229] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:06 2022] GET /identity/v3/users/91b9e2cb20a343c18f702505f17e23c5 => generated 283 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:06.465467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca830241-d460-42c8-be8c-8569953e30c2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:06.504448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d914b7-6c2d-40a6-8ffb-b9a0161c987d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:06.523600 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:06.542313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc64558-68b8-45fb-a794-d15f8310e2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:06.543629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc64558-68b8-45fb-a794-d15f8310e2ad None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:06.544150 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc64558-68b8-45fb-a794-d15f8310e2ad None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:06.544611 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc64558-68b8-45fb-a794-d15f8310e2ad None admin] PATH_INFO: `/v3/users/91b9e2cb20a343c18f702505f17e23c5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:06.546027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc64558-68b8-45fb-a794-d15f8310e2ad None admin] RBAC: Authorizing `identity:get_user(user_id=91b9e2cb20a343c18f702505f17e23c5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:06.547801 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc64558-68b8-45fb-a794-d15f8310e2ad None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:06.550301 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 114/230] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:06 2022] GET /identity/v3/users/91b9e2cb20a343c18f702505f17e23c5 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:06.560320 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc64558-68b8-45fb-a794-d15f8310e2ad None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:06.562646 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:06.601145 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca830241-d460-42c8-be8c-8569953e30c2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:06.664078 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a38c16-f603-4920-827d-7efeecc469ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:06.665244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a38c16-f603-4920-827d-7efeecc469ff None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:06.665779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a38c16-f603-4920-827d-7efeecc469ff None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:06.666215 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a38c16-f603-4920-827d-7efeecc469ff None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:06.668368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc64558-68b8-45fb-a794-d15f8310e2ad None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:06.670579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a38c16-f603-4920-827d-7efeecc469ff None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:06.672419 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a38c16-f603-4920-827d-7efeecc469ff None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:06.674240 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 117/231] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:06 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:06.680072 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a38c16-f603-4920-827d-7efeecc469ff None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:06.738360 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9db1e1-4c7d-4ad3-86de-c5da2227654b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:06.740690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9db1e1-4c7d-4ad3-86de-c5da2227654b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:06.741798 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9db1e1-4c7d-4ad3-86de-c5da2227654b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:06.742521 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9db1e1-4c7d-4ad3-86de-c5da2227654b None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:06.746129 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9db1e1-4c7d-4ad3-86de-c5da2227654b None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:06.747896 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9db1e1-4c7d-4ad3-86de-c5da2227654b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:06.751015 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 115/232] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:06 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:06.756479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9db1e1-4c7d-4ad3-86de-c5da2227654b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:06.850003 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a38c16-f603-4920-827d-7efeecc469ff None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:06.866757 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:06.885701 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1b5953-3075-4cfa-a7cd-afa1188b2bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:06.886936 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5953-3075-4cfa-a7cd-afa1188b2bba None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:06.887475 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5953-3075-4cfa-a7cd-afa1188b2bba None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:06.887979 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1b5953-3075-4cfa-a7cd-afa1188b2bba None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3/users/91b9e2cb20a343c18f702505f17e23c5/roles/e7e71ae9fccc4607808005a2e261bab1` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:06.890430 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b5953-3075-4cfa-a7cd-afa1188b2bba None admin] RBAC: Authorizing `identity:create_grant(project_id=60e98823de624a7fa1c311b6f19b75a3, user_id=91b9e2cb20a343c18f702505f17e23c5, role_id=e7e71ae9fccc4607808005a2e261bab1)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:06.892142 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1b5953-3075-4cfa-a7cd-afa1188b2bba None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:06.909694 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 118/233] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:58:06 2022] PUT /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3/users/91b9e2cb20a343c18f702505f17e23c5/roles/e7e71ae9fccc4607808005a2e261bab1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:58:06.916602 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c19222-14b0-4bcc-b121-cd363c645602 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:06.917603 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c19222-14b0-4bcc-b121-cd363c645602 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:06.918201 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c19222-14b0-4bcc-b121-cd363c645602 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:06.921302 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 119/234] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:06.926643 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62159e9-3f2a-49bc-aeb2-20b3a4a18d06 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:06.927241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62159e9-3f2a-49bc-aeb2-20b3a4a18d06 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:06.927785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62159e9-3f2a-49bc-aeb2-20b3a4a18d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:06.946398 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9db1e1-4c7d-4ad3-86de-c5da2227654b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:06.952098 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:06.960741 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e62159e9-3f2a-49bc-aeb2-20b3a4a18d06 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:06.962455 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e62159e9-3f2a-49bc-aeb2-20b3a4a18d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:06.993367 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0548751-2fee-497f-90a4-262dfa0acda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:06.994313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0548751-2fee-497f-90a4-262dfa0acda0 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:06.994637 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0548751-2fee-497f-90a4-262dfa0acda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:06.994913 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0548751-2fee-497f-90a4-262dfa0acda0 None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3/users/91b9e2cb20a343c18f702505f17e23c5/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:06.997272 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0548751-2fee-497f-90a4-262dfa0acda0 None admin] RBAC: Authorizing `identity:create_grant(project_id=60e98823de624a7fa1c311b6f19b75a3, user_id=91b9e2cb20a343c18f702505f17e23c5, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:06.998544 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0548751-2fee-497f-90a4-262dfa0acda0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:07.017312 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 116/235] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:58:06 2022] PUT /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3/users/91b9e2cb20a343c18f702505f17e23c5/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:58:07.018910 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5f015-01b8-472e-9d02-8eee39dbd346 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:07.019253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5f015-01b8-472e-9d02-8eee39dbd346 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:07.019575 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5f015-01b8-472e-9d02-8eee39dbd346 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:07.021676 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 117/236] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:07.027796 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15355a-60d1-4695-9edb-e0db2cf6bbb2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:07.028122 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15355a-60d1-4695-9edb-e0db2cf6bbb2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:07.028370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15355a-60d1-4695-9edb-e0db2cf6bbb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:07.052594 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 120/237] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:07.072705 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-db15355a-60d1-4695-9edb-e0db2cf6bbb2 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:07.074013 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-db15355a-60d1-4695-9edb-e0db2cf6bbb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:07.079118 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62159e9-3f2a-49bc-aeb2-20b3a4a18d06 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:07.180874 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 118/238] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:07.192897 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62159e9-3f2a-49bc-aeb2-20b3a4a18d06 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:07.207503 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15355a-60d1-4695-9edb-e0db2cf6bbb2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:07.230242 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46715c7c-139a-48c5-811f-0986088b8569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:07.231546 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46715c7c-139a-48c5-811f-0986088b8569 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:07.232031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46715c7c-139a-48c5-811f-0986088b8569 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:07.232501 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46715c7c-139a-48c5-811f-0986088b8569 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:07.233985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46715c7c-139a-48c5-811f-0986088b8569 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:07.235771 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46715c7c-139a-48c5-811f-0986088b8569 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:07.238108 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 121/239] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:07.243246 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46715c7c-139a-48c5-811f-0986088b8569 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:07.246701 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:07.267703 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:07.318144 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15355a-60d1-4695-9edb-e0db2cf6bbb2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:07.350702 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46715c7c-139a-48c5-811f-0986088b8569 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:07.354742 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecb1fd-b7c6-4b88-8435-9897bd86fc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:07.355598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecb1fd-b7c6-4b88-8435-9897bd86fc0d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:07.355885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecb1fd-b7c6-4b88-8435-9897bd86fc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:07.356161 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecb1fd-b7c6-4b88-8435-9897bd86fc0d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:07.371344 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecb1fd-b7c6-4b88-8435-9897bd86fc0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-e7ecb1fd-b7c6-4b88-8435-9897bd86fc0d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:07.376764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:07.377692 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:07.378496 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:07.378496 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:07.378496 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:07.378496 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:07.378496 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:07.378496 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:07.378496 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:07.378496 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:07.378496 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:07.378496 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:07.378496 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:58:07.378496 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:07.378496 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 119/240] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:58:07.384190 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecb1fd-b7c6-4b88-8435-9897bd86fc0d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:07.421710 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3f9f2-f4dc-435a-8ba1-56836d6f0a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:07.422812 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3f9f2-f4dc-435a-8ba1-56836d6f0a83 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:07.423353 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3f9f2-f4dc-435a-8ba1-56836d6f0a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:07.423877 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3f9f2-f4dc-435a-8ba1-56836d6f0a83 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:07.424852 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3f9f2-f4dc-435a-8ba1-56836d6f0a83 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:07.426569 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b3f9f2-f4dc-435a-8ba1-56836d6f0a83 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:07.475188 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 122/241] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 00:58:07 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:58:07.495265 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecb1fd-b7c6-4b88-8435-9897bd86fc0d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:07.503811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:07.533720 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b270cc-c486-4041-95ba-a167330dd72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:07.534523 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b270cc-c486-4041-95ba-a167330dd72c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:07.534724 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b270cc-c486-4041-95ba-a167330dd72c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:07.534988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b270cc-c486-4041-95ba-a167330dd72c None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:07.535805 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b270cc-c486-4041-95ba-a167330dd72c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:07.536109 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b270cc-c486-4041-95ba-a167330dd72c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:07.537588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b270cc-c486-4041-95ba-a167330dd72c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:07.547621 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 120/242] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:07.553344 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3f9f2-f4dc-435a-8ba1-56836d6f0a83 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:07.619978 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:07.667149 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3f9f2-f4dc-435a-8ba1-56836d6f0a83 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:07.704713 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de8ea55-4a3c-475a-8820-4ac167278655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:07.705616 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8ea55-4a3c-475a-8820-4ac167278655 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:07.705900 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8ea55-4a3c-475a-8820-4ac167278655 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:07.706176 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de8ea55-4a3c-475a-8820-4ac167278655 None admin] PATH_INFO: `/v3/users/ca4131954dbc43ab98c907481eeee487` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:07.720284 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8ea55-4a3c-475a-8820-4ac167278655 None admin] RBAC: Authorizing `identity:get_user(user_id=ca4131954dbc43ab98c907481eeee487)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:07.721777 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de8ea55-4a3c-475a-8820-4ac167278655 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:07.723731 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 123/243] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:07 2022] GET /identity/v3/users/ca4131954dbc43ab98c907481eeee487 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:07.729236 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b270cc-c486-4041-95ba-a167330dd72c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:07.796852 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92dd8c-e4c8-4924-b9d2-24a59550473e None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:07.796852 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92dd8c-e4c8-4924-b9d2-24a59550473e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:07.796852 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92dd8c-e4c8-4924-b9d2-24a59550473e None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:07.797632 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 124/244] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:07.805693 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947284ba-a471-4618-9f7f-984cbeebb247 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:07.805990 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947284ba-a471-4618-9f7f-984cbeebb247 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:07.806272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947284ba-a471-4618-9f7f-984cbeebb247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:07.833592 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-947284ba-a471-4618-9f7f-984cbeebb247 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:07.835000 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-947284ba-a471-4618-9f7f-984cbeebb247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:07.854474 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b270cc-c486-4041-95ba-a167330dd72c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:07.909324 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d6dcb-5bae-437c-a3ca-111c7c31a6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:07.910507 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d6dcb-5bae-437c-a3ca-111c7c31a6cb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:07.911080 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d6dcb-5bae-437c-a3ca-111c7c31a6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:07.911588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d6dcb-5bae-437c-a3ca-111c7c31a6cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:07.916834 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 125/245] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:07.948984 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947284ba-a471-4618-9f7f-984cbeebb247 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:07.951672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:08.006777 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:08.052982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d6dcb-5bae-437c-a3ca-111c7c31a6cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:08.054210 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d6dcb-5bae-437c-a3ca-111c7c31a6cb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:08.173461 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 121/246] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:08.179907 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d6dcb-5bae-437c-a3ca-111c7c31a6cb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:08.202599 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947284ba-a471-4618-9f7f-984cbeebb247 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:08.256062 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:08.260886 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13620cf4-8f8a-4345-b82a-05e6b536a1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:08.262182 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13620cf4-8f8a-4345-b82a-05e6b536a1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:08.262529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13620cf4-8f8a-4345-b82a-05e6b536a1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:08.262812 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13620cf4-8f8a-4345-b82a-05e6b536a1c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:08.274615 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13620cf4-8f8a-4345-b82a-05e6b536a1c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-13620cf4-8f8a-4345-b82a-05e6b536a1c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:08.284464 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:08.285554 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:08.286357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:08.286357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:08.286357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:08.286357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:08.286357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:08.286357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:08.286357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:08.286357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:08.286357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:08.286357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:08.286357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:08.286357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:08.286357 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 126/247] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:08.293564 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13620cf4-8f8a-4345-b82a-05e6b536a1c2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:08.301353 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d6dcb-5bae-437c-a3ca-111c7c31a6cb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:08.352555 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f81fe-e9e6-49bc-acc9-47cc252e81e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:08.353866 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f81fe-e9e6-49bc-acc9-47cc252e81e8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:08.354356 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f81fe-e9e6-49bc-acc9-47cc252e81e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:08.354858 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773f81fe-e9e6-49bc-acc9-47cc252e81e8 None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:08.356722 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f81fe-e9e6-49bc-acc9-47cc252e81e8 None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:08.358602 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773f81fe-e9e6-49bc-acc9-47cc252e81e8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:08.373205 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 122/248] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:08 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:08.381681 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f81fe-e9e6-49bc-acc9-47cc252e81e8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:08.502591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13620cf4-8f8a-4345-b82a-05e6b536a1c2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:08.520308 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:08.593489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdcfbd-01d3-45b1-8769-87b3b1603c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:08.594205 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdcfbd-01d3-45b1-8769-87b3b1603c24 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:08.594493 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdcfbd-01d3-45b1-8769-87b3b1603c24 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:08.594776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacdcfbd-01d3-45b1-8769-87b3b1603c24 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:08.599327 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdcfbd-01d3-45b1-8769-87b3b1603c24 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:08.599327 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdcfbd-01d3-45b1-8769-87b3b1603c24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:08.599327 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacdcfbd-01d3-45b1-8769-87b3b1603c24 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:08.614588 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 127/249] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:08.620244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdcfbd-01d3-45b1-8769-87b3b1603c24 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:08.654968 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773f81fe-e9e6-49bc-acc9-47cc252e81e8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:08.739803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:08.752577 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b69558-6cdb-4e2b-a16a-d3599f278b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:08.753576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b69558-6cdb-4e2b-a16a-d3599f278b5a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:08.754064 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b69558-6cdb-4e2b-a16a-d3599f278b5a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:08.754563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b69558-6cdb-4e2b-a16a-d3599f278b5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:08.755708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b69558-6cdb-4e2b-a16a-d3599f278b5a None admin] RBAC: Adding query filter params (role.id=ac3cef1fcb1744de989fa7f25e7de7b4, scope.project.id=60e98823de624a7fa1c311b6f19b75a3, user.id=ca4131954dbc43ab98c907481eeee487) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:08.756228 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b69558-6cdb-4e2b-a16a-d3599f278b5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:08.757911 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b69558-6cdb-4e2b-a16a-d3599f278b5a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:08.773702 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 123/250] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:08 2022] GET /identity/v3/role_assignments?user.id=ca4131954dbc43ab98c907481eeee487&scope.project.id=60e98823de624a7fa1c311b6f19b75a3&role.id=ac3cef1fcb1744de989fa7f25e7de7b4 => generated 259 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:08.822087 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacdcfbd-01d3-45b1-8769-87b3b1603c24 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:08.870768 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6722-9ec1-4b0e-8830-acf59a63d086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:08.871764 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6722-9ec1-4b0e-8830-acf59a63d086 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:08.872095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6722-9ec1-4b0e-8830-acf59a63d086 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:08.872371 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa6722-9ec1-4b0e-8830-acf59a63d086 None admin] PATH_INFO: `/v3/users/65a06df50e5247309ac62286cc4baa6c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:08.875026 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa6722-9ec1-4b0e-8830-acf59a63d086 None admin] RBAC: Authorizing `identity:get_user(user_id=65a06df50e5247309ac62286cc4baa6c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:08.876577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa6722-9ec1-4b0e-8830-acf59a63d086 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:08.878375 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 128/251] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:08 2022] GET /identity/v3/users/65a06df50e5247309ac62286cc4baa6c => generated 297 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:08.884250 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b69558-6cdb-4e2b-a16a-d3599f278b5a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:09.004190 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b69558-6cdb-4e2b-a16a-d3599f278b5a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:09.042968 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4379f5-fda0-4b0b-90e5-7c2b4fb0853e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:09.043826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4379f5-fda0-4b0b-90e5-7c2b4fb0853e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:09.044213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4379f5-fda0-4b0b-90e5-7c2b4fb0853e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:09.044512 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4379f5-fda0-4b0b-90e5-7c2b4fb0853e None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:09.045741 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4379f5-fda0-4b0b-90e5-7c2b4fb0853e None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:09.047268 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4379f5-fda0-4b0b-90e5-7c2b4fb0853e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:09.049337 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 124/252] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:08 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:09.054935 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6722-9ec1-4b0e-8830-acf59a63d086 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:09.106948 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:09.191121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa6722-9ec1-4b0e-8830-acf59a63d086 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:09.234662 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6eca98-0309-4401-ac82-58e70dc6230f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:09.235605 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eca98-0309-4401-ac82-58e70dc6230f None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:09.235886 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eca98-0309-4401-ac82-58e70dc6230f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:09.236164 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6eca98-0309-4401-ac82-58e70dc6230f None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3/users/65a06df50e5247309ac62286cc4baa6c/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:09.238117 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6eca98-0309-4401-ac82-58e70dc6230f None admin] RBAC: Authorizing `identity:create_grant(project_id=60e98823de624a7fa1c311b6f19b75a3, user_id=65a06df50e5247309ac62286cc4baa6c, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:09.239610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6eca98-0309-4401-ac82-58e70dc6230f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:09.266032 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 129/253] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:58:09 2022] PUT /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3/users/65a06df50e5247309ac62286cc4baa6c/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:58:09.562700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5cce6-e127-4446-ae01-7ebd8991f690 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:09.563078 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5cce6-e127-4446-ae01-7ebd8991f690 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:09.563271 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5cce6-e127-4446-ae01-7ebd8991f690 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:09.564939 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 125/254] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:09.578050 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0d5fa-91a0-429e-ba30-ebc1b86391e9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:09.578329 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0d5fa-91a0-429e-ba30-ebc1b86391e9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:09.578595 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0d5fa-91a0-429e-ba30-ebc1b86391e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:09.600471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4fe0d5fa-91a0-429e-ba30-ebc1b86391e9 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:09.601691 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4fe0d5fa-91a0-429e-ba30-ebc1b86391e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:09.682524 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 130/255] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:09.721174 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5cce6-e127-4446-ae01-7ebd8991f690 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:09.799880 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:09.852647 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5cce6-e127-4446-ae01-7ebd8991f690 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:09.896000 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682c412-4fbb-4f0c-8dc2-d0a8ec87758d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:09.896835 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682c412-4fbb-4f0c-8dc2-d0a8ec87758d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:09.897112 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682c412-4fbb-4f0c-8dc2-d0a8ec87758d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:09.897387 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682c412-4fbb-4f0c-8dc2-d0a8ec87758d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:09.909474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513f998-226d-41ed-9ac9-078801612f19 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:09.909761 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513f998-226d-41ed-9ac9-078801612f19 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:09.910046 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513f998-226d-41ed-9ac9-078801612f19 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:09.911852 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 131/256] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:09.912690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682c412-4fbb-4f0c-8dc2-d0a8ec87758d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:09.917417 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db287d-db8d-46d3-9c37-9d10d28f6229 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:09.917712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db287d-db8d-46d3-9c37-9d10d28f6229 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:09.917994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db287d-db8d-46d3-9c37-9d10d28f6229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-4682c412-4fbb-4f0c-8dc2-d0a8ec87758d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:09.921838 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:09.922715 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:09.923944 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:09.923944 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:09.923944 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:09.923944 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:09.923944 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:09.923944 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:09.923944 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:09.923944 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:09.923944 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:09.923944 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:09.923944 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:09.923944 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:09.923944 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 126/257] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:58:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:09.930870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682c412-4fbb-4f0c-8dc2-d0a8ec87758d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:09.941090 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-79db287d-db8d-46d3-9c37-9d10d28f6229 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:09.942909 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-79db287d-db8d-46d3-9c37-9d10d28f6229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:09.978924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:10.056661 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682c412-4fbb-4f0c-8dc2-d0a8ec87758d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:10.074121 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 132/258] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:58:10.091663 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:10.105670 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023502d-ff7f-4c22-85e9-cc5c4dc9a1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:10.106571 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023502d-ff7f-4c22-85e9-cc5c4dc9a1dd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:10.107002 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023502d-ff7f-4c22-85e9-cc5c4dc9a1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:10.107489 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4023502d-ff7f-4c22-85e9-cc5c4dc9a1dd None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:10.108396 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023502d-ff7f-4c22-85e9-cc5c4dc9a1dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:10.108853 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023502d-ff7f-4c22-85e9-cc5c4dc9a1dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:10.110429 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4023502d-ff7f-4c22-85e9-cc5c4dc9a1dd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:10.120298 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 127/259] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:10.125607 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023502d-ff7f-4c22-85e9-cc5c4dc9a1dd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:10.125727 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db287d-db8d-46d3-9c37-9d10d28f6229 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:10.231466 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4023502d-ff7f-4c22-85e9-cc5c4dc9a1dd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:10.284938 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18277c1-d41f-4d97-8a36-b9714b4cc27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:10.286311 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18277c1-d41f-4d97-8a36-b9714b4cc27d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:10.286817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18277c1-d41f-4d97-8a36-b9714b4cc27d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:10.287315 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18277c1-d41f-4d97-8a36-b9714b4cc27d None admin] PATH_INFO: `/v3/users/91b9e2cb20a343c18f702505f17e23c5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:10.288743 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18277c1-d41f-4d97-8a36-b9714b4cc27d None admin] RBAC: Authorizing `identity:get_user(user_id=91b9e2cb20a343c18f702505f17e23c5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:10.290449 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18277c1-d41f-4d97-8a36-b9714b4cc27d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:10.296543 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 128/260] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:10 2022] GET /identity/v3/users/91b9e2cb20a343c18f702505f17e23c5 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:10.302119 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18277c1-d41f-4d97-8a36-b9714b4cc27d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:10.361271 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db287d-db8d-46d3-9c37-9d10d28f6229 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:10.437132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:10.450362 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f315ba-26cb-40c4-984f-c4b2dd5f448b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:10.451184 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f315ba-26cb-40c4-984f-c4b2dd5f448b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:10.451491 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f315ba-26cb-40c4-984f-c4b2dd5f448b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:10.451768 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f315ba-26cb-40c4-984f-c4b2dd5f448b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:10.477957 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f315ba-26cb-40c4-984f-c4b2dd5f448b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d4f315ba-26cb-40c4-984f-c4b2dd5f448b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:10.485720 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:10.486707 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:10.487563 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:10.487563 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:10.487563 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:10.487563 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:10.487563 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:10.487563 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:10.487563 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:10.487563 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:10.487563 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:10.487563 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:10.487563 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:58:10.487563 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:10.487563 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 133/261] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:58:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:10.499996 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f315ba-26cb-40c4-984f-c4b2dd5f448b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:10.535692 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18277c1-d41f-4d97-8a36-b9714b4cc27d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:10.540311 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:10.601162 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfbd69-fca0-4602-b136-b010e264beba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:10.601823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfbd69-fca0-4602-b136-b010e264beba None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:10.602102 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfbd69-fca0-4602-b136-b010e264beba None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:10.602375 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfbd69-fca0-4602-b136-b010e264beba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:10.683619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfbd69-fca0-4602-b136-b010e264beba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:10.685315 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfbd69-fca0-4602-b136-b010e264beba None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:10.707068 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f315ba-26cb-40c4-984f-c4b2dd5f448b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:10.787657 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:10.792171 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c603d-9333-4407-87c5-1e99db997ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:10.792881 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c603d-9333-4407-87c5-1e99db997ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:10.793170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c603d-9333-4407-87c5-1e99db997ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:10.793447 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c603d-9333-4407-87c5-1e99db997ac1 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:10.794214 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c603d-9333-4407-87c5-1e99db997ac1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:10.797238 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c603d-9333-4407-87c5-1e99db997ac1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:10.798695 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c603d-9333-4407-87c5-1e99db997ac1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:10.821692 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 134/262] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:10.828423 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbb453-be2d-484f-8004-7b367c688e55 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:10.828717 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbb453-be2d-484f-8004-7b367c688e55 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:10.828997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbb453-be2d-484f-8004-7b367c688e55 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:10.831649 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 135/263] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:58:10.832396 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbb453-be2d-484f-8004-7b367c688e55 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:10.865315 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 129/264] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:58:10.866633 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9a9f6-0337-4c68-99bc-fa997dfda83c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:10.866918 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9a9f6-0337-4c68-99bc-fa997dfda83c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:10.867192 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e9a9f6-0337-4c68-99bc-fa997dfda83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:10.892385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d9e9a9f6-0337-4c68-99bc-fa997dfda83c None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:10.893598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d9e9a9f6-0337-4c68-99bc-fa997dfda83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:10.945154 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:10.970242 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbb453-be2d-484f-8004-7b367c688e55 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:11.004525 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2293e4-6f99-44be-9cac-49f4ea747c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:11.005524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2293e4-6f99-44be-9cac-49f4ea747c29 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:11.005809 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2293e4-6f99-44be-9cac-49f4ea747c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:11.006083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2293e4-6f99-44be-9cac-49f4ea747c29 None admin] PATH_INFO: `/v3/users/91b9e2cb20a343c18f702505f17e23c5` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:11.007280 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2293e4-6f99-44be-9cac-49f4ea747c29 None admin] RBAC: Authorizing `identity:get_user(user_id=91b9e2cb20a343c18f702505f17e23c5)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:11.008912 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2293e4-6f99-44be-9cac-49f4ea747c29 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:11.010621 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 136/265] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:10 2022] GET /identity/v3/users/91b9e2cb20a343c18f702505f17e23c5 => generated 283 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:11.011404 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2293e4-6f99-44be-9cac-49f4ea747c29 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:11.068982 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 130/266] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:11.070223 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9a9f6-0337-4c68-99bc-fa997dfda83c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:11.113513 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2293e4-6f99-44be-9cac-49f4ea747c29 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:11.170704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402baeb4-5a7a-432d-9e2b-610aca605feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:11.171617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402baeb4-5a7a-432d-9e2b-610aca605feb None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:11.171896 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402baeb4-5a7a-432d-9e2b-610aca605feb None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:11.172166 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402baeb4-5a7a-432d-9e2b-610aca605feb None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:11.177042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402baeb4-5a7a-432d-9e2b-610aca605feb None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:11.178525 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402baeb4-5a7a-432d-9e2b-610aca605feb None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:11.182163 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 137/267] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:11 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:11.182762 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402baeb4-5a7a-432d-9e2b-610aca605feb None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:11.224520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:11.237535 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:11.266834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e9a9f6-0337-4c68-99bc-fa997dfda83c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:11.310345 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d568eb-0918-478a-853f-08f7d2104eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:11.311011 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d568eb-0918-478a-853f-08f7d2104eeb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:11.311323 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d568eb-0918-478a-853f-08f7d2104eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:11.311596 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d568eb-0918-478a-853f-08f7d2104eeb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:11.339485 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402baeb4-5a7a-432d-9e2b-610aca605feb None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:11.374198 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259a47c-0836-4bfa-aa62-796ebe14cc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:11.375009 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259a47c-0836-4bfa-aa62-796ebe14cc85 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:11.375287 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259a47c-0836-4bfa-aa62-796ebe14cc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:11.375637 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259a47c-0836-4bfa-aa62-796ebe14cc85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:11.385914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259a47c-0836-4bfa-aa62-796ebe14cc85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:11.393507 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d568eb-0918-478a-853f-08f7d2104eeb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-3259a47c-0836-4bfa-aa62-796ebe14cc85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:11.393713 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:11.394557 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:11.395388 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:11.395388 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:11.395388 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:11.395388 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:11.395388 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:11.395388 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:11.395388 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:11.395388 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:11.395388 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:11.395388 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:11.395388 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:11.395388 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:11.395988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d568eb-0918-478a-853f-08f7d2104eeb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:11.396055 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 138/268] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:11.396127 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259a47c-0836-4bfa-aa62-796ebe14cc85 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:11.486703 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:11.498724 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:11.517540 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 131/269] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:11.518196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259a47c-0836-4bfa-aa62-796ebe14cc85 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:11.519431 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8db5b4-52d5-47bd-b59a-5e6e747e33f5 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:11.519861 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8db5b4-52d5-47bd-b59a-5e6e747e33f5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:11.520275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8db5b4-52d5-47bd-b59a-5e6e747e33f5 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:11.521748 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 132/270] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:11.522772 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8db5b4-52d5-47bd-b59a-5e6e747e33f5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:11.556494 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae666369-9997-4c58-9839-5001c226d6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:11.557289 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae666369-9997-4c58-9839-5001c226d6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:11.557576 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae666369-9997-4c58-9839-5001c226d6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:11.557856 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae666369-9997-4c58-9839-5001c226d6f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:11.558933 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae666369-9997-4c58-9839-5001c226d6f5 None admin] RBAC: Adding query filter params (role.id=e7e71ae9fccc4607808005a2e261bab1, scope.project.id=60e98823de624a7fa1c311b6f19b75a3, user.id=91b9e2cb20a343c18f702505f17e23c5) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:11.559248 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae666369-9997-4c58-9839-5001c226d6f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:11.561550 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae666369-9997-4c58-9839-5001c226d6f5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:11.569004 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 139/271] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:11 2022] GET /identity/v3/role_assignments?user.id=91b9e2cb20a343c18f702505f17e23c5&scope.project.id=60e98823de624a7fa1c311b6f19b75a3&role.id=e7e71ae9fccc4607808005a2e261bab1 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:11.575605 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae666369-9997-4c58-9839-5001c226d6f5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:11.691893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae666369-9997-4c58-9839-5001c226d6f5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:11.732273 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ad2ef-f4f0-4083-8711-fedccb5607d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:11.733159 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ad2ef-f4f0-4083-8711-fedccb5607d1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:11.733439 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ad2ef-f4f0-4083-8711-fedccb5607d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:11.733663 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8db5b4-52d5-47bd-b59a-5e6e747e33f5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:11.733764 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ad2ef-f4f0-4083-8711-fedccb5607d1 None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:11.734900 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ad2ef-f4f0-4083-8711-fedccb5607d1 None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:11.738770 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ad2ef-f4f0-4083-8711-fedccb5607d1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:11.738770 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 140/272] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:11 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:11.739687 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01b4b8-2327-47ae-b349-7502b5899bb1 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:11.739973 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01b4b8-2327-47ae-b349-7502b5899bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:11.740253 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01b4b8-2327-47ae-b349-7502b5899bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:11.762960 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:11.778606 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4f01b4b8-2327-47ae-b349-7502b5899bb1 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:11.779859 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4f01b4b8-2327-47ae-b349-7502b5899bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:11.828564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbf413-01bf-475a-98c4-ab74cf7f613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:11.829264 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbf413-01bf-475a-98c4-ab74cf7f613b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:11.829544 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbf413-01bf-475a-98c4-ab74cf7f613b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:11.829818 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dbf413-01bf-475a-98c4-ab74cf7f613b None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:11.830577 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbf413-01bf-475a-98c4-ab74cf7f613b None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:11.830881 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbf413-01bf-475a-98c4-ab74cf7f613b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:11.832314 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dbf413-01bf-475a-98c4-ab74cf7f613b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:11.841470 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 133/273] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:11.842065 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbf413-01bf-475a-98c4-ab74cf7f613b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:11.856964 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 141/274] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:11.857842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01b4b8-2327-47ae-b349-7502b5899bb1 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:11.895259 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:11.955091 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dbf413-01bf-475a-98c4-ab74cf7f613b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:11.963900 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01b4b8-2327-47ae-b349-7502b5899bb1 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:11.994084 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b34f1-2c78-4d04-8a69-e8aaff8aee7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:11.994596 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b34f1-2c78-4d04-8a69-e8aaff8aee7c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:11.994879 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b34f1-2c78-4d04-8a69-e8aaff8aee7c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:11.995152 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836b34f1-2c78-4d04-8a69-e8aaff8aee7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:11.996289 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b34f1-2c78-4d04-8a69-e8aaff8aee7c None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=60e98823de624a7fa1c311b6f19b75a3, user.id=91b9e2cb20a343c18f702505f17e23c5) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:11.996601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b34f1-2c78-4d04-8a69-e8aaff8aee7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:11.998401 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836b34f1-2c78-4d04-8a69-e8aaff8aee7c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:12.005064 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 134/275] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:11 2022] GET /identity/v3/role_assignments?user.id=91b9e2cb20a343c18f702505f17e23c5&scope.project.id=60e98823de624a7fa1c311b6f19b75a3&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:12.005868 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b34f1-2c78-4d04-8a69-e8aaff8aee7c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:12.007522 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec899da7-80b0-46bd-b889-9d47ffd81fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:12.008939 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec899da7-80b0-46bd-b889-9d47ffd81fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.009467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec899da7-80b0-46bd-b889-9d47ffd81fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.009933 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec899da7-80b0-46bd-b889-9d47ffd81fa6 None admin] PATH_INFO: `/v3/users/9708963ca39d4545a1fae63df1a7b3d0` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.014096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:12.036904 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec899da7-80b0-46bd-b889-9d47ffd81fa6 None admin] RBAC: Authorizing `identity:get_user(user_id=9708963ca39d4545a1fae63df1a7b3d0)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:12.039195 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec899da7-80b0-46bd-b889-9d47ffd81fa6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:12.041681 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 142/276] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:11 2022] GET /identity/v3/users/9708963ca39d4545a1fae63df1a7b3d0 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:12.044804 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d70e88-a626-402b-a02e-87c006ef729e None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.045305 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d70e88-a626-402b-a02e-87c006ef729e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.045784 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d70e88-a626-402b-a02e-87c006ef729e None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.047708 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 143/277] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:12.055694 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5d3fb-7e16-41fb-b4cd-af38ff34823e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.056246 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5d3fb-7e16-41fb-b4cd-af38ff34823e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.056686 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a5d3fb-7e16-41fb-b4cd-af38ff34823e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.075598 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a4a5d3fb-7e16-41fb-b4cd-af38ff34823e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:12.077228 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a4a5d3fb-7e16-41fb-b4cd-af38ff34823e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:12.144847 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836b34f1-2c78-4d04-8a69-e8aaff8aee7c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:12.154229 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 144/278] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:12.156123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5d3fb-7e16-41fb-b4cd-af38ff34823e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:12.160161 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:12.186223 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16596c-d8bd-43de-a4e6-425b2b98a3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:12.187039 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16596c-d8bd-43de-a4e6-425b2b98a3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.187347 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16596c-d8bd-43de-a4e6-425b2b98a3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.187626 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16596c-d8bd-43de-a4e6-425b2b98a3a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.188819 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16596c-d8bd-43de-a4e6-425b2b98a3a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:12.190303 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16596c-d8bd-43de-a4e6-425b2b98a3a1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:12.192114 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 135/279] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:12.193214 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ff4bd-c4e5-4f5f-8474-074d4ac82af0 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.193507 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ff4bd-c4e5-4f5f-8474-074d4ac82af0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.193784 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ff4bd-c4e5-4f5f-8474-074d4ac82af0 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.195462 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 136/280] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:12.196210 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ff4bd-c4e5-4f5f-8474-074d4ac82af0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:12.274408 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a5d3fb-7e16-41fb-b4cd-af38ff34823e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:12.297111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:12.305833 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ff4bd-c4e5-4f5f-8474-074d4ac82af0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:12.307870 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a40d4-f551-4389-9028-00bde983593b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:12.308533 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a40d4-f551-4389-9028-00bde983593b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.308811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a40d4-f551-4389-9028-00bde983593b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.309085 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a40d4-f551-4389-9028-00bde983593b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.309923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a40d4-f551-4389-9028-00bde983593b None admin] RBAC: Adding query filter params (role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9, user.id=9708963ca39d4545a1fae63df1a7b3d0, scope.system=all) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:12.310233 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a40d4-f551-4389-9028-00bde983593b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:12.311711 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a40d4-f551-4389-9028-00bde983593b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:12.316751 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 145/281] 10.222.0.42 () {56 vars in 1308 bytes} [Sun Jul 24 00:58:12 2022] GET /identity/v3/role_assignments?user.id=9708963ca39d4545a1fae63df1a7b3d0&scope.system=all&role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:12.317319 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a40d4-f551-4389-9028-00bde983593b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:12.347593 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109fa0a2-c431-4868-b312-e57919f5b6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:12.348515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fa0a2-c431-4868-b312-e57919f5b6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.348708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fa0a2-c431-4868-b312-e57919f5b6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.348982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109fa0a2-c431-4868-b312-e57919f5b6e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.361629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109fa0a2-c431-4868-b312-e57919f5b6e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-109fa0a2-c431-4868-b312-e57919f5b6e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:12.369910 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:12.370890 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:12.372269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:12.372269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:12.372269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:12.372269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:12.372269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:12.372269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:12.372269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:12.372269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:12.372269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:12.372269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:12.372269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:58:12.372269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:12.372269 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 137/282] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:12.372920 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ef07e-152c-4760-806f-319bcd183e7b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.372920 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ef07e-152c-4760-806f-319bcd183e7b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.373037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51ef07e-152c-4760-806f-319bcd183e7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.391101 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b51ef07e-152c-4760-806f-319bcd183e7b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:12.392504 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b51ef07e-152c-4760-806f-319bcd183e7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:12.425414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:12.437031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a40d4-f551-4389-9028-00bde983593b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:12.469821 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 138/283] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:12.470688 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ef07e-152c-4760-806f-319bcd183e7b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:12.485137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e9373-a078-4a8d-bb7d-299d1da2b939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:12.486132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e9373-a078-4a8d-bb7d-299d1da2b939 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.486555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e9373-a078-4a8d-bb7d-299d1da2b939 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.487165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e9373-a078-4a8d-bb7d-299d1da2b939 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.488093 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e9373-a078-4a8d-bb7d-299d1da2b939 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:12.489746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e9373-a078-4a8d-bb7d-299d1da2b939 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:12.513327 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 146/284] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 00:58:12 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:58:12.523529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e9373-a078-4a8d-bb7d-299d1da2b939 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:12.578586 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:12.615419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51ef07e-152c-4760-806f-319bcd183e7b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:12.645623 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e9373-a078-4a8d-bb7d-299d1da2b939 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:12.662937 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a9e04-e79d-4952-bedd-74ce92644bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:12.663851 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a9e04-e79d-4952-bedd-74ce92644bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.664227 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a9e04-e79d-4952-bedd-74ce92644bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.664597 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a9e04-e79d-4952-bedd-74ce92644bc9 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.665655 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a9e04-e79d-4952-bedd-74ce92644bc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:12.666433 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a9e04-e79d-4952-bedd-74ce92644bc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:12.668035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a9e04-e79d-4952-bedd-74ce92644bc9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:12.681956 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 139/285] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:12.686131 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a9e04-e79d-4952-bedd-74ce92644bc9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:12.687112 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a477fa-0250-4801-b90f-eb056e0e3517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:12.687971 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a477fa-0250-4801-b90f-eb056e0e3517 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.688252 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a477fa-0250-4801-b90f-eb056e0e3517 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.688521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a477fa-0250-4801-b90f-eb056e0e3517 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.702215 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a477fa-0250-4801-b90f-eb056e0e3517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-32a477fa-0250-4801-b90f-eb056e0e3517 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:12.709965 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:12.710871 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:12.712462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:12.712462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:12.712462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:12.712462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:12.712462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:12.712462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:12.712462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:12.712462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:12.712462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:12.712462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:12.712462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:12.712462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:12.712462 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 147/286] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:12.717705 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a477fa-0250-4801-b90f-eb056e0e3517 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:12.735560 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:12.827616 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a9e04-e79d-4952-bedd-74ce92644bc9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:12.857781 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a477fa-0250-4801-b90f-eb056e0e3517 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:12.860773 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:12.873910 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fcaff-ce14-4cbf-9594-f53d48ed6ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:12.874813 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fcaff-ce14-4cbf-9594-f53d48ed6ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.875096 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fcaff-ce14-4cbf-9594-f53d48ed6ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.875423 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8fcaff-ce14-4cbf-9594-f53d48ed6ed7 None admin] PATH_INFO: `/v3/users/ca4131954dbc43ab98c907481eeee487` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.877797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fcaff-ce14-4cbf-9594-f53d48ed6ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=ca4131954dbc43ab98c907481eeee487)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:12.879277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8fcaff-ce14-4cbf-9594-f53d48ed6ed7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:12.880977 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 140/287] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:12 2022] GET /identity/v3/users/ca4131954dbc43ab98c907481eeee487 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:12.887312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fcaff-ce14-4cbf-9594-f53d48ed6ed7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:12.903921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c9964-5cae-44a9-956b-c94e31d528c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:12.904847 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c9964-5cae-44a9-956b-c94e31d528c1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:12.905294 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c9964-5cae-44a9-956b-c94e31d528c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:12.906022 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c9964-5cae-44a9-956b-c94e31d528c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:12.906790 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c9964-5cae-44a9-956b-c94e31d528c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:12.907099 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c9964-5cae-44a9-956b-c94e31d528c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:12.908662 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c9964-5cae-44a9-956b-c94e31d528c1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:12.922993 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 148/288] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:12.924154 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c9964-5cae-44a9-956b-c94e31d528c1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:13.037231 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:13.039253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8fcaff-ce14-4cbf-9594-f53d48ed6ed7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:13.083513 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c9964-5cae-44a9-956b-c94e31d528c1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:13.103785 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67e206-1c03-4ad0-b65e-c4a3e1ddbfad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:13.104678 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67e206-1c03-4ad0-b65e-c4a3e1ddbfad None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:13.104962 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67e206-1c03-4ad0-b65e-c4a3e1ddbfad None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:13.105242 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67e206-1c03-4ad0-b65e-c4a3e1ddbfad None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:13.107205 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67e206-1c03-4ad0-b65e-c4a3e1ddbfad None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:13.108759 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67e206-1c03-4ad0-b65e-c4a3e1ddbfad None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:13.110732 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 141/289] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:12 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:13.116586 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67e206-1c03-4ad0-b65e-c4a3e1ddbfad None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:13.143958 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4b56d-1a3a-41a7-b6bd-6fc29136b68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:13.144862 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4b56d-1a3a-41a7-b6bd-6fc29136b68a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:13.145948 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4b56d-1a3a-41a7-b6bd-6fc29136b68a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:13.146283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad4b56d-1a3a-41a7-b6bd-6fc29136b68a None admin] PATH_INFO: `/v3/users/65a06df50e5247309ac62286cc4baa6c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:13.148182 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4b56d-1a3a-41a7-b6bd-6fc29136b68a None admin] RBAC: Authorizing `identity:get_user(user_id=65a06df50e5247309ac62286cc4baa6c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:13.149658 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad4b56d-1a3a-41a7-b6bd-6fc29136b68a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:13.151552 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 149/290] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:12 2022] GET /identity/v3/users/65a06df50e5247309ac62286cc4baa6c => generated 297 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:13.157484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4b56d-1a3a-41a7-b6bd-6fc29136b68a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:13.225572 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:13.271794 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67e206-1c03-4ad0-b65e-c4a3e1ddbfad None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:13.325734 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb651fb5-e19f-43fb-9947-1d7bc88731f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:13.327985 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb651fb5-e19f-43fb-9947-1d7bc88731f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:13.327985 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb651fb5-e19f-43fb-9947-1d7bc88731f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:13.327985 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb651fb5-e19f-43fb-9947-1d7bc88731f4 None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3/users/ca4131954dbc43ab98c907481eeee487/roles/ac3cef1fcb1744de989fa7f25e7de7b4` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:13.333306 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb651fb5-e19f-43fb-9947-1d7bc88731f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=60e98823de624a7fa1c311b6f19b75a3, user_id=ca4131954dbc43ab98c907481eeee487, role_id=ac3cef1fcb1744de989fa7f25e7de7b4)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:13.335669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb651fb5-e19f-43fb-9947-1d7bc88731f4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:13.344165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad4b56d-1a3a-41a7-b6bd-6fc29136b68a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:13.371794 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 142/291] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:58:13 2022] PUT /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3/users/ca4131954dbc43ab98c907481eeee487/roles/ac3cef1fcb1744de989fa7f25e7de7b4 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:58:13.390826 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5da057-9fbb-4bfe-9f8b-c7e88d97579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:13.391539 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5da057-9fbb-4bfe-9f8b-c7e88d97579d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:13.391822 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5da057-9fbb-4bfe-9f8b-c7e88d97579d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:13.392101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5da057-9fbb-4bfe-9f8b-c7e88d97579d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:13.465405 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5da057-9fbb-4bfe-9f8b-c7e88d97579d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:13.466917 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5da057-9fbb-4bfe-9f8b-c7e88d97579d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:13.502512 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:13.575102 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 150/292] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:13.581097 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb651fb5-e19f-43fb-9947-1d7bc88731f4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:13.619089 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:13.687404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb651fb5-e19f-43fb-9947-1d7bc88731f4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:13.721021 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b80fe-9e81-4a5f-b2a6-9332aa28e9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:13.721902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b80fe-9e81-4a5f-b2a6-9332aa28e9af None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:13.722183 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b80fe-9e81-4a5f-b2a6-9332aa28e9af None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:13.722457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b80fe-9e81-4a5f-b2a6-9332aa28e9af None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:13.723669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b80fe-9e81-4a5f-b2a6-9332aa28e9af None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:13.725143 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b80fe-9e81-4a5f-b2a6-9332aa28e9af None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:13.726836 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 143/293] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:13 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:13.733112 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5da057-9fbb-4bfe-9f8b-c7e88d97579d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:13.832320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5da057-9fbb-4bfe-9f8b-c7e88d97579d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:13.865226 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acb8f5-3ce4-44b8-8162-e2180d9a811c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:13.865890 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acb8f5-3ce4-44b8-8162-e2180d9a811c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:13.866170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acb8f5-3ce4-44b8-8162-e2180d9a811c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:13.866440 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acb8f5-3ce4-44b8-8162-e2180d9a811c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:13.867267 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acb8f5-3ce4-44b8-8162-e2180d9a811c None admin] RBAC: Adding query filter params (role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9, scope.project.id=60e98823de624a7fa1c311b6f19b75a3, user.id=65a06df50e5247309ac62286cc4baa6c) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:13.867602 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acb8f5-3ce4-44b8-8162-e2180d9a811c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:13.869101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acb8f5-3ce4-44b8-8162-e2180d9a811c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:13.870970 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:13.879725 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 151/294] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:13 2022] GET /identity/v3/role_assignments?user.id=65a06df50e5247309ac62286cc4baa6c&scope.project.id=60e98823de624a7fa1c311b6f19b75a3&role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:14.589891 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f9d1e-96da-4ad8-af47-b60fd5a19c90 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:14.590410 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f9d1e-96da-4ad8-af47-b60fd5a19c90 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:14.590510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f9d1e-96da-4ad8-af47-b60fd5a19c90 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:14.592112 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 144/295] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:14.597934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063eac44-a45a-40de-aca8-00712d5ab96b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:14.598352 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063eac44-a45a-40de-aca8-00712d5ab96b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:14.598522 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063eac44-a45a-40de-aca8-00712d5ab96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:14.615741 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-063eac44-a45a-40de-aca8-00712d5ab96b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:14.616988 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-063eac44-a45a-40de-aca8-00712d5ab96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:14.684119 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 152/296] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:14.707416 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f9d1e-96da-4ad8-af47-b60fd5a19c90 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:14.806336 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:14.814275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f9d1e-96da-4ad8-af47-b60fd5a19c90 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:14.849362 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d6193-ac68-4435-870c-f1fab62b63ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:14.850100 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d6193-ac68-4435-870c-f1fab62b63ca None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:14.850380 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d6193-ac68-4435-870c-f1fab62b63ca None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:14.850653 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d6193-ac68-4435-870c-f1fab62b63ca None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:14.861530 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d6193-ac68-4435-870c-f1fab62b63ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-270d6193-ac68-4435-870c-f1fab62b63ca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:14.869572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:14.870473 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:14.871582 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:14.871582 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:14.871582 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:14.871582 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:14.871582 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:14.871582 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:14.871582 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:14.871582 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:14.871582 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:14.871582 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:14.871582 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:14.871582 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:14.871582 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 145/297] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:14.876852 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063eac44-a45a-40de-aca8-00712d5ab96b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:14.932121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b568e4-6043-44a6-bb23-090196ed5465 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:14.932439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b568e4-6043-44a6-bb23-090196ed5465 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:14.932674 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b568e4-6043-44a6-bb23-090196ed5465 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:14.934305 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 146/298] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:14.939365 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfaf6d-2643-42c2-8420-14d87eeab958 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:14.939649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfaf6d-2643-42c2-8420-14d87eeab958 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:14.939925 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bfaf6d-2643-42c2-8420-14d87eeab958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:14.957272 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a5bfaf6d-2643-42c2-8420-14d87eeab958 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:14.958455 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a5bfaf6d-2643-42c2-8420-14d87eeab958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:14.987336 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063eac44-a45a-40de-aca8-00712d5ab96b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:15.023431 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:15.034634 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1743d7c-b0b7-4592-9628-7db160d46047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:15.034889 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 147/299] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:58:15.035328 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1743d7c-b0b7-4592-9628-7db160d46047 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:15.035615 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1743d7c-b0b7-4592-9628-7db160d46047 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:15.035889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1743d7c-b0b7-4592-9628-7db160d46047 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:15.036642 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1743d7c-b0b7-4592-9628-7db160d46047 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:15.036946 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1743d7c-b0b7-4592-9628-7db160d46047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:15.038329 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1743d7c-b0b7-4592-9628-7db160d46047 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:15.047268 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 153/300] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:15.052527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfaf6d-2643-42c2-8420-14d87eeab958 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:15.064537 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1743d7c-b0b7-4592-9628-7db160d46047 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:15.148800 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:15.166284 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bfaf6d-2643-42c2-8420-14d87eeab958 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:15.175164 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1743d7c-b0b7-4592-9628-7db160d46047 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:15.203401 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0cb45-1816-42d6-9f83-655c6c65ef1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:15.204275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0cb45-1816-42d6-9f83-655c6c65ef1e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:15.204562 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0cb45-1816-42d6-9f83-655c6c65ef1e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:15.204901 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0cb45-1816-42d6-9f83-655c6c65ef1e None admin] PATH_INFO: `/v3/users/9708963ca39d4545a1fae63df1a7b3d0` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:15.206042 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0cb45-1816-42d6-9f83-655c6c65ef1e None admin] RBAC: Authorizing `identity:get_user(user_id=9708963ca39d4545a1fae63df1a7b3d0)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:15.207580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0cb45-1816-42d6-9f83-655c6c65ef1e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:15.207677 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cdfed-7c4a-4477-af5d-4eac586370e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:15.208414 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cdfed-7c4a-4477-af5d-4eac586370e0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:15.208694 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cdfed-7c4a-4477-af5d-4eac586370e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:15.208965 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113cdfed-7c4a-4477-af5d-4eac586370e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:15.209504 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 148/301] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:15 2022] GET /identity/v3/users/9708963ca39d4545a1fae63df1a7b3d0 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:15.210118 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cdfed-7c4a-4477-af5d-4eac586370e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:15.211655 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113cdfed-7c4a-4477-af5d-4eac586370e0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:15.213378 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 154/302] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:15.214789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cdfed-7c4a-4477-af5d-4eac586370e0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:15.218475 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbe478-9bca-4e1d-bc6a-5105996e22d1 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:15.218764 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbe478-9bca-4e1d-bc6a-5105996e22d1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:15.219047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbe478-9bca-4e1d-bc6a-5105996e22d1 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:15.223342 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 149/303] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:15.225688 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbe478-9bca-4e1d-bc6a-5105996e22d1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:15.277877 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:15.319371 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113cdfed-7c4a-4477-af5d-4eac586370e0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:15.340214 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbe478-9bca-4e1d-bc6a-5105996e22d1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:15.354778 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b955173b-3526-421a-90d6-29b28085f483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:15.355692 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955173b-3526-421a-90d6-29b28085f483 None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:15.355969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955173b-3526-421a-90d6-29b28085f483 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:15.356237 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b955173b-3526-421a-90d6-29b28085f483 None admin] PATH_INFO: `/v3/system/users/9708963ca39d4545a1fae63df1a7b3d0/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:15.357730 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955173b-3526-421a-90d6-29b28085f483 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9708963ca39d4545a1fae63df1a7b3d0, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:15.359121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b955173b-3526-421a-90d6-29b28085f483 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:15.375333 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 155/304] 10.222.0.42 () {58 vars in 1334 bytes} [Sun Jul 24 00:58:15 2022] PUT /identity/v3/system/users/9708963ca39d4545a1fae63df1a7b3d0/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:58:15.375333 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ddfd9-c9d0-40fd-894d-6e44ea9118ed None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:15.375333 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ddfd9-c9d0-40fd-894d-6e44ea9118ed None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:15.375333 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ddfd9-c9d0-40fd-894d-6e44ea9118ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:15.391225 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-cb2ddfd9-c9d0-40fd-894d-6e44ea9118ed None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:15.392537 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cb2ddfd9-c9d0-40fd-894d-6e44ea9118ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:15.392642 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b724e-3a1b-4014-b6c3-55dc171e3d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:15.393360 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b724e-3a1b-4014-b6c3-55dc171e3d96 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:15.393648 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b724e-3a1b-4014-b6c3-55dc171e3d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:15.393991 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b724e-3a1b-4014-b6c3-55dc171e3d96 None admin] PATH_INFO: `/v3/groups` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:15.395107 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b724e-3a1b-4014-b6c3-55dc171e3d96 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:15.397916 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b724e-3a1b-4014-b6c3-55dc171e3d96 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:15.420050 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 150/305] 10.222.0.42 () {60 vars in 1134 bytes} [Sun Jul 24 00:58:15 2022] POST /identity/v3/groups => generated 229 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:58:15.480783 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 156/306] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:15.504557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b724e-3a1b-4014-b6c3-55dc171e3d96 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:15.523213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:15.622995 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b724e-3a1b-4014-b6c3-55dc171e3d96 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:15.659134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ade733-48fa-4e28-b990-79f6782b5030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:15.659134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ade733-48fa-4e28-b990-79f6782b5030 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:15.659134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ade733-48fa-4e28-b990-79f6782b5030 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:15.659134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ade733-48fa-4e28-b990-79f6782b5030 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:15.669909 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ade733-48fa-4e28-b990-79f6782b5030 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-c7ade733-48fa-4e28-b990-79f6782b5030 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:15.677907 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:15.678812 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:15.679701 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:15.679701 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:15.679701 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:15.679701 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:15.679701 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:15.679701 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:15.679701 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:15.679701 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:15.679701 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:15.679701 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:15.679701 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:58:15.679701 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:15.679701 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 151/307] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:15.685413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ddfd9-c9d0-40fd-894d-6e44ea9118ed None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:15.740733 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:15.790254 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ddfd9-c9d0-40fd-894d-6e44ea9118ed None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:15.825298 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af28ab1-d928-4502-ab8d-c5081b7e2d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:15.825984 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af28ab1-d928-4502-ab8d-c5081b7e2d5d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:15.826274 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af28ab1-d928-4502-ab8d-c5081b7e2d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:15.826556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af28ab1-d928-4502-ab8d-c5081b7e2d5d None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:15.827338 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af28ab1-d928-4502-ab8d-c5081b7e2d5d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:15.827810 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af28ab1-d928-4502-ab8d-c5081b7e2d5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:15.829222 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af28ab1-d928-4502-ab8d-c5081b7e2d5d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:15.838217 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 157/308] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:15.843845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ade733-48fa-4e28-b990-79f6782b5030 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:15.856300 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8927a69-9abd-427c-8f02-3cbb1b1e6288 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:15.856610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8927a69-9abd-427c-8f02-3cbb1b1e6288 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:15.856859 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8927a69-9abd-427c-8f02-3cbb1b1e6288 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:15.862124 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 158/309] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:58:15.863704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efae4d-d6c7-4e11-a2ce-924e1b9b1965 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:15.863997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efae4d-d6c7-4e11-a2ce-924e1b9b1965 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:15.864286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efae4d-d6c7-4e11-a2ce-924e1b9b1965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:15.881104 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-81efae4d-d6c7-4e11-a2ce-924e1b9b1965 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:15.882292 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-81efae4d-d6c7-4e11-a2ce-924e1b9b1965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:15.924816 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:15.952582 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 159/310] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:58:15.961481 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ade733-48fa-4e28-b990-79f6782b5030 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:15.976956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efae4d-d6c7-4e11-a2ce-924e1b9b1965 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:16.000192 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d33345-b97a-49e2-9e51-c4cd20076ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:16.001245 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d33345-b97a-49e2-9e51-c4cd20076ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:16.001531 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d33345-b97a-49e2-9e51-c4cd20076ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:16.002130 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d33345-b97a-49e2-9e51-c4cd20076ee1 None admin] PATH_INFO: `/v3/users/04c84f4afa1a4e839ba00605a03eed6e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:16.018887 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d33345-b97a-49e2-9e51-c4cd20076ee1 None admin] RBAC: Authorizing `identity:get_user(user_id=04c84f4afa1a4e839ba00605a03eed6e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:16.021094 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d33345-b97a-49e2-9e51-c4cd20076ee1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:16.023572 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 152/311] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:15 2022] GET /identity/v3/users/04c84f4afa1a4e839ba00605a03eed6e => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:16.027698 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:16.029515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d33345-b97a-49e2-9e51-c4cd20076ee1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:16.086590 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efae4d-d6c7-4e11-a2ce-924e1b9b1965 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:16.122427 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686825e-ab4f-4be5-b719-ab4918c4e095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:16.123312 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686825e-ab4f-4be5-b719-ab4918c4e095 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:16.123611 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686825e-ab4f-4be5-b719-ab4918c4e095 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:16.123980 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8686825e-ab4f-4be5-b719-ab4918c4e095 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:16.133339 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d33345-b97a-49e2-9e51-c4cd20076ee1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:16.135366 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8686825e-ab4f-4be5-b719-ab4918c4e095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-8686825e-ab4f-4be5-b719-ab4918c4e095 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:16.143678 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:16.145504 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:16.146614 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:16.146614 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:16.146614 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:16.146614 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:16.146614 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:16.146614 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:16.146614 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:16.146614 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:16.146614 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:16.146614 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:16.146614 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:58:16.146614 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:16.146614 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 160/312] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:16.150847 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686825e-ab4f-4be5-b719-ab4918c4e095 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:16.163134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:16.170301 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a01a2-6a79-4e93-bcd8-eabdebf908b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:16.171062 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a01a2-6a79-4e93-bcd8-eabdebf908b7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:16.171440 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a01a2-6a79-4e93-bcd8-eabdebf908b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:16.171793 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a01a2-6a79-4e93-bcd8-eabdebf908b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:16.172760 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a01a2-6a79-4e93-bcd8-eabdebf908b7 None admin] RBAC: Adding query filter params (role.id=ac3cef1fcb1744de989fa7f25e7de7b4, user.id=04c84f4afa1a4e839ba00605a03eed6e, scope.system=all) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:16.173163 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a01a2-6a79-4e93-bcd8-eabdebf908b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:16.174687 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a01a2-6a79-4e93-bcd8-eabdebf908b7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:16.180468 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 153/313] 10.222.0.42 () {56 vars in 1308 bytes} [Sun Jul 24 00:58:16 2022] GET /identity/v3/role_assignments?user.id=04c84f4afa1a4e839ba00605a03eed6e&scope.system=all&role.id=ac3cef1fcb1744de989fa7f25e7de7b4 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:16.278272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8686825e-ab4f-4be5-b719-ab4918c4e095 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:16.281483 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:16.319109 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ffca4-2c3f-4723-8053-ffa34e6c2c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:16.320548 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ffca4-2c3f-4723-8053-ffa34e6c2c96 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:16.321011 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ffca4-2c3f-4723-8053-ffa34e6c2c96 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:16.321496 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ffca4-2c3f-4723-8053-ffa34e6c2c96 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:16.322462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ffca4-2c3f-4723-8053-ffa34e6c2c96 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:16.322950 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ffca4-2c3f-4723-8053-ffa34e6c2c96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:16.324578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ffca4-2c3f-4723-8053-ffa34e6c2c96 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:16.339084 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 161/314] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:16.340825 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a01a2-6a79-4e93-bcd8-eabdebf908b7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:16.444792 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a01a2-6a79-4e93-bcd8-eabdebf908b7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:16.479110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e8577-9c12-4897-a28b-0a9cc7c452ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:16.480342 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e8577-9c12-4897-a28b-0a9cc7c452ee None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:16.480806 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e8577-9c12-4897-a28b-0a9cc7c452ee None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:16.481255 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958e8577-9c12-4897-a28b-0a9cc7c452ee None admin] PATH_INFO: `/v3/users/ca4131954dbc43ab98c907481eeee487` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:16.482668 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e8577-9c12-4897-a28b-0a9cc7c452ee None admin] RBAC: Authorizing `identity:get_user(user_id=ca4131954dbc43ab98c907481eeee487)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:16.484332 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958e8577-9c12-4897-a28b-0a9cc7c452ee None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:16.486154 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 154/315] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:16 2022] GET /identity/v3/users/ca4131954dbc43ab98c907481eeee487 => generated 297 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:16.492197 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ffca4-2c3f-4723-8053-ffa34e6c2c96 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:16.599736 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ffca4-2c3f-4723-8053-ffa34e6c2c96 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:16.634224 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710e31b-32df-479b-bd1d-b26f084b421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:16.635039 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710e31b-32df-479b-bd1d-b26f084b421a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:16.635343 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710e31b-32df-479b-bd1d-b26f084b421a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:16.635626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710e31b-32df-479b-bd1d-b26f084b421a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:16.671730 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:16.709559 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710e31b-32df-479b-bd1d-b26f084b421a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:16.711041 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3710e31b-32df-479b-bd1d-b26f084b421a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:16.828520 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 162/316] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:16.830121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e8577-9c12-4897-a28b-0a9cc7c452ee None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:16.893108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:16.932555 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958e8577-9c12-4897-a28b-0a9cc7c452ee None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:16.967527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5855e-d75b-4fa8-afe4-a7156ee0d266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:16.968780 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5855e-d75b-4fa8-afe4-a7156ee0d266 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:16.969263 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5855e-d75b-4fa8-afe4-a7156ee0d266 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:16.969735 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5855e-d75b-4fa8-afe4-a7156ee0d266 None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:16.971163 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5855e-d75b-4fa8-afe4-a7156ee0d266 None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:16.972856 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5855e-d75b-4fa8-afe4-a7156ee0d266 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:16.974806 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 155/317] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:16 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:16.981204 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710e31b-32df-479b-bd1d-b26f084b421a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:17.048941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:17.086434 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710e31b-32df-479b-bd1d-b26f084b421a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:17.121980 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43615857-58ca-4148-bd2c-ebb6f6bc3443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:17.123032 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43615857-58ca-4148-bd2c-ebb6f6bc3443 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:17.123559 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43615857-58ca-4148-bd2c-ebb6f6bc3443 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:17.124037 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43615857-58ca-4148-bd2c-ebb6f6bc3443 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:17.125096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43615857-58ca-4148-bd2c-ebb6f6bc3443 None admin] RBAC: Adding query filter params (role.id=ac3cef1fcb1744de989fa7f25e7de7b4, scope.project.id=60e98823de624a7fa1c311b6f19b75a3, user.id=ca4131954dbc43ab98c907481eeee487) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:17.125608 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43615857-58ca-4148-bd2c-ebb6f6bc3443 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:17.127268 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43615857-58ca-4148-bd2c-ebb6f6bc3443 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:17.139441 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 163/318] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:16 2022] GET /identity/v3/role_assignments?user.id=ca4131954dbc43ab98c907481eeee487&scope.project.id=60e98823de624a7fa1c311b6f19b75a3&role.id=ac3cef1fcb1744de989fa7f25e7de7b4 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:17.496134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c93746-cdbd-42d4-9360-26d21d00cd71 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:17.496503 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c93746-cdbd-42d4-9360-26d21d00cd71 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:17.496718 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c93746-cdbd-42d4-9360-26d21d00cd71 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:17.498143 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 156/319] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:17.503423 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49585620-62a2-4fe2-88a0-7a77f745883a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:17.503722 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49585620-62a2-4fe2-88a0-7a77f745883a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:17.504019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49585620-62a2-4fe2-88a0-7a77f745883a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:17.521654 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-49585620-62a2-4fe2-88a0-7a77f745883a None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:17.522863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-49585620-62a2-4fe2-88a0-7a77f745883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:17.558369 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755248a8-fb2d-4a0b-a339-6ca07cf8f501 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:17.558643 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755248a8-fb2d-4a0b-a339-6ca07cf8f501 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:17.558927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755248a8-fb2d-4a0b-a339-6ca07cf8f501 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:17.560360 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 157/320] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:58:17.565100 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724eba5-964d-45ad-81fb-edff47e0f1c8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:17.565388 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724eba5-964d-45ad-81fb-edff47e0f1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:17.565670 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724eba5-964d-45ad-81fb-edff47e0f1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:17.582107 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3724eba5-964d-45ad-81fb-edff47e0f1c8 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:17.583288 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3724eba5-964d-45ad-81fb-edff47e0f1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:17.595441 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 164/321] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:17.616315 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49585620-62a2-4fe2-88a0-7a77f745883a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:17.650312 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 158/322] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:58:17.672569 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724eba5-964d-45ad-81fb-edff47e0f1c8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:17.675102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:17.725982 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49585620-62a2-4fe2-88a0-7a77f745883a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:17.734722 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:17.762610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5409caf-01b1-4e16-b8e3-527d6e5b551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:17.763671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5409caf-01b1-4e16-b8e3-527d6e5b551e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:17.764137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5409caf-01b1-4e16-b8e3-527d6e5b551e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:17.764417 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5409caf-01b1-4e16-b8e3-527d6e5b551e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:17.775259 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5409caf-01b1-4e16-b8e3-527d6e5b551e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:17.779851 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724eba5-964d-45ad-81fb-edff47e0f1c8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-e5409caf-01b1-4e16-b8e3-527d6e5b551e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:17.783276 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:17.784182 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:17.785011 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:17.785011 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:17.785011 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:17.785011 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:17.785011 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:17.785011 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:17.785011 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:17.785011 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:17.785011 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:17.785011 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:17.785011 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:17.785011 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:17.789422 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 165/323] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:58:17.790238 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5409caf-01b1-4e16-b8e3-527d6e5b551e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:17.824991 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa29e4-f308-4bb1-8b51-d06d709b5ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:17.825805 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa29e4-f308-4bb1-8b51-d06d709b5ec1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:17.826087 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa29e4-f308-4bb1-8b51-d06d709b5ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:17.826360 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aa29e4-f308-4bb1-8b51-d06d709b5ec1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:17.827574 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa29e4-f308-4bb1-8b51-d06d709b5ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:17.829063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aa29e4-f308-4bb1-8b51-d06d709b5ec1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:17.830873 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 159/324] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:17.836274 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa29e4-f308-4bb1-8b51-d06d709b5ec1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:17.893994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5409caf-01b1-4e16-b8e3-527d6e5b551e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:17.914031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:17.928539 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfdd87-1ac9-4366-b4c2-a3bdf7e5253e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:17.929223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfdd87-1ac9-4366-b4c2-a3bdf7e5253e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:17.929510 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfdd87-1ac9-4366-b4c2-a3bdf7e5253e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:17.929788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbfdd87-1ac9-4366-b4c2-a3bdf7e5253e None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:17.930549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfdd87-1ac9-4366-b4c2-a3bdf7e5253e None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:17.930862 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfdd87-1ac9-4366-b4c2-a3bdf7e5253e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:17.932343 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbfdd87-1ac9-4366-b4c2-a3bdf7e5253e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:17.940631 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 166/325] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:17.943042 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aa29e4-f308-4bb1-8b51-d06d709b5ec1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:17.947333 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfdd87-1ac9-4366-b4c2-a3bdf7e5253e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:17.976688 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:17.985635 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b198ca-599f-4bcc-bc5c-8d7da11c5987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:17.986316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b198ca-599f-4bcc-bc5c-8d7da11c5987 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:17.986599 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b198ca-599f-4bcc-bc5c-8d7da11c5987 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:17.987250 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b198ca-599f-4bcc-bc5c-8d7da11c5987 None admin] PATH_INFO: `/v3/groups` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:17.987722 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b198ca-599f-4bcc-bc5c-8d7da11c5987 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:17.989321 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b198ca-599f-4bcc-bc5c-8d7da11c5987 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:18.015412 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 160/326] 10.222.0.42 () {60 vars in 1134 bytes} [Sun Jul 24 00:58:17 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:58:18.064642 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbfdd87-1ac9-4366-b4c2-a3bdf7e5253e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:18.101988 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c20eda-ebf7-4616-bdd9-47d481d3c4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:18.102895 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c20eda-ebf7-4616-bdd9-47d481d3c4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:18.103183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c20eda-ebf7-4616-bdd9-47d481d3c4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:18.103549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c20eda-ebf7-4616-bdd9-47d481d3c4e4 None admin] PATH_INFO: `/v3/users/9708963ca39d4545a1fae63df1a7b3d0` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:18.104787 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c20eda-ebf7-4616-bdd9-47d481d3c4e4 None admin] RBAC: Authorizing `identity:get_user(user_id=9708963ca39d4545a1fae63df1a7b3d0)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:18.106297 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c20eda-ebf7-4616-bdd9-47d481d3c4e4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:18.108218 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 167/327] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:17 2022] GET /identity/v3/users/9708963ca39d4545a1fae63df1a7b3d0 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:18.113839 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b198ca-599f-4bcc-bc5c-8d7da11c5987 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:18.222198 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b198ca-599f-4bcc-bc5c-8d7da11c5987 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:18.256371 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa51227-86a3-4ce6-b9a7-0a3f82a62fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:18.257053 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa51227-86a3-4ce6-b9a7-0a3f82a62fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:18.257341 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa51227-86a3-4ce6-b9a7-0a3f82a62fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:18.257626 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa51227-86a3-4ce6-b9a7-0a3f82a62fe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:18.258532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa51227-86a3-4ce6-b9a7-0a3f82a62fe3 None admin] RBAC: Adding query filter params (role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9, user.id=9708963ca39d4545a1fae63df1a7b3d0, scope.system=all) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:18.258854 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa51227-86a3-4ce6-b9a7-0a3f82a62fe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:18.260417 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa51227-86a3-4ce6-b9a7-0a3f82a62fe3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:18.274018 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 161/328] 10.222.0.42 () {56 vars in 1308 bytes} [Sun Jul 24 00:58:18 2022] GET /identity/v3/role_assignments?user.id=9708963ca39d4545a1fae63df1a7b3d0&scope.system=all&role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 510 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:18.306839 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149e123-96d2-4b13-8af2-7c488c2ebbd5 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:18.307196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149e123-96d2-4b13-8af2-7c488c2ebbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:18.307433 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6149e123-96d2-4b13-8af2-7c488c2ebbd5 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:18.309159 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 168/329] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:18.315003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d788f32-a95e-4f93-bdb1-2f4d675bd788 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:18.315367 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d788f32-a95e-4f93-bdb1-2f4d675bd788 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:18.315603 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d788f32-a95e-4f93-bdb1-2f4d675bd788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:18.334311 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8d788f32-a95e-4f93-bdb1-2f4d675bd788 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:18.335871 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8d788f32-a95e-4f93-bdb1-2f4d675bd788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:18.388763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:18.426873 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 162/330] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:18.451770 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149e123-96d2-4b13-8af2-7c488c2ebbd5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:18.509551 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:18.568593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6149e123-96d2-4b13-8af2-7c488c2ebbd5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:18.605507 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691a1d5-73d0-4e9c-8b6e-43cb1265c88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:18.606333 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691a1d5-73d0-4e9c-8b6e-43cb1265c88f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:18.606611 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691a1d5-73d0-4e9c-8b6e-43cb1265c88f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:18.606891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d691a1d5-73d0-4e9c-8b6e-43cb1265c88f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:18.617903 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d691a1d5-73d0-4e9c-8b6e-43cb1265c88f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d691a1d5-73d0-4e9c-8b6e-43cb1265c88f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:18.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:18.626806 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:18.627721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:18.627721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:18.627721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:18.627721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:18.627721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:18.627721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:18.627721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:18.627721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:18.627721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:18.627721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:18.627721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:58:18.627721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:18.627721 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 169/331] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:18.633277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d788f32-a95e-4f93-bdb1-2f4d675bd788 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:18.743009 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d788f32-a95e-4f93-bdb1-2f4d675bd788 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:18.779277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18b649-e856-4585-af03-c7cf798a82f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:18.779996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18b649-e856-4585-af03-c7cf798a82f8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:18.780280 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18b649-e856-4585-af03-c7cf798a82f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:18.780557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18b649-e856-4585-af03-c7cf798a82f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:18.781323 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18b649-e856-4585-af03-c7cf798a82f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:18.781635 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18b649-e856-4585-af03-c7cf798a82f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:18.783042 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18b649-e856-4585-af03-c7cf798a82f8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:18.799328 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 163/332] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:18.805094 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691a1d5-73d0-4e9c-8b6e-43cb1265c88f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:18.918525 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d691a1d5-73d0-4e9c-8b6e-43cb1265c88f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:18.931823 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:18.953043 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cfed67-57e3-4bed-b1fc-2870c56faba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:18.953936 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfed67-57e3-4bed-b1fc-2870c56faba8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:18.954221 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfed67-57e3-4bed-b1fc-2870c56faba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:18.954500 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cfed67-57e3-4bed-b1fc-2870c56faba8 None admin] PATH_INFO: `/v3/users/04c84f4afa1a4e839ba00605a03eed6e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:18.955732 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfed67-57e3-4bed-b1fc-2870c56faba8 None admin] RBAC: Authorizing `identity:get_user(user_id=04c84f4afa1a4e839ba00605a03eed6e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:18.957209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cfed67-57e3-4bed-b1fc-2870c56faba8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:18.959156 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 170/333] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:18 2022] GET /identity/v3/users/04c84f4afa1a4e839ba00605a03eed6e => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:18.964939 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18b649-e856-4585-af03-c7cf798a82f8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:19.016368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:19.093826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18b649-e856-4585-af03-c7cf798a82f8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:19.130870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f3b1f-9ae9-4b5a-9309-9e333acce22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:19.131795 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f3b1f-9ae9-4b5a-9309-9e333acce22c None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:19.132072 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f3b1f-9ae9-4b5a-9309-9e333acce22c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:19.132342 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f3b1f-9ae9-4b5a-9309-9e333acce22c None admin] PATH_INFO: `/v3/system/users/04c84f4afa1a4e839ba00605a03eed6e/roles/ac3cef1fcb1744de989fa7f25e7de7b4` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:19.134655 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f3b1f-9ae9-4b5a-9309-9e333acce22c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=04c84f4afa1a4e839ba00605a03eed6e, role_id=ac3cef1fcb1744de989fa7f25e7de7b4)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:19.136146 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f3b1f-9ae9-4b5a-9309-9e333acce22c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:19.148917 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 164/334] 10.222.0.42 () {58 vars in 1334 bytes} [Sun Jul 24 00:58:18 2022] PUT /identity/v3/system/users/04c84f4afa1a4e839ba00605a03eed6e/roles/ac3cef1fcb1744de989fa7f25e7de7b4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:58:20.289717 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d575ca8-d2be-471e-a63c-86bc7c41c418 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:20.290241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d575ca8-d2be-471e-a63c-86bc7c41c418 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:20.290316 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d575ca8-d2be-471e-a63c-86bc7c41c418 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:20.291755 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 171/335] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:20.297166 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9767c-3e8b-4e17-a7de-5fb0950d568f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:20.297633 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9767c-3e8b-4e17-a7de-5fb0950d568f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:20.297710 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc9767c-3e8b-4e17-a7de-5fb0950d568f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:20.328447 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9dc9767c-3e8b-4e17-a7de-5fb0950d568f None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:20.329692 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9dc9767c-3e8b-4e17-a7de-5fb0950d568f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:20.419216 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 165/336] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:20.470187 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d575ca8-d2be-471e-a63c-86bc7c41c418 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:20.600205 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d575ca8-d2be-471e-a63c-86bc7c41c418 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:20.660097 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a82f380-6714-4875-89bd-1ef78413f4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:20.661302 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82f380-6714-4875-89bd-1ef78413f4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:20.661802 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82f380-6714-4875-89bd-1ef78413f4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:20.662268 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a82f380-6714-4875-89bd-1ef78413f4d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:20.676734 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a82f380-6714-4875-89bd-1ef78413f4d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-0a82f380-6714-4875-89bd-1ef78413f4d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:20.685109 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:20.686005 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:20.686804 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:20.686804 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:20.686804 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:20.686804 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:20.686804 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:20.686804 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:20.686804 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:20.686804 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:20.686804 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:20.686804 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:20.686804 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:20.686804 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:20.691773 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 172/337] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:20.697798 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9767c-3e8b-4e17-a7de-5fb0950d568f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:20.734783 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d0922-6793-4e7c-a7e8-8a2181e581ef None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:20.735447 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d0922-6793-4e7c-a7e8-8a2181e581ef None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:20.735917 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d0922-6793-4e7c-a7e8-8a2181e581ef None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:20.737553 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 173/338] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:20.742942 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b944113-88fa-400a-a8c6-fd8f67afe576 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:20.743500 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b944113-88fa-400a-a8c6-fd8f67afe576 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:20.744014 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b944113-88fa-400a-a8c6-fd8f67afe576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:20.750876 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:20.769156 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5b944113-88fa-400a-a8c6-fd8f67afe576 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:20.770706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5b944113-88fa-400a-a8c6-fd8f67afe576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:20.830331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:20.864290 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 174/339] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:58:20.865640 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a0dbb-bc16-4cca-a6a6-cf4a7ae4e00d None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:20.865936 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a0dbb-bc16-4cca-a6a6-cf4a7ae4e00d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:20.866215 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a0dbb-bc16-4cca-a6a6-cf4a7ae4e00d None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:20.867565 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 175/340] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:20.881063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5e20-58fb-41ba-bea1-57ea73fe3111 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:20.881558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5e20-58fb-41ba-bea1-57ea73fe3111 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:20.881970 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9f5e20-58fb-41ba-bea1-57ea73fe3111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:20.907355 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc9767c-3e8b-4e17-a7de-5fb0950d568f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:20.908632 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6d9f5e20-58fb-41ba-bea1-57ea73fe3111 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:20.909858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6d9f5e20-58fb-41ba-bea1-57ea73fe3111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:20.947260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54393d-8230-4cec-a159-b220fc395562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:20.948397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54393d-8230-4cec-a159-b220fc395562 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:20.948895 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54393d-8230-4cec-a159-b220fc395562 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:20.949358 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf54393d-8230-4cec-a159-b220fc395562 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:20.950412 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54393d-8230-4cec-a159-b220fc395562 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:20.950915 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54393d-8230-4cec-a159-b220fc395562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:20.952714 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf54393d-8230-4cec-a159-b220fc395562 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:20.965700 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 166/341] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:20.969257 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54393d-8230-4cec-a159-b220fc395562 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:21.008458 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 176/342] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:58:21.010476 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f5e20-58fb-41ba-bea1-57ea73fe3111 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:21.134410 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:21.143700 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:21.144523 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf54393d-8230-4cec-a159-b220fc395562 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:21.147236 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9f5e20-58fb-41ba-bea1-57ea73fe3111 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:21.190369 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b683ca6-bc41-4108-bf94-9210e86830a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:21.191045 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b683ca6-bc41-4108-bf94-9210e86830a9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:21.191356 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b683ca6-bc41-4108-bf94-9210e86830a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:21.191639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b683ca6-bc41-4108-bf94-9210e86830a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:21.196528 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfb5c8-a378-4987-bea1-82f7d7bda1be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:21.197423 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfb5c8-a378-4987-bea1-82f7d7bda1be None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:21.197711 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfb5c8-a378-4987-bea1-82f7d7bda1be None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:21.197990 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfb5c8-a378-4987-bea1-82f7d7bda1be None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:21.247919 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfb5c8-a378-4987-bea1-82f7d7bda1be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-2bcfb5c8-a378-4987-bea1-82f7d7bda1be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:21.255936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:21.256851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:21.257645 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:21.257645 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:21.257645 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:21.257645 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:21.257645 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:21.257645 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:21.257645 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:21.257645 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:21.257645 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:21.257645 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:21.257645 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:21.257645 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:21.257645 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 167/343] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:21.258306 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfb5c8-a378-4987-bea1-82f7d7bda1be None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:21.277963 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b683ca6-bc41-4108-bf94-9210e86830a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:21.280423 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b683ca6-bc41-4108-bf94-9210e86830a9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:21.390582 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:21.396474 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 177/344] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:21.397808 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b683ca6-bc41-4108-bf94-9210e86830a9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:21.511529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b683ca6-bc41-4108-bf94-9210e86830a9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:21.524471 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfb5c8-a378-4987-bea1-82f7d7bda1be None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:21.571473 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1de4b-b84d-4a9b-807e-c2fb55134ff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:21.572584 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1de4b-b84d-4a9b-807e-c2fb55134ff5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:21.574158 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1de4b-b84d-4a9b-807e-c2fb55134ff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:21.576113 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1de4b-b84d-4a9b-807e-c2fb55134ff5 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:21.577086 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1de4b-b84d-4a9b-807e-c2fb55134ff5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:21.579050 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1de4b-b84d-4a9b-807e-c2fb55134ff5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:21.580687 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1de4b-b84d-4a9b-807e-c2fb55134ff5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:21.597180 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620def5e-ae9f-49f2-b394-482445b9d610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:21.598454 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620def5e-ae9f-49f2-b394-482445b9d610 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:21.601193 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620def5e-ae9f-49f2-b394-482445b9d610 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:21.601627 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620def5e-ae9f-49f2-b394-482445b9d610 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:21.602731 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 178/345] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:21.604760 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1de4b-b84d-4a9b-807e-c2fb55134ff5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:21.624148 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620def5e-ae9f-49f2-b394-482445b9d610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-620def5e-ae9f-49f2-b394-482445b9d610 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:21.639103 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:21.640280 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:21.641385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:21.641385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:21.641385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:21.641385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:21.641385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:21.641385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:21.641385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:21.641385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:21.641385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:21.641385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:21.641385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:21.641385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:21.646822 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 168/346] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:58:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:21.647826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620def5e-ae9f-49f2-b394-482445b9d610 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:21.684091 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:21.728823 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:21.815763 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1de4b-b84d-4a9b-807e-c2fb55134ff5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:21.856207 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620def5e-ae9f-49f2-b394-482445b9d610 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:21.879309 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79d10b-8924-461a-81e0-f64139f09a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:21.880212 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79d10b-8924-461a-81e0-f64139f09a9c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:21.880499 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79d10b-8924-461a-81e0-f64139f09a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:21.880781 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79d10b-8924-461a-81e0-f64139f09a9c None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:21.886291 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79d10b-8924-461a-81e0-f64139f09a9c None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:21.887801 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79d10b-8924-461a-81e0-f64139f09a9c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:21.889709 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 179/347] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:21 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:21.895016 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79d10b-8924-461a-81e0-f64139f09a9c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:21.927766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49573f66-f7e9-4dcd-a615-df8e020518af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:21.928437 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49573f66-f7e9-4dcd-a615-df8e020518af None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:21.928723 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49573f66-f7e9-4dcd-a615-df8e020518af None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:21.929002 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49573f66-f7e9-4dcd-a615-df8e020518af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.024681 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49573f66-f7e9-4dcd-a615-df8e020518af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:22.026326 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49573f66-f7e9-4dcd-a615-df8e020518af None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:22.045896 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79d10b-8924-461a-81e0-f64139f09a9c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:22.046416 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:22.079388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:22.089539 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d40bdf-8de2-46b7-8b74-8d54dcb547e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:22.090512 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d40bdf-8de2-46b7-8b74-8d54dcb547e8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:22.091012 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d40bdf-8de2-46b7-8b74-8d54dcb547e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:22.091647 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d40bdf-8de2-46b7-8b74-8d54dcb547e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.092585 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d40bdf-8de2-46b7-8b74-8d54dcb547e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:22.093101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d40bdf-8de2-46b7-8b74-8d54dcb547e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:22.094777 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d40bdf-8de2-46b7-8b74-8d54dcb547e8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:22.103970 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 180/348] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:22.105116 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d40bdf-8de2-46b7-8b74-8d54dcb547e8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:22.150455 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 169/349] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:22.152264 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1ba40-8cc4-40af-8c9f-cb43d20c750b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:22.152701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1ba40-8cc4-40af-8c9f-cb43d20c750b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:22.153152 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef1ba40-8cc4-40af-8c9f-cb43d20c750b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.155053 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 170/350] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:22.156108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1ba40-8cc4-40af-8c9f-cb43d20c750b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:22.213542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d40bdf-8de2-46b7-8b74-8d54dcb547e8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:22.250723 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a45d56-142d-462c-a14b-dbab76c42ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:22.251976 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a45d56-142d-462c-a14b-dbab76c42ebe None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:22.252462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a45d56-142d-462c-a14b-dbab76c42ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:22.253025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a45d56-142d-462c-a14b-dbab76c42ebe None admin] PATH_INFO: `/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.260127 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a45d56-142d-462c-a14b-dbab76c42ebe None admin] RBAC: Authorizing `identity:get_group(group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:22.262004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a45d56-142d-462c-a14b-dbab76c42ebe None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:22.263130 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef1ba40-8cc4-40af-8c9f-cb43d20c750b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:22.264478 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 181/351] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Jul 24 00:58:22 2022] GET /identity/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:22.265541 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a45d56-142d-462c-a14b-dbab76c42ebe None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:22.279473 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:22.301822 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257f274-3b8a-4d98-bd4d-8cd812dc555f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:22.302834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257f274-3b8a-4d98-bd4d-8cd812dc555f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:22.303383 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257f274-3b8a-4d98-bd4d-8cd812dc555f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:22.303834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4257f274-3b8a-4d98-bd4d-8cd812dc555f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.334329 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:22.382820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257f274-3b8a-4d98-bd4d-8cd812dc555f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:22.385420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4257f274-3b8a-4d98-bd4d-8cd812dc555f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:22.389962 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a45d56-142d-462c-a14b-dbab76c42ebe None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:22.428741 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dc8b57-ffbf-4b56-b5b5-c21bdcb2b900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:22.429554 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc8b57-ffbf-4b56-b5b5-c21bdcb2b900 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:22.429835 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc8b57-ffbf-4b56-b5b5-c21bdcb2b900 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:22.430112 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dc8b57-ffbf-4b56-b5b5-c21bdcb2b900 None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.431639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc8b57-ffbf-4b56-b5b5-c21bdcb2b900 None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:22.433105 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dc8b57-ffbf-4b56-b5b5-c21bdcb2b900 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:22.435449 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 182/352] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:22 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:22.437260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fdf2c-738a-4b95-aa94-8e12aded154b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:22.438229 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fdf2c-738a-4b95-aa94-8e12aded154b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:22.438978 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027fdf2c-738a-4b95-aa94-8e12aded154b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.458394 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-027fdf2c-738a-4b95-aa94-8e12aded154b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:22.459959 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-027fdf2c-738a-4b95-aa94-8e12aded154b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:22.502488 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 171/353] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:22.502488 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257f274-3b8a-4d98-bd4d-8cd812dc555f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:22.522701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:22.540030 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 183/354] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:22.543036 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8164284-2dec-457a-97c9-92265dcf4dd0 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:22.543560 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8164284-2dec-457a-97c9-92265dcf4dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:22.544063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8164284-2dec-457a-97c9-92265dcf4dd0 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.545701 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 184/355] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:22.547150 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8164284-2dec-457a-97c9-92265dcf4dd0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:22.616096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:22.628031 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4257f274-3b8a-4d98-bd4d-8cd812dc555f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:22.666303 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eded3b-1e80-461a-aef9-4e14800f531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:22.666303 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eded3b-1e80-461a-aef9-4e14800f531a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:22.666655 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eded3b-1e80-461a-aef9-4e14800f531a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:22.666856 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eded3b-1e80-461a-aef9-4e14800f531a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.667732 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eded3b-1e80-461a-aef9-4e14800f531a None admin] RBAC: Adding query filter params (group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e, role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9, scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:22.668048 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eded3b-1e80-461a-aef9-4e14800f531a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:22.669530 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eded3b-1e80-461a-aef9-4e14800f531a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:22.676080 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 172/356] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Jul 24 00:58:22 2022] GET /identity/v3/role_assignments?group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e&scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c&role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:22.677205 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eded3b-1e80-461a-aef9-4e14800f531a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:22.683509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8164284-2dec-457a-97c9-92265dcf4dd0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:22.734494 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d020825-43c4-462a-89a9-f1e9f4f3ad10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:22.735656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d020825-43c4-462a-89a9-f1e9f4f3ad10 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:22.735789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d020825-43c4-462a-89a9-f1e9f4f3ad10 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:22.735971 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d020825-43c4-462a-89a9-f1e9f4f3ad10 None admin] PATH_INFO: `/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.737269 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d020825-43c4-462a-89a9-f1e9f4f3ad10 None admin] RBAC: Authorizing `identity:get_group(group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:22.738775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d020825-43c4-462a-89a9-f1e9f4f3ad10 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:22.740574 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 185/357] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Jul 24 00:58:22 2022] GET /identity/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:22.741859 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74aee51-05f0-4870-8303-0b9ed1c82e1c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:22.742149 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74aee51-05f0-4870-8303-0b9ed1c82e1c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:22.742433 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74aee51-05f0-4870-8303-0b9ed1c82e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.768088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b74aee51-05f0-4870-8303-0b9ed1c82e1c None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:22.769311 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b74aee51-05f0-4870-8303-0b9ed1c82e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:22.788194 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:22.826570 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eded3b-1e80-461a-aef9-4e14800f531a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:22.868712 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 186/358] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:22.870762 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74aee51-05f0-4870-8303-0b9ed1c82e1c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:22.874667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7c77e5-91db-456d-80f2-1b30770dfc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:22.875281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c77e5-91db-456d-80f2-1b30770dfc49 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:22.875611 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c77e5-91db-456d-80f2-1b30770dfc49 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:22.875885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7c77e5-91db-456d-80f2-1b30770dfc49 None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.877552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c77e5-91db-456d-80f2-1b30770dfc49 None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:22.879034 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7c77e5-91db-456d-80f2-1b30770dfc49 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:22.880909 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 173/359] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:22 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:22.881957 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1358bb-0998-4bd1-8e20-4d9337dc19a0 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:22.882233 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1358bb-0998-4bd1-8e20-4d9337dc19a0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:22.882511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1358bb-0998-4bd1-8e20-4d9337dc19a0 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:22.884089 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 174/360] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:22.885223 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1358bb-0998-4bd1-8e20-4d9337dc19a0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:22.941524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:23.001217 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74aee51-05f0-4870-8303-0b9ed1c82e1c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:23.013240 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1358bb-0998-4bd1-8e20-4d9337dc19a0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:23.038685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afbce7-eee5-4dfa-935b-03db19b0a645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:23.039869 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afbce7-eee5-4dfa-935b-03db19b0a645 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:23.040322 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afbce7-eee5-4dfa-935b-03db19b0a645 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:23.040851 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97afbce7-eee5-4dfa-935b-03db19b0a645 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:23.050389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa484bd-0008-4bb2-a4ec-7599b8f11789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:23.051060 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa484bd-0008-4bb2-a4ec-7599b8f11789 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:23.051370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa484bd-0008-4bb2-a4ec-7599b8f11789 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:23.051654 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa484bd-0008-4bb2-a4ec-7599b8f11789 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:23.053810 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97afbce7-eee5-4dfa-935b-03db19b0a645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:23.054301 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa484bd-0008-4bb2-a4ec-7599b8f11789 None admin] RBAC: Adding query filter params (group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e, role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9, scope.project.id=60e98823de624a7fa1c311b6f19b75a3) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:23.054646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa484bd-0008-4bb2-a4ec-7599b8f11789 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:23.056184 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa484bd-0008-4bb2-a4ec-7599b8f11789 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:23.062950 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 175/361] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Jul 24 00:58:22 2022] GET /identity/v3/role_assignments?group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e&scope.project.id=60e98823de624a7fa1c311b6f19b75a3&role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 260 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-97afbce7-eee5-4dfa-935b-03db19b0a645 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:23.063091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:23.063966 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:23.065293 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:23.065293 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:23.065293 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:23.065293 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:23.065293 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:23.065293 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:23.065293 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:23.065293 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:23.065293 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:23.065293 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:23.065293 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:23.065293 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:23.065916 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451c749-07c4-4126-970f-9a7de6484ef8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:23.065916 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451c749-07c4-4126-970f-9a7de6484ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:23.066047 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 187/362] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:58:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:23.066113 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451c749-07c4-4126-970f-9a7de6484ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:23.066178 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afbce7-eee5-4dfa-935b-03db19b0a645 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:23.084616 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9451c749-07c4-4126-970f-9a7de6484ef8 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:23.085847 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9451c749-07c4-4126-970f-9a7de6484ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:23.094825 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:23.175989 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 176/363] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:23.176954 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451c749-07c4-4126-970f-9a7de6484ef8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:23.206941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97afbce7-eee5-4dfa-935b-03db19b0a645 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:23.221425 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:23.251103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa5372-3fb9-4226-abae-4c6f0e92bb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:23.252060 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa5372-3fb9-4226-abae-4c6f0e92bb8c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:23.252347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa5372-3fb9-4226-abae-4c6f0e92bb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:23.252626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa5372-3fb9-4226-abae-4c6f0e92bb8c None admin] PATH_INFO: `/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:23.254666 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa5372-3fb9-4226-abae-4c6f0e92bb8c None admin] RBAC: Authorizing `identity:get_group(group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:23.255967 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa5372-3fb9-4226-abae-4c6f0e92bb8c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:23.258051 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 188/364] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Jul 24 00:58:23 2022] GET /identity/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:23.258756 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa5372-3fb9-4226-abae-4c6f0e92bb8c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:23.307390 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9451c749-07c4-4126-970f-9a7de6484ef8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:23.350630 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a548e00-2be3-432f-8ee8-be46298f0a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:23.354199 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a548e00-2be3-432f-8ee8-be46298f0a90 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:23.354199 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a548e00-2be3-432f-8ee8-be46298f0a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:23.354199 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a548e00-2be3-432f-8ee8-be46298f0a90 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:23.363679 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:23.367675 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a548e00-2be3-432f-8ee8-be46298f0a90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-4a548e00-2be3-432f-8ee8-be46298f0a90 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:23.378272 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:23.379222 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:23.380052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:23.380052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:23.380052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:23.380052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:23.380052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:23.380052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:23.380052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:23.380052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:23.380052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:23.380052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:23.380052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 24 00:58:23.380052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:23.380052 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 177/365] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:23.381513 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a548e00-2be3-432f-8ee8-be46298f0a90 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:23.389934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa5372-3fb9-4226-abae-4c6f0e92bb8c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:23.444054 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b348fa-b54c-46e3-8238-c2ed06122180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:23.445190 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b348fa-b54c-46e3-8238-c2ed06122180 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:23.445370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b348fa-b54c-46e3-8238-c2ed06122180 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:23.445645 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b348fa-b54c-46e3-8238-c2ed06122180 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:23.446400 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b348fa-b54c-46e3-8238-c2ed06122180 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:23.446705 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b348fa-b54c-46e3-8238-c2ed06122180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:23.448295 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b348fa-b54c-46e3-8238-c2ed06122180 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:23.457205 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 189/366] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:23.457966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b348fa-b54c-46e3-8238-c2ed06122180 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:23.512544 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a548e00-2be3-432f-8ee8-be46298f0a90 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:23.520945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:23.555762 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93891007-e5f2-4905-b1b3-40e5aa3abc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:23.557146 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93891007-e5f2-4905-b1b3-40e5aa3abc52 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:23.557660 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93891007-e5f2-4905-b1b3-40e5aa3abc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:23.558136 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93891007-e5f2-4905-b1b3-40e5aa3abc52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:23.572775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93891007-e5f2-4905-b1b3-40e5aa3abc52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-93891007-e5f2-4905-b1b3-40e5aa3abc52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:23.581759 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:23.582653 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:23.583505 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:23.583505 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:23.583505 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:23.583505 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:23.583505 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:23.583505 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:23.583505 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:23.583505 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:23.583505 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:23.583505 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:23.583505 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:58:23.583505 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:23.586395 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 178/367] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:58:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:23.587511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93891007-e5f2-4905-b1b3-40e5aa3abc52 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:23.596729 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b348fa-b54c-46e3-8238-c2ed06122180 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:23.639522 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b57c17-d563-4759-8891-4b073b2970b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:23.640298 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57c17-d563-4759-8891-4b073b2970b4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:23.640586 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57c17-d563-4759-8891-4b073b2970b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:23.640859 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b57c17-d563-4759-8891-4b073b2970b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:23.641691 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b57c17-d563-4759-8891-4b073b2970b4 None admin] RBAC: Adding query filter params (group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e, role.id=e7e71ae9fccc4607808005a2e261bab1, scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:23.642004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b57c17-d563-4759-8891-4b073b2970b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:23.644041 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b57c17-d563-4759-8891-4b073b2970b4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:23.651428 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 190/368] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Jul 24 00:58:23 2022] GET /identity/v3/role_assignments?group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e&scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c&role.id=e7e71ae9fccc4607808005a2e261bab1 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:23.652060 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b57c17-d563-4759-8891-4b073b2970b4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:23.659727 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:23.710138 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93891007-e5f2-4905-b1b3-40e5aa3abc52 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:23.751973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6438a-56f0-4586-ba60-a3eb01adb30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:23.753120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6438a-56f0-4586-ba60-a3eb01adb30d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:23.753764 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6438a-56f0-4586-ba60-a3eb01adb30d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:23.754362 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6438a-56f0-4586-ba60-a3eb01adb30d None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:23.755414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6438a-56f0-4586-ba60-a3eb01adb30d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:23.755944 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6438a-56f0-4586-ba60-a3eb01adb30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:23.757769 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6438a-56f0-4586-ba60-a3eb01adb30d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:23.769256 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 179/369] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:23.769915 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b57c17-d563-4759-8891-4b073b2970b4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:23.770707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6438a-56f0-4586-ba60-a3eb01adb30d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:23.778544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:23.813809 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5148256-eb87-49b4-9f77-326cf2eabc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:23.815609 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5148256-eb87-49b4-9f77-326cf2eabc4e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:23.815609 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5148256-eb87-49b4-9f77-326cf2eabc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:23.815609 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5148256-eb87-49b4-9f77-326cf2eabc4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:23.945920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5148256-eb87-49b4-9f77-326cf2eabc4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:23.947433 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5148256-eb87-49b4-9f77-326cf2eabc4e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:23.963274 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6438a-56f0-4586-ba60-a3eb01adb30d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:24.003320 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:24.020415 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde553b2-59b9-4a07-a69f-1da0ebe260a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:24.021132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde553b2-59b9-4a07-a69f-1da0ebe260a7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:24.021425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde553b2-59b9-4a07-a69f-1da0ebe260a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:24.021701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde553b2-59b9-4a07-a69f-1da0ebe260a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:24.022470 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde553b2-59b9-4a07-a69f-1da0ebe260a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:24.023980 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde553b2-59b9-4a07-a69f-1da0ebe260a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:24.025233 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde553b2-59b9-4a07-a69f-1da0ebe260a7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:24.043058 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 180/370] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:24.043954 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde553b2-59b9-4a07-a69f-1da0ebe260a7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:24.153655 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 191/371] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:24.154847 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5148256-eb87-49b4-9f77-326cf2eabc4e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:24.164920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:24.169460 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde553b2-59b9-4a07-a69f-1da0ebe260a7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:24.207325 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7905de-8c10-4d20-b861-f5e0669504db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:24.207325 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7905de-8c10-4d20-b861-f5e0669504db None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:24.207325 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7905de-8c10-4d20-b861-f5e0669504db None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:24.207325 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7905de-8c10-4d20-b861-f5e0669504db None admin] PATH_INFO: `/v3/users/04c84f4afa1a4e839ba00605a03eed6e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:24.207744 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7905de-8c10-4d20-b861-f5e0669504db None admin] RBAC: Authorizing `identity:get_user(user_id=04c84f4afa1a4e839ba00605a03eed6e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:24.209500 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7905de-8c10-4d20-b861-f5e0669504db None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:24.211548 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 181/372] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:58:24 2022] GET /identity/v3/users/04c84f4afa1a4e839ba00605a03eed6e => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:24.212252 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7905de-8c10-4d20-b861-f5e0669504db None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:24.278354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:24.338014 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5148256-eb87-49b4-9f77-326cf2eabc4e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:24.360631 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7905de-8c10-4d20-b861-f5e0669504db None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:24.392285 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39f349-111b-49d9-b4db-16ac82d39009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:24.392973 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39f349-111b-49d9-b4db-16ac82d39009 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:24.393259 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39f349-111b-49d9-b4db-16ac82d39009 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:24.393538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39f349-111b-49d9-b4db-16ac82d39009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:24.428154 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15804e-b5e5-4b75-8545-8fa9a3543268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:24.429065 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15804e-b5e5-4b75-8545-8fa9a3543268 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:24.429519 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15804e-b5e5-4b75-8545-8fa9a3543268 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:24.429962 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15804e-b5e5-4b75-8545-8fa9a3543268 None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:24.436292 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15804e-b5e5-4b75-8545-8fa9a3543268 None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:24.438171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db15804e-b5e5-4b75-8545-8fa9a3543268 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:24.440647 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 182/373] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:24 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:24.441745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15804e-b5e5-4b75-8545-8fa9a3543268 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:24.499316 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39f349-111b-49d9-b4db-16ac82d39009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:24.501277 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39f349-111b-49d9-b4db-16ac82d39009 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:24.504146 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:24.626948 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db15804e-b5e5-4b75-8545-8fa9a3543268 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:24.652684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:24.665026 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 192/374] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:24.666008 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39f349-111b-49d9-b4db-16ac82d39009 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:24.668303 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c12159-29f5-4b39-aa32-71054d058038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:24.668984 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c12159-29f5-4b39-aa32-71054d058038 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:24.669319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c12159-29f5-4b39-aa32-71054d058038 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:24.669604 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c12159-29f5-4b39-aa32-71054d058038 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:24.670461 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c12159-29f5-4b39-aa32-71054d058038 None admin] RBAC: Adding query filter params (role.id=ac3cef1fcb1744de989fa7f25e7de7b4, user.id=04c84f4afa1a4e839ba00605a03eed6e, scope.system=all) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:24.670784 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c12159-29f5-4b39-aa32-71054d058038 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:24.672460 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c12159-29f5-4b39-aa32-71054d058038 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:24.686561 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 183/375] 10.222.0.42 () {56 vars in 1308 bytes} [Sun Jul 24 00:58:24 2022] GET /identity/v3/role_assignments?user.id=04c84f4afa1a4e839ba00605a03eed6e&scope.system=all&role.id=ac3cef1fcb1744de989fa7f25e7de7b4 => generated 510 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:24.687427 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c12159-29f5-4b39-aa32-71054d058038 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:24.857323 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39f349-111b-49d9-b4db-16ac82d39009 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:24.860640 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:24.894889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c12159-29f5-4b39-aa32-71054d058038 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:24.916946 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd25b6b-f188-498d-ae38-b0d6f659c038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:24.917888 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd25b6b-f188-498d-ae38-b0d6f659c038 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:24.918144 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd25b6b-f188-498d-ae38-b0d6f659c038 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:24.918417 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd25b6b-f188-498d-ae38-b0d6f659c038 None admin] PATH_INFO: `/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:24.924140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd25b6b-f188-498d-ae38-b0d6f659c038 None admin] RBAC: Authorizing `identity:get_group(group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:24.925632 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd25b6b-f188-498d-ae38-b0d6f659c038 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:24.927776 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 193/376] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Jul 24 00:58:24 2022] GET /identity/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:24.944824 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd25b6b-f188-498d-ae38-b0d6f659c038 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:24.957356 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3e6ce-35cd-49ee-9f60-564254b53640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:24.958251 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3e6ce-35cd-49ee-9f60-564254b53640 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:24.958535 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3e6ce-35cd-49ee-9f60-564254b53640 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:24.958806 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3e6ce-35cd-49ee-9f60-564254b53640 None admin] PATH_INFO: `/v3/projects/05a6eda2714c497da6528545bd5b3ebc` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:24.964151 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3e6ce-35cd-49ee-9f60-564254b53640 None admin] RBAC: Authorizing `identity:get_project(project_id=05a6eda2714c497da6528545bd5b3ebc)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:24.965865 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a3e6ce-35cd-49ee-9f60-564254b53640 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:24.968114 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 184/377] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:24 2022] GET /identity/v3/projects/05a6eda2714c497da6528545bd5b3ebc => generated 344 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:24.973187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3e6ce-35cd-49ee-9f60-564254b53640 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:25.035701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:25.081827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd25b6b-f188-498d-ae38-b0d6f659c038 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:25.111827 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3e6ce-35cd-49ee-9f60-564254b53640 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:25.132471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2e4f3-72f6-4d38-9dff-dedfed0c5fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:25.133155 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2e4f3-72f6-4d38-9dff-dedfed0c5fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:25.133440 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2e4f3-72f6-4d38-9dff-dedfed0c5fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:25.133713 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd2e4f3-72f6-4d38-9dff-dedfed0c5fe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:25.134640 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2e4f3-72f6-4d38-9dff-dedfed0c5fe9 None admin] RBAC: Adding query filter params (group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e, role.id=e7e71ae9fccc4607808005a2e261bab1, scope.project.id=60e98823de624a7fa1c311b6f19b75a3) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:25.134957 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2e4f3-72f6-4d38-9dff-dedfed0c5fe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:25.136478 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd2e4f3-72f6-4d38-9dff-dedfed0c5fe9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:25.146432 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 194/378] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Jul 24 00:58:24 2022] GET /identity/v3/role_assignments?group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e&scope.project.id=60e98823de624a7fa1c311b6f19b75a3&role.id=e7e71ae9fccc4607808005a2e261bab1 => generated 260 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:25.178100 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25842252-9880-42db-8060-5e5ec4b85ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:25.179019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25842252-9880-42db-8060-5e5ec4b85ecc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:25.179338 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25842252-9880-42db-8060-5e5ec4b85ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:25.183834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25842252-9880-42db-8060-5e5ec4b85ecc None admin] PATH_INFO: `/v3/groups/7bdd9aeba62d400a9484db6d706471d5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:25.196952 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25842252-9880-42db-8060-5e5ec4b85ecc None admin] RBAC: Authorizing `identity:get_group(group_id=7bdd9aeba62d400a9484db6d706471d5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:25.198482 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25842252-9880-42db-8060-5e5ec4b85ecc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:25.200659 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 185/379] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Jul 24 00:58:24 2022] GET /identity/v3/groups/7bdd9aeba62d400a9484db6d706471d5 => generated 229 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:25.206355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2e4f3-72f6-4d38-9dff-dedfed0c5fe9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:25.245164 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:25.318952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd2e4f3-72f6-4d38-9dff-dedfed0c5fe9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:25.356123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0b929f-d082-4da9-950b-cfbeb070f099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:25.356809 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b929f-d082-4da9-950b-cfbeb070f099 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:25.357096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b929f-d082-4da9-950b-cfbeb070f099 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:25.357368 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0b929f-d082-4da9-950b-cfbeb070f099 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:25.359574 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b929f-d082-4da9-950b-cfbeb070f099 None admin] RBAC: Adding query filter params (group.id=7bdd9aeba62d400a9484db6d706471d5, role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=05a6eda2714c497da6528545bd5b3ebc) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:25.359574 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b929f-d082-4da9-950b-cfbeb070f099 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:25.360049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0b929f-d082-4da9-950b-cfbeb070f099 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:25.366430 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 195/380] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Jul 24 00:58:25 2022] GET /identity/v3/role_assignments?group.id=7bdd9aeba62d400a9484db6d706471d5&scope.project.id=05a6eda2714c497da6528545bd5b3ebc&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:25.579365 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297970f-959b-4f02-ad25-4369d0a13e58 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:25.579762 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297970f-959b-4f02-ad25-4369d0a13e58 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:25.579945 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297970f-959b-4f02-ad25-4369d0a13e58 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:25.581577 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 186/381] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:25.587142 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545fd0-fc27-4433-b472-7229ea2228ee None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:25.587781 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545fd0-fc27-4433-b472-7229ea2228ee None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:25.587868 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77545fd0-fc27-4433-b472-7229ea2228ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:25.616365 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-77545fd0-fc27-4433-b472-7229ea2228ee None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:25.617595 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-77545fd0-fc27-4433-b472-7229ea2228ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:25.695250 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 196/382] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:58:25.734523 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297970f-959b-4f02-ad25-4369d0a13e58 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:25.853684 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e6a84-c522-4a8e-8c3c-6ef142847c93 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:25.853971 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e6a84-c522-4a8e-8c3c-6ef142847c93 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:25.854162 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45e6a84-c522-4a8e-8c3c-6ef142847c93 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:25.856471 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 197/383] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:25.863141 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f5eb0-2e62-4cef-9b4b-65003e98ed77 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:25.863444 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f5eb0-2e62-4cef-9b4b-65003e98ed77 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:25.863729 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0f5eb0-2e62-4cef-9b4b-65003e98ed77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:25.891328 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4d0f5eb0-2e62-4cef-9b4b-65003e98ed77 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:25.891328 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4d0f5eb0-2e62-4cef-9b4b-65003e98ed77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:25.913901 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297970f-959b-4f02-ad25-4369d0a13e58 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:25.928245 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:25.930094 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:25.977619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535a800-8d3c-4e65-9994-12ea2e44d2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:25.978984 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535a800-8d3c-4e65-9994-12ea2e44d2db None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:25.979512 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535a800-8d3c-4e65-9994-12ea2e44d2db None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:25.980006 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535a800-8d3c-4e65-9994-12ea2e44d2db None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:25.999776 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535a800-8d3c-4e65-9994-12ea2e44d2db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:26.010848 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 198/384] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9535a800-8d3c-4e65-9994-12ea2e44d2db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:26.011148 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:26.012081 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:26.013254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:26.013254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:26.013254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:26.013254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:26.013254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:26.013254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:26.013254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:26.013254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:26.013254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:26.013254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:26.013254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:26.013254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:26.016717 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 187/385] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:26.022498 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f5eb0-2e62-4cef-9b4b-65003e98ed77 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:26.055529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535a800-8d3c-4e65-9994-12ea2e44d2db None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:26.209504 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0f5eb0-2e62-4cef-9b4b-65003e98ed77 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:26.215067 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535a800-8d3c-4e65-9994-12ea2e44d2db None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:26.257293 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f973d-aeb2-438a-9bbf-4fe8911a3dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:26.258494 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f973d-aeb2-438a-9bbf-4fe8911a3dc9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:26.258776 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f973d-aeb2-438a-9bbf-4fe8911a3dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:26.259057 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f973d-aeb2-438a-9bbf-4fe8911a3dc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:26.275504 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f973d-aeb2-438a-9bbf-4fe8911a3dc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-454f973d-aeb2-438a-9bbf-4fe8911a3dc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:26.284440 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:26.285359 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:26.286597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:26.286597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:26.286597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:26.286597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:26.286597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:26.286597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:26.286597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:26.286597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:26.286597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:26.286597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:26.286597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:26.286597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:26.286597 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 188/386] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:26.292202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f89ab9-a05d-4f74-ab8a-1c48a06ea92c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:26.292548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f89ab9-a05d-4f74-ab8a-1c48a06ea92c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:26.292823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f89ab9-a05d-4f74-ab8a-1c48a06ea92c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:26.294747 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 189/387] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:26.295471 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f89ab9-a05d-4f74-ab8a-1c48a06ea92c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:26.300064 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a14f80-9db1-4105-b5be-8c680b65de15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:26.300763 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a14f80-9db1-4105-b5be-8c680b65de15 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:26.301162 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a14f80-9db1-4105-b5be-8c680b65de15 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:26.301443 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a14f80-9db1-4105-b5be-8c680b65de15 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:26.302200 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a14f80-9db1-4105-b5be-8c680b65de15 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:26.302504 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a14f80-9db1-4105-b5be-8c680b65de15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:26.304025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a14f80-9db1-4105-b5be-8c680b65de15 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:26.313067 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 199/388] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:26.314321 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b5558-489e-44b1-a5f6-5478e2f80d9b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:26.314606 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b5558-489e-44b1-a5f6-5478e2f80d9b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:26.314877 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b5558-489e-44b1-a5f6-5478e2f80d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:26.332296 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:26.336287 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6b1b5558-489e-44b1-a5f6-5478e2f80d9b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:26.337698 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6b1b5558-489e-44b1-a5f6-5478e2f80d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:26.354401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:26.414159 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 200/389] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:26.415526 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b5558-489e-44b1-a5f6-5478e2f80d9b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:26.421413 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f89ab9-a05d-4f74-ab8a-1c48a06ea92c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:26.457333 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d88c9-f030-4a02-9970-f42ad24aec87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:26.458053 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d88c9-f030-4a02-9970-f42ad24aec87 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:26.458339 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d88c9-f030-4a02-9970-f42ad24aec87 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:26.458613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d88c9-f030-4a02-9970-f42ad24aec87 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:26.459791 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d88c9-f030-4a02-9970-f42ad24aec87 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:26.460040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d88c9-f030-4a02-9970-f42ad24aec87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:26.463167 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d88c9-f030-4a02-9970-f42ad24aec87 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:26.472799 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 190/390] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:26.473621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d88c9-f030-4a02-9970-f42ad24aec87 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:26.523442 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b5558-489e-44b1-a5f6-5478e2f80d9b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:26.561398 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a7c8a-c1fb-4e53-bea7-5f6f29aa5149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:26.562731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a7c8a-c1fb-4e53-bea7-5f6f29aa5149 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:26.563180 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a7c8a-c1fb-4e53-bea7-5f6f29aa5149 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:26.563648 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a7c8a-c1fb-4e53-bea7-5f6f29aa5149 None admin] PATH_INFO: `/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:26.565139 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a7c8a-c1fb-4e53-bea7-5f6f29aa5149 None admin] RBAC: Authorizing `identity:get_group(group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:26.566864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a7c8a-c1fb-4e53-bea7-5f6f29aa5149 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:26.569663 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 201/391] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Jul 24 00:58:26 2022] GET /identity/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:26.570634 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a7c8a-c1fb-4e53-bea7-5f6f29aa5149 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:26.580652 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:26.590183 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d88c9-f030-4a02-9970-f42ad24aec87 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:26.598620 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:26.629126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732d0fd-a579-4da8-8d46-3d0bfe0ac114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:26.630050 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732d0fd-a579-4da8-8d46-3d0bfe0ac114 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:26.630333 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732d0fd-a579-4da8-8d46-3d0bfe0ac114 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:26.630607 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b732d0fd-a579-4da8-8d46-3d0bfe0ac114 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:26.643794 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b732d0fd-a579-4da8-8d46-3d0bfe0ac114 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-b732d0fd-a579-4da8-8d46-3d0bfe0ac114 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:26.653323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:26.654227 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:26.655020 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:26.655020 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:26.655020 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:26.655020 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:26.655020 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:26.655020 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:26.655020 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:26.655020 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:26.655020 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:26.655020 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:26.655020 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:26.655020 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:26.655020 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 191/392] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:58:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:26.655718 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732d0fd-a579-4da8-8d46-3d0bfe0ac114 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:26.686891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a7c8a-c1fb-4e53-bea7-5f6f29aa5149 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:26.727933 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f34aaf-cc0c-4fba-aff1-5187deafe95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:26.729571 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f34aaf-cc0c-4fba-aff1-5187deafe95b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:26.730102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f34aaf-cc0c-4fba-aff1-5187deafe95b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:26.730570 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f34aaf-cc0c-4fba-aff1-5187deafe95b None admin] PATH_INFO: `/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:26.732091 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f34aaf-cc0c-4fba-aff1-5187deafe95b None admin] RBAC: Authorizing `identity:get_group(group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:26.733991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f34aaf-cc0c-4fba-aff1-5187deafe95b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:26.735983 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 202/393] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Jul 24 00:58:26 2022] GET /identity/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:26.737017 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f34aaf-cc0c-4fba-aff1-5187deafe95b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:26.773317 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b732d0fd-a579-4da8-8d46-3d0bfe0ac114 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:26.815237 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042666a-d966-4e94-a01b-c1aa4b9e73c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:26.815845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042666a-d966-4e94-a01b-c1aa4b9e73c8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:26.816127 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042666a-d966-4e94-a01b-c1aa4b9e73c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:26.816405 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042666a-d966-4e94-a01b-c1aa4b9e73c8 None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:26.817728 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042666a-d966-4e94-a01b-c1aa4b9e73c8 None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:26.819662 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042666a-d966-4e94-a01b-c1aa4b9e73c8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:26.821380 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 192/394] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:26 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:26.829786 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042666a-d966-4e94-a01b-c1aa4b9e73c8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:26.850693 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:26.867371 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:26.873142 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f34aaf-cc0c-4fba-aff1-5187deafe95b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:26.920302 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd48cc8-4d0e-428b-97e5-2c81b2e2d4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:26.921126 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd48cc8-4d0e-428b-97e5-2c81b2e2d4a9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:26.923463 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd48cc8-4d0e-428b-97e5-2c81b2e2d4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:26.923463 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd48cc8-4d0e-428b-97e5-2c81b2e2d4a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:26.923463 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd48cc8-4d0e-428b-97e5-2c81b2e2d4a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:26.923463 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd48cc8-4d0e-428b-97e5-2c81b2e2d4a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:26.925237 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd48cc8-4d0e-428b-97e5-2c81b2e2d4a9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:26.934489 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 203/395] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:26.935467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd48cc8-4d0e-428b-97e5-2c81b2e2d4a9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:26.968384 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042666a-d966-4e94-a01b-c1aa4b9e73c8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:27.004672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458d13f-8d50-4deb-9788-8864f3cef326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:27.005541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458d13f-8d50-4deb-9788-8864f3cef326 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:27.005771 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458d13f-8d50-4deb-9788-8864f3cef326 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:27.006060 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0458d13f-8d50-4deb-9788-8864f3cef326 None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:27.007241 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458d13f-8d50-4deb-9788-8864f3cef326 None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:27.008841 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0458d13f-8d50-4deb-9788-8864f3cef326 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:27.011120 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 193/396] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:26 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:27.011932 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458d13f-8d50-4deb-9788-8864f3cef326 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:27.046460 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd48cc8-4d0e-428b-97e5-2c81b2e2d4a9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:27.082676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d4c6a-5d96-43be-8e66-08a257f302be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:27.084070 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d4c6a-5d96-43be-8e66-08a257f302be None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:27.084594 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d4c6a-5d96-43be-8e66-08a257f302be None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:27.085079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d4c6a-5d96-43be-8e66-08a257f302be None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:27.087611 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d4c6a-5d96-43be-8e66-08a257f302be None admin] RBAC: Authorizing `identity:create_grant(project_id=89fd50ea31554d3f9c9a1d40a0fe059c, group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:27.089276 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8d4c6a-5d96-43be-8e66-08a257f302be None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:27.107690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:27.110385 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 204/397] 10.222.0.42 () {58 vars in 1442 bytes} [Sun Jul 24 00:58:26 2022] PUT /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:58:27.111703 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d4c6a-5d96-43be-8e66-08a257f302be None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:27.126731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:27.131541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0458d13f-8d50-4deb-9788-8864f3cef326 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:27.191095 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3e4dc-aa68-4000-a291-8c8e1ffbf450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:27.192087 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3e4dc-aa68-4000-a291-8c8e1ffbf450 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:27.192378 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3e4dc-aa68-4000-a291-8c8e1ffbf450 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:27.192721 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e3e4dc-aa68-4000-a291-8c8e1ffbf450 None admin] PATH_INFO: `/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:27.197404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3e4dc-aa68-4000-a291-8c8e1ffbf450 None admin] RBAC: Authorizing `identity:get_group(group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:27.199571 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e3e4dc-aa68-4000-a291-8c8e1ffbf450 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:27.201282 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 194/398] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Jul 24 00:58:27 2022] GET /identity/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:27.207057 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3e4dc-aa68-4000-a291-8c8e1ffbf450 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:27.237591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d4c6a-5d96-43be-8e66-08a257f302be None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:27.279008 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a12b1-cd31-4836-8136-bbdeb6db41ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:27.280393 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a12b1-cd31-4836-8136-bbdeb6db41ab None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:27.280887 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a12b1-cd31-4836-8136-bbdeb6db41ab None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:27.281438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a12b1-cd31-4836-8136-bbdeb6db41ab None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:27.285469 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a12b1-cd31-4836-8136-bbdeb6db41ab None admin] RBAC: Authorizing `identity:create_grant(project_id=60e98823de624a7fa1c311b6f19b75a3, group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:27.287315 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17a12b1-cd31-4836-8136-bbdeb6db41ab None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:27.324277 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 205/399] 10.222.0.42 () {58 vars in 1442 bytes} [Sun Jul 24 00:58:27 2022] PUT /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:58:27.349269 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e3e4dc-aa68-4000-a291-8c8e1ffbf450 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:27.389488 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd351da8-0d77-4704-864e-cb703bbea110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:27.390389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd351da8-0d77-4704-864e-cb703bbea110 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:27.390674 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd351da8-0d77-4704-864e-cb703bbea110 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:27.390948 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd351da8-0d77-4704-864e-cb703bbea110 None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:27.394179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd351da8-0d77-4704-864e-cb703bbea110 None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:27.396032 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd351da8-0d77-4704-864e-cb703bbea110 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:27.398607 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 195/400] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:27 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:27.404392 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a12b1-cd31-4836-8136-bbdeb6db41ab None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:27.507724 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:27.538846 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a12b1-cd31-4836-8136-bbdeb6db41ab None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:27.582345 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6e396-9fd9-4fa8-b9ba-7647042ae5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:27.583623 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6e396-9fd9-4fa8-b9ba-7647042ae5c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:27.584113 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6e396-9fd9-4fa8-b9ba-7647042ae5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:27.584586 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6e396-9fd9-4fa8-b9ba-7647042ae5c2 None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e/roles/e7e71ae9fccc4607808005a2e261bab1` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:27.587011 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6e396-9fd9-4fa8-b9ba-7647042ae5c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=89fd50ea31554d3f9c9a1d40a0fe059c, group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e, role_id=e7e71ae9fccc4607808005a2e261bab1)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:27.588911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6e396-9fd9-4fa8-b9ba-7647042ae5c2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:27.609011 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 206/401] 10.222.0.42 () {58 vars in 1442 bytes} [Sun Jul 24 00:58:27 2022] PUT /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e/roles/e7e71ae9fccc4607808005a2e261bab1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:58:27.782667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7e713-0156-476e-8363-a396496c31be None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:27.783193 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7e713-0156-476e-8363-a396496c31be None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:27.783193 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7e713-0156-476e-8363-a396496c31be None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:27.785022 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 196/402] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:27.790851 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701d708-52f0-43c5-8ada-60de0b3eee3b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:27.791394 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701d708-52f0-43c5-8ada-60de0b3eee3b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:27.791864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701d708-52f0-43c5-8ada-60de0b3eee3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:27.820283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-8701d708-52f0-43c5-8ada-60de0b3eee3b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:27.821491 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8701d708-52f0-43c5-8ada-60de0b3eee3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:27.883951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5e5d8-d272-4e16-88b9-b15487d550d0 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:27.884356 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5e5d8-d272-4e16-88b9-b15487d550d0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:27.884581 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d5e5d8-d272-4e16-88b9-b15487d550d0 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:27.886297 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 197/403] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:27.892820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55830e16-86bd-4f75-9bc0-b1b71acff8e1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:27.893099 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55830e16-86bd-4f75-9bc0-b1b71acff8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:27.893380 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55830e16-86bd-4f75-9bc0-b1b71acff8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:27.910778 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 207/404] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:27.919324 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-55830e16-86bd-4f75-9bc0-b1b71acff8e1 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:27.920558 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-55830e16-86bd-4f75-9bc0-b1b71acff8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:27.935966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701d708-52f0-43c5-8ada-60de0b3eee3b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:27.940313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:28.001371 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:28.006561 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 198/405] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:28.034008 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55830e16-86bd-4f75-9bc0-b1b71acff8e1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:28.044713 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8701d708-52f0-43c5-8ada-60de0b3eee3b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:28.081354 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac811f-5a6f-4866-b99d-4b19c85199de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:28.082411 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac811f-5a6f-4866-b99d-4b19c85199de None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:28.082829 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac811f-5a6f-4866-b99d-4b19c85199de None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:28.083237 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ac811f-5a6f-4866-b99d-4b19c85199de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:28.094737 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ac811f-5a6f-4866-b99d-4b19c85199de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-22ac811f-5a6f-4866-b99d-4b19c85199de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:28.103249 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:28.104344 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:28.105315 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:28.105315 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:28.105315 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:28.105315 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:28.105315 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:28.105315 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:28.105315 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:28.105315 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:28.105315 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:28.105315 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:28.105315 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:58:28.105315 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:28.107900 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 208/406] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:58:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:28.113838 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac811f-5a6f-4866-b99d-4b19c85199de None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:28.139452 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55830e16-86bd-4f75-9bc0-b1b71acff8e1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:28.175860 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5840b-7734-40f0-b872-eeab3ed2fe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:28.176708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5840b-7734-40f0-b872-eeab3ed2fe50 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:28.177072 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5840b-7734-40f0-b872-eeab3ed2fe50 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:28.177354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f5840b-7734-40f0-b872-eeab3ed2fe50 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:28.188698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f5840b-7734-40f0-b872-eeab3ed2fe50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-28f5840b-7734-40f0-b872-eeab3ed2fe50 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:28.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:28.199002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:28.200052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:28.200052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:28.200052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:28.200052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:28.200052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:28.200052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:28.200052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:28.200052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:28.200052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:28.200052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:28.200052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:28.200052 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:28.203480 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 199/407] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:58:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:58:28.205514 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5840b-7734-40f0-b872-eeab3ed2fe50 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:28.222390 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:28.225210 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ac811f-5a6f-4866-b99d-4b19c85199de None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:28.247359 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:28.263084 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6691127-f265-45f4-8c81-474137ad4f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:28.264336 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6691127-f265-45f4-8c81-474137ad4f0f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:28.264336 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6691127-f265-45f4-8c81-474137ad4f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:28.264792 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6691127-f265-45f4-8c81-474137ad4f0f None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:28.265662 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6691127-f265-45f4-8c81-474137ad4f0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:28.266073 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6691127-f265-45f4-8c81-474137ad4f0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:28.267685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6691127-f265-45f4-8c81-474137ad4f0f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:28.278773 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 209/408] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:28.283991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6691127-f265-45f4-8c81-474137ad4f0f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:28.313220 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f5840b-7734-40f0-b872-eeab3ed2fe50 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:28.384289 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6691127-f265-45f4-8c81-474137ad4f0f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:28.404056 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16be684-fbf7-4dd8-9888-008ccd3ea571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:28.404760 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16be684-fbf7-4dd8-9888-008ccd3ea571 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:28.405041 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16be684-fbf7-4dd8-9888-008ccd3ea571 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:28.405320 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16be684-fbf7-4dd8-9888-008ccd3ea571 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:28.406084 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16be684-fbf7-4dd8-9888-008ccd3ea571 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:28.406393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16be684-fbf7-4dd8-9888-008ccd3ea571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:28.407982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16be684-fbf7-4dd8-9888-008ccd3ea571 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:28.418990 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b66cc6-c202-420c-8184-ce4dbefc08c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:28.420075 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b66cc6-c202-420c-8184-ce4dbefc08c8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:28.420451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b66cc6-c202-420c-8184-ce4dbefc08c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:28.420873 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b66cc6-c202-420c-8184-ce4dbefc08c8 None admin] PATH_INFO: `/v3/groups/7bdd9aeba62d400a9484db6d706471d5` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:28.422576 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b66cc6-c202-420c-8184-ce4dbefc08c8 None admin] RBAC: Authorizing `identity:get_group(group_id=7bdd9aeba62d400a9484db6d706471d5)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:28.423920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b66cc6-c202-420c-8184-ce4dbefc08c8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:28.425682 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 210/409] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Jul 24 00:58:28 2022] GET /identity/v3/groups/7bdd9aeba62d400a9484db6d706471d5 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:28.431883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b66cc6-c202-420c-8184-ce4dbefc08c8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:28.435399 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 200/410] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:28.441681 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16be684-fbf7-4dd8-9888-008ccd3ea571 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:28.516861 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:28.548929 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:28.569718 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16be684-fbf7-4dd8-9888-008ccd3ea571 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:28.597171 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b66cc6-c202-420c-8184-ce4dbefc08c8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:28.630877 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a13bd-816f-473d-ae48-97e3d9043899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:28.631793 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a13bd-816f-473d-ae48-97e3d9043899 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:28.632076 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a13bd-816f-473d-ae48-97e3d9043899 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:28.632350 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a13bd-816f-473d-ae48-97e3d9043899 None admin] PATH_INFO: `/v3/projects/05a6eda2714c497da6528545bd5b3ebc` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:28.633528 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a13bd-816f-473d-ae48-97e3d9043899 None admin] RBAC: Authorizing `identity:get_project(project_id=05a6eda2714c497da6528545bd5b3ebc)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:28.635073 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a13bd-816f-473d-ae48-97e3d9043899 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:28.637258 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 211/411] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:28 2022] GET /identity/v3/projects/05a6eda2714c497da6528545bd5b3ebc => generated 344 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:28.642874 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a13bd-816f-473d-ae48-97e3d9043899 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:28.676053 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb598a30-308b-4249-b689-5438cc9181a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:28.676949 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb598a30-308b-4249-b689-5438cc9181a3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:28.677233 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb598a30-308b-4249-b689-5438cc9181a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:28.677516 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb598a30-308b-4249-b689-5438cc9181a3 None admin] PATH_INFO: `/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:28.684049 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb598a30-308b-4249-b689-5438cc9181a3 None admin] RBAC: Authorizing `identity:get_group(group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:28.685535 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb598a30-308b-4249-b689-5438cc9181a3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:28.687597 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 201/412] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Jul 24 00:58:28 2022] GET /identity/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:28.696216 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb598a30-308b-4249-b689-5438cc9181a3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:28.746138 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a13bd-816f-473d-ae48-97e3d9043899 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:28.775663 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:28.783902 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1a4ba-088d-4e46-a55f-9da139e67a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:28.784827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1a4ba-088d-4e46-a55f-9da139e67a48 None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:28.785101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1a4ba-088d-4e46-a55f-9da139e67a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:28.785376 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1a4ba-088d-4e46-a55f-9da139e67a48 None admin] PATH_INFO: `/v3/projects/05a6eda2714c497da6528545bd5b3ebc/groups/7bdd9aeba62d400a9484db6d706471d5/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:28.787777 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1a4ba-088d-4e46-a55f-9da139e67a48 None admin] RBAC: Authorizing `identity:create_grant(project_id=05a6eda2714c497da6528545bd5b3ebc, group_id=7bdd9aeba62d400a9484db6d706471d5, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:28.789515 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1a4ba-088d-4e46-a55f-9da139e67a48 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:28.813467 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 212/413] 10.222.0.42 () {58 vars in 1442 bytes} [Sun Jul 24 00:58:28 2022] PUT /identity/v3/projects/05a6eda2714c497da6528545bd5b3ebc/groups/7bdd9aeba62d400a9484db6d706471d5/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 00:58:28.904872 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb598a30-308b-4249-b689-5438cc9181a3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:28.953871 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac013e2-bf79-431b-8002-4945684e4e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:28.954825 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac013e2-bf79-431b-8002-4945684e4e01 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:28.955111 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac013e2-bf79-431b-8002-4945684e4e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:28.955425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac013e2-bf79-431b-8002-4945684e4e01 None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:28.956659 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac013e2-bf79-431b-8002-4945684e4e01 None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:28.958148 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac013e2-bf79-431b-8002-4945684e4e01 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:28.959976 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 202/414] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:28 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:28.966082 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1a4ba-088d-4e46-a55f-9da139e67a48 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:29.073183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1a4ba-088d-4e46-a55f-9da139e67a48 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:29.106695 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422b132e-a559-4e8e-a2f5-18c6034a09cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:29.107629 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b132e-a559-4e8e-a2f5-18c6034a09cd None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:29.107906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b132e-a559-4e8e-a2f5-18c6034a09cd None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:29.108179 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422b132e-a559-4e8e-a2f5-18c6034a09cd None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e/roles/e7e71ae9fccc4607808005a2e261bab1` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:29.110426 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b132e-a559-4e8e-a2f5-18c6034a09cd None admin] RBAC: Authorizing `identity:create_grant(project_id=60e98823de624a7fa1c311b6f19b75a3, group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e, role_id=e7e71ae9fccc4607808005a2e261bab1)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:29.111923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422b132e-a559-4e8e-a2f5-18c6034a09cd None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:29.129034 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 213/415] 10.222.0.42 () {58 vars in 1442 bytes} [Sun Jul 24 00:58:28 2022] PUT /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e/roles/e7e71ae9fccc4607808005a2e261bab1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:58:29.626027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0c8b5-83f4-4558-b024-c1f0c8b60456 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:29.626414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0c8b5-83f4-4558-b024-c1f0c8b60456 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:29.626606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0c8b5-83f4-4558-b024-c1f0c8b60456 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:29.628275 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 203/416] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:29.633835 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f255f33-5c42-4095-be3f-3be462463f1f None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:29.634359 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f255f33-5c42-4095-be3f-3be462463f1f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:29.634452 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f255f33-5c42-4095-be3f-3be462463f1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:29.660326 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7f255f33-5c42-4095-be3f-3be462463f1f None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:29.661600 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7f255f33-5c42-4095-be3f-3be462463f1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:29.705059 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:29.765536 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 214/417] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:58:29.813601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0c8b5-83f4-4558-b024-c1f0c8b60456 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:29.830257 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:29.935014 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0c8b5-83f4-4558-b024-c1f0c8b60456 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:29.969465 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ae8d1-9525-4ef4-be5a-9bec1f495d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:29.970287 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ae8d1-9525-4ef4-be5a-9bec1f495d96 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:29.970572 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ae8d1-9525-4ef4-be5a-9bec1f495d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:29.970849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ae8d1-9525-4ef4-be5a-9bec1f495d96 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:29.981459 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ae8d1-9525-4ef4-be5a-9bec1f495d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-483ae8d1-9525-4ef4-be5a-9bec1f495d96 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:29.989375 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:29.990290 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:29.991521 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:29.991521 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:29.991521 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:29.991521 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:29.991521 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:29.991521 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:29.991521 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:29.991521 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:29.991521 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:29.991521 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:29.991521 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:29.991521 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:29.991521 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 204/418] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:30.000423 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f255f33-5c42-4095-be3f-3be462463f1f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:30.027593 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a429615-448f-48b1-9563-81336811e0ee None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:30.028218 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a429615-448f-48b1-9563-81336811e0ee None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:30.028693 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a429615-448f-48b1-9563-81336811e0ee None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:30.030360 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 205/419] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:30.035659 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce0faa-f104-40b9-a977-1ebc40429df7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:30.036192 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce0faa-f104-40b9-a977-1ebc40429df7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:30.036676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce0faa-f104-40b9-a977-1ebc40429df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:30.058345 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d2ce0faa-f104-40b9-a977-1ebc40429df7 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:30.060508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d2ce0faa-f104-40b9-a977-1ebc40429df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:30.179383 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f255f33-5c42-4095-be3f-3be462463f1f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:30.190123 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 206/420] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:58:30.237242 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce0faa-f104-40b9-a977-1ebc40429df7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:30.239008 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71213a1-da0b-40ff-8033-e78a7943d812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:30.239948 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71213a1-da0b-40ff-8033-e78a7943d812 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:30.240281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:30.240672 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71213a1-da0b-40ff-8033-e78a7943d812 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:30.241142 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71213a1-da0b-40ff-8033-e78a7943d812 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:30.242121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71213a1-da0b-40ff-8033-e78a7943d812 None admin] RBAC: Adding query filter params (name=member) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:30.242637 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71213a1-da0b-40ff-8033-e78a7943d812 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:30.244301 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71213a1-da0b-40ff-8033-e78a7943d812 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:30.261837 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 215/421] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:30.267039 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71213a1-da0b-40ff-8033-e78a7943d812 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:30.329085 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:30.361586 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce0faa-f104-40b9-a977-1ebc40429df7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:30.403911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71213a1-da0b-40ff-8033-e78a7943d812 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:30.404776 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e7207f-bc7b-4b39-bc63-e2ccb67fe228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:30.406045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7207f-bc7b-4b39-bc63-e2ccb67fe228 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:30.406463 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7207f-bc7b-4b39-bc63-e2ccb67fe228 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:30.407574 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e7207f-bc7b-4b39-bc63-e2ccb67fe228 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:30.420308 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e7207f-bc7b-4b39-bc63-e2ccb67fe228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-42e7207f-bc7b-4b39-bc63-e2ccb67fe228 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:30.431044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:30.432091 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:30.433068 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:30.433068 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:30.433068 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:30.433068 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:30.433068 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:30.433068 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:30.433068 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:30.433068 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:30.433068 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:30.433068 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:30.433068 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 24 00:58:30.433068 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:30.435740 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 207/422] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:58:30.437216 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6e61b-d62f-4f9e-87af-975fb660b111 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:30.437686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6e61b-d62f-4f9e-87af-975fb660b111 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:30.438142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6e61b-d62f-4f9e-87af-975fb660b111 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:30.439861 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 208/423] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:30.442726 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6e61b-d62f-4f9e-87af-975fb660b111 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:30.452968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0388f985-0cc5-4a64-8d78-c6cb5ed68900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:30.453648 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388f985-0cc5-4a64-8d78-c6cb5ed68900 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:30.453936 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388f985-0cc5-4a64-8d78-c6cb5ed68900 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:30.454214 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0388f985-0cc5-4a64-8d78-c6cb5ed68900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:30.526734 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388f985-0cc5-4a64-8d78-c6cb5ed68900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:30.527252 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:30.528389 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0388f985-0cc5-4a64-8d78-c6cb5ed68900 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:30.560077 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:30.581249 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6e61b-d62f-4f9e-87af-975fb660b111 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:30.626303 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc30dd9-32cd-4159-be0b-98f798e9db29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:30.627500 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc30dd9-32cd-4159-be0b-98f798e9db29 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:30.628189 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc30dd9-32cd-4159-be0b-98f798e9db29 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:30.628665 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc30dd9-32cd-4159-be0b-98f798e9db29 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:30.630212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc30dd9-32cd-4159-be0b-98f798e9db29 None admin] RBAC: Adding query filter params (name=member) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:30.630708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc30dd9-32cd-4159-be0b-98f798e9db29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:30.633180 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc30dd9-32cd-4159-be0b-98f798e9db29 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:30.636228 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 216/424] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:58:30.637768 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff2815-9657-4158-b891-88ff51973ac8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:30.638129 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff2815-9657-4158-b891-88ff51973ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:30.638478 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff2815-9657-4158-b891-88ff51973ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:30.645230 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 209/425] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:58:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:30.646315 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc30dd9-32cd-4159-be0b-98f798e9db29 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:30.659800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-22ff2815-9657-4158-b891-88ff51973ac8 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:30.661123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-22ff2815-9657-4158-b891-88ff51973ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:30.738557 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 217/426] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:30.739783 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff2815-9657-4158-b891-88ff51973ac8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:30.791195 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc30dd9-32cd-4159-be0b-98f798e9db29 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:30.811213 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:30.828914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:30.841871 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798a850-c20d-440c-a4f0-61ee8963eab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:30.843112 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798a850-c20d-440c-a4f0-61ee8963eab0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:30.843413 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798a850-c20d-440c-a4f0-61ee8963eab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:30.843784 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4798a850-c20d-440c-a4f0-61ee8963eab0 None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:30.845066 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798a850-c20d-440c-a4f0-61ee8963eab0 None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:30.846929 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4798a850-c20d-440c-a4f0-61ee8963eab0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:30.848866 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 210/427] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:30 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:30.849729 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798a850-c20d-440c-a4f0-61ee8963eab0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:30.864528 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff2815-9657-4158-b891-88ff51973ac8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:30.905533 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a997a0-9d65-47e1-afe3-316df670701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:30.906469 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a997a0-9d65-47e1-afe3-316df670701d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:30.906890 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a997a0-9d65-47e1-afe3-316df670701d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:30.907322 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a997a0-9d65-47e1-afe3-316df670701d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:30.957365 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4798a850-c20d-440c-a4f0-61ee8963eab0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:30.990918 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a997a0-9d65-47e1-afe3-316df670701d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:30.992502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a997a0-9d65-47e1-afe3-316df670701d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:30.999733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbde4d-0f0e-460b-9c21-c9415bfa5d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:31.001231 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbde4d-0f0e-460b-9c21-c9415bfa5d8e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:31.001650 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbde4d-0f0e-460b-9c21-c9415bfa5d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:31.002056 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dbde4d-0f0e-460b-9c21-c9415bfa5d8e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:31.016521 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dbde4d-0f0e-460b-9c21-c9415bfa5d8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-13dbde4d-0f0e-460b-9c21-c9415bfa5d8e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:31.027064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:31.028259 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:31.029152 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:31.029152 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:31.029152 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:31.029152 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:31.029152 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:31.029152 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:31.029152 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:31.029152 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:31.029152 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:31.029152 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:31.029152 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:31.029152 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:31.030379 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 211/428] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:58:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:31.031241 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbde4d-0f0e-460b-9c21-c9415bfa5d8e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:31.058924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:31.101197 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:31.107695 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 218/429] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:31.108776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a997a0-9d65-47e1-afe3-316df670701d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:31.155592 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dbde4d-0f0e-460b-9c21-c9415bfa5d8e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:31.190303 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109d2a3-0c87-4638-93d3-68d489a2b199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:31.191258 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109d2a3-0c87-4638-93d3-68d489a2b199 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:31.191639 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109d2a3-0c87-4638-93d3-68d489a2b199 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:31.192008 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109d2a3-0c87-4638-93d3-68d489a2b199 None admin] PATH_INFO: `/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:31.193265 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109d2a3-0c87-4638-93d3-68d489a2b199 None admin] RBAC: Authorizing `identity:get_group(group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:31.195629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109d2a3-0c87-4638-93d3-68d489a2b199 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:31.197133 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 212/430] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Jul 24 00:58:31 2022] GET /identity/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:31.198047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109d2a3-0c87-4638-93d3-68d489a2b199 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:31.238684 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a997a0-9d65-47e1-afe3-316df670701d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:31.273855 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d231f63-4396-448b-a0c3-df14f61d6a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:31.274537 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d231f63-4396-448b-a0c3-df14f61d6a66 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:31.274946 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d231f63-4396-448b-a0c3-df14f61d6a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:31.275308 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d231f63-4396-448b-a0c3-df14f61d6a66 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:31.276152 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d231f63-4396-448b-a0c3-df14f61d6a66 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:31.276523 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d231f63-4396-448b-a0c3-df14f61d6a66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:31.278088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d231f63-4396-448b-a0c3-df14f61d6a66 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:31.287723 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 219/431] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:31.288856 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d231f63-4396-448b-a0c3-df14f61d6a66 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:31.314202 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:31.317587 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109d2a3-0c87-4638-93d3-68d489a2b199 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:31.343529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:31.363331 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2a94-cdce-41ad-a81c-51ea2ec97604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:31.365072 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2a94-cdce-41ad-a81c-51ea2ec97604 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:31.365356 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2a94-cdce-41ad-a81c-51ea2ec97604 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:31.365631 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d2a94-cdce-41ad-a81c-51ea2ec97604 None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:31.366812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d2a94-cdce-41ad-a81c-51ea2ec97604 None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:31.368297 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350d2a94-cdce-41ad-a81c-51ea2ec97604 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:31.370786 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 213/432] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:31 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:31.375481 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2a94-cdce-41ad-a81c-51ea2ec97604 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:31.394327 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d231f63-4396-448b-a0c3-df14f61d6a66 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:31.430204 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c28e31-66da-44c3-96d4-be33ec0ce45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:31.430877 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28e31-66da-44c3-96d4-be33ec0ce45b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:31.431227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28e31-66da-44c3-96d4-be33ec0ce45b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:31.431549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c28e31-66da-44c3-96d4-be33ec0ce45b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:31.432391 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c28e31-66da-44c3-96d4-be33ec0ce45b None admin] RBAC: Adding query filter params (group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e, role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9, scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:31.432711 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c28e31-66da-44c3-96d4-be33ec0ce45b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:31.434165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c28e31-66da-44c3-96d4-be33ec0ce45b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:31.440465 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 220/433] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Jul 24 00:58:31 2022] GET /identity/v3/role_assignments?group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e&scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c&role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:31.445648 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21532e4e-af04-451d-af6f-29f9952c4623 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:31.446159 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21532e4e-af04-451d-af6f-29f9952c4623 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:31.447064 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21532e4e-af04-451d-af6f-29f9952c4623 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:31.448996 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 221/434] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:31.449956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21532e4e-af04-451d-af6f-29f9952c4623 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:31.491379 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d2a94-cdce-41ad-a81c-51ea2ec97604 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:31.541211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69581e7f-9f52-47ec-947d-e4384bf0d45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:31.542150 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69581e7f-9f52-47ec-947d-e4384bf0d45d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:31.542591 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69581e7f-9f52-47ec-947d-e4384bf0d45d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:31.543267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69581e7f-9f52-47ec-947d-e4384bf0d45d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:31.562685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:31.582344 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21532e4e-af04-451d-af6f-29f9952c4623 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:31.624968 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:31.629413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101f42c-7526-490c-ad07-e774a8d62022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:31.629413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101f42c-7526-490c-ad07-e774a8d62022 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:31.629413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101f42c-7526-490c-ad07-e774a8d62022 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:31.629413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101f42c-7526-490c-ad07-e774a8d62022 None admin] PATH_INFO: `/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:31.631014 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101f42c-7526-490c-ad07-e774a8d62022 None admin] RBAC: Authorizing `identity:get_group(group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:31.632827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101f42c-7526-490c-ad07-e774a8d62022 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:31.634805 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 222/435] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Jul 24 00:58:31 2022] GET /identity/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:31.636483 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28844369-7d3d-4830-8f83-461aa7249274 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:31.636483 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28844369-7d3d-4830-8f83-461aa7249274 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:31.637071 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28844369-7d3d-4830-8f83-461aa7249274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:31.645844 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69581e7f-9f52-47ec-947d-e4384bf0d45d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:31.647486 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69581e7f-9f52-47ec-947d-e4384bf0d45d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:31.656188 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-28844369-7d3d-4830-8f83-461aa7249274 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:31.656831 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-28844369-7d3d-4830-8f83-461aa7249274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:31.744949 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 223/436] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:31.745965 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28844369-7d3d-4830-8f83-461aa7249274 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:31.773818 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 214/437] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:31.775316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb8ea2-5d5d-4ef2-b6c8-ff44edcc932f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:31.775684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb8ea2-5d5d-4ef2-b6c8-ff44edcc932f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:31.776037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb8ea2-5d5d-4ef2-b6c8-ff44edcc932f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:31.777550 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 215/438] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:31.778149 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb8ea2-5d5d-4ef2-b6c8-ff44edcc932f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:31.847288 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:31.868680 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28844369-7d3d-4830-8f83-461aa7249274 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:31.891341 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:31.902429 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8e903-ffcb-401d-9856-4e129290c42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:31.903102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8e903-ffcb-401d-9856-4e129290c42e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:31.903424 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8e903-ffcb-401d-9856-4e129290c42e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:31.903704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de8e903-ffcb-401d-9856-4e129290c42e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:31.904490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb8ea2-5d5d-4ef2-b6c8-ff44edcc932f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:31.904590 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8e903-ffcb-401d-9856-4e129290c42e None admin] RBAC: Adding query filter params (group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e, role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9, scope.project.id=60e98823de624a7fa1c311b6f19b75a3) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:31.904843 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8e903-ffcb-401d-9856-4e129290c42e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:31.906319 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de8e903-ffcb-401d-9856-4e129290c42e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:31.912027 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 224/439] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Jul 24 00:58:31 2022] GET /identity/v3/role_assignments?group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e&scope.project.id=60e98823de624a7fa1c311b6f19b75a3&role.id=04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:31.912796 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8e903-ffcb-401d-9856-4e129290c42e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:31.951886 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dba4b1f-89fd-4fef-8cb9-b0564ab303a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:31.952837 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba4b1f-89fd-4fef-8cb9-b0564ab303a5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:31.953175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba4b1f-89fd-4fef-8cb9-b0564ab303a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:31.953511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dba4b1f-89fd-4fef-8cb9-b0564ab303a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:31.965667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dba4b1f-89fd-4fef-8cb9-b0564ab303a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-7dba4b1f-89fd-4fef-8cb9-b0564ab303a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:31.973700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:31.974872 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:31.980973 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:31.980973 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:31.980973 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:31.980973 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:31.980973 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:31.980973 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:31.980973 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:31.980973 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:31.980973 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:31.980973 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:31.980973 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:58:31.980973 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:31.980973 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 216/440] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:58:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:31.980973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02906c0-0a8a-45a2-99ae-ebe0fdccc615 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:31.981848 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02906c0-0a8a-45a2-99ae-ebe0fdccc615 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:31.981848 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02906c0-0a8a-45a2-99ae-ebe0fdccc615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:31.994564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b02906c0-0a8a-45a2-99ae-ebe0fdccc615 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:31.995933 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b02906c0-0a8a-45a2-99ae-ebe0fdccc615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:32.034791 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de8e903-ffcb-401d-9856-4e129290c42e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:32.067725 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 217/441] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:32.068586 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02906c0-0a8a-45a2-99ae-ebe0fdccc615 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:32.082542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e60ba0-76cd-4cac-b072-451305cd210c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:32.083634 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e60ba0-76cd-4cac-b072-451305cd210c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:32.084051 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e60ba0-76cd-4cac-b072-451305cd210c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:32.084392 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e60ba0-76cd-4cac-b072-451305cd210c None admin] PATH_INFO: `/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:32.086542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e60ba0-76cd-4cac-b072-451305cd210c None admin] RBAC: Authorizing `identity:get_project(project_id=89fd50ea31554d3f9c9a1d40a0fe059c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:32.088300 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e60ba0-76cd-4cac-b072-451305cd210c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:32.091942 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 225/442] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:31 2022] GET /identity/v3/projects/89fd50ea31554d3f9c9a1d40a0fe059c => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:32.091942 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e60ba0-76cd-4cac-b072-451305cd210c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:32.112347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:32.161126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:32.182557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02906c0-0a8a-45a2-99ae-ebe0fdccc615 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:32.197663 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e60ba0-76cd-4cac-b072-451305cd210c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:32.215605 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a162a-f410-48ba-bd2c-7d962630534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:32.216282 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a162a-f410-48ba-bd2c-7d962630534b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:32.216568 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a162a-f410-48ba-bd2c-7d962630534b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:32.216842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829a162a-f410-48ba-bd2c-7d962630534b None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:32.217589 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a162a-f410-48ba-bd2c-7d962630534b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:32.217902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a162a-f410-48ba-bd2c-7d962630534b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:32.219340 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829a162a-f410-48ba-bd2c-7d962630534b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:32.227184 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 218/443] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:32.228031 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a162a-f410-48ba-bd2c-7d962630534b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:32.234411 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764ed61-7805-478d-9865-d8f75a256b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:32.235244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764ed61-7805-478d-9865-d8f75a256b21 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:32.235556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764ed61-7805-478d-9865-d8f75a256b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:32.235827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6764ed61-7805-478d-9865-d8f75a256b21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:32.246133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6764ed61-7805-478d-9865-d8f75a256b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-6764ed61-7805-478d-9865-d8f75a256b21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:32.254265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:32.255224 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:32.256456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:32.256456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:32.256456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:32.256456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:32.256456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:32.256456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:32.256456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:32.256456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:32.256456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:32.256456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:32.256456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:32.256456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:32.256456 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 226/444] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:58:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:58:32.256456 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764ed61-7805-478d-9865-d8f75a256b21 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:32.331047 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:32.337393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829a162a-f410-48ba-bd2c-7d962630534b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:32.353409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6764ed61-7805-478d-9865-d8f75a256b21 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:32.369543 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa0d25-02c4-48a7-bd88-c8d30fb748c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:32.370464 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0d25-02c4-48a7-bd88-c8d30fb748c0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:32.370745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0d25-02c4-48a7-bd88-c8d30fb748c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:32.371019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0d25-02c4-48a7-bd88-c8d30fb748c0 None admin] PATH_INFO: `/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:32.372253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa0d25-02c4-48a7-bd88-c8d30fb748c0 None admin] RBAC: Authorizing `identity:get_group(group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:32.373720 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa0d25-02c4-48a7-bd88-c8d30fb748c0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:32.375360 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 219/445] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Jul 24 00:58:32 2022] GET /identity/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:32.376112 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa0d25-02c4-48a7-bd88-c8d30fb748c0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:32.387172 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804ac96-17f8-43ac-93c3-5292aeca60bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:32.387363 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:32.387850 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804ac96-17f8-43ac-93c3-5292aeca60bf None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:32.388135 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804ac96-17f8-43ac-93c3-5292aeca60bf None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:32.388422 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804ac96-17f8-43ac-93c3-5292aeca60bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:32.454047 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804ac96-17f8-43ac-93c3-5292aeca60bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:32.455650 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804ac96-17f8-43ac-93c3-5292aeca60bf None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:32.473005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa0d25-02c4-48a7-bd88-c8d30fb748c0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:32.507319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd504d-b477-467c-a3c1-bbce69ea2cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:32.507999 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd504d-b477-467c-a3c1-bbce69ea2cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:32.508279 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd504d-b477-467c-a3c1-bbce69ea2cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:32.508552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd504d-b477-467c-a3c1-bbce69ea2cf5 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:32.509415 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd504d-b477-467c-a3c1-bbce69ea2cf5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:32.509726 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd504d-b477-467c-a3c1-bbce69ea2cf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:32.511110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd504d-b477-467c-a3c1-bbce69ea2cf5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:32.519608 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 220/446] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:32.520228 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd504d-b477-467c-a3c1-bbce69ea2cf5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:32.533632 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:32.556786 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 227/447] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:32.557597 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804ac96-17f8-43ac-93c3-5292aeca60bf None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:32.587287 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:32.616957 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd504d-b477-467c-a3c1-bbce69ea2cf5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:32.650053 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc15820-d1c5-4df9-9658-c7b3e5f5cfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:32.650698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc15820-d1c5-4df9-9658-c7b3e5f5cfdb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:32.650979 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc15820-d1c5-4df9-9658-c7b3e5f5cfdb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:32.651277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc15820-d1c5-4df9-9658-c7b3e5f5cfdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:32.652129 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc15820-d1c5-4df9-9658-c7b3e5f5cfdb None admin] RBAC: Adding query filter params (group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e, role.id=e7e71ae9fccc4607808005a2e261bab1, scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:32.652437 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc15820-d1c5-4df9-9658-c7b3e5f5cfdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:32.653870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc15820-d1c5-4df9-9658-c7b3e5f5cfdb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:32.653975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804ac96-17f8-43ac-93c3-5292aeca60bf None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:32.659520 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 221/448] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Jul 24 00:58:32 2022] GET /identity/v3/role_assignments?group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e&scope.project.id=89fd50ea31554d3f9c9a1d40a0fe059c&role.id=e7e71ae9fccc4607808005a2e261bab1 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:32.660286 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc15820-d1c5-4df9-9658-c7b3e5f5cfdb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:32.689355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb828b-8b24-410e-b224-67b36b378ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:32.690034 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb828b-8b24-410e-b224-67b36b378ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:32.690317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb828b-8b24-410e-b224-67b36b378ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:32.690593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb828b-8b24-410e-b224-67b36b378ee8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:32.739601 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:32.764956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb828b-8b24-410e-b224-67b36b378ee8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:32.766464 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bb828b-8b24-410e-b224-67b36b378ee8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:32.783218 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc15820-d1c5-4df9-9658-c7b3e5f5cfdb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:32.830314 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750db5d-9258-43d6-bbbb-aecfd31e0af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:32.831208 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750db5d-9258-43d6-bbbb-aecfd31e0af1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:32.831527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750db5d-9258-43d6-bbbb-aecfd31e0af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:32.831802 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750db5d-9258-43d6-bbbb-aecfd31e0af1 None admin] PATH_INFO: `/v3/projects/05a6eda2714c497da6528545bd5b3ebc` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:32.833021 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750db5d-9258-43d6-bbbb-aecfd31e0af1 None admin] RBAC: Authorizing `identity:get_project(project_id=05a6eda2714c497da6528545bd5b3ebc)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:32.835191 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f750db5d-9258-43d6-bbbb-aecfd31e0af1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:32.836409 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 222/449] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:32 2022] GET /identity/v3/projects/05a6eda2714c497da6528545bd5b3ebc => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:32.843966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750db5d-9258-43d6-bbbb-aecfd31e0af1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:32.846643 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:32.882599 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 228/450] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:32.888915 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb828b-8b24-410e-b224-67b36b378ee8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:32.959772 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750db5d-9258-43d6-bbbb-aecfd31e0af1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:32.976322 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:32.997005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a45672-a532-4e9a-85c6-136da1440ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:32.998025 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a45672-a532-4e9a-85c6-136da1440ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:32.998142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a45672-a532-4e9a-85c6-136da1440ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:32.998394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a45672-a532-4e9a-85c6-136da1440ad3 None admin] PATH_INFO: `/v3/groups/7bdd9aeba62d400a9484db6d706471d5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:32.999599 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a45672-a532-4e9a-85c6-136da1440ad3 None admin] RBAC: Authorizing `identity:get_group(group_id=7bdd9aeba62d400a9484db6d706471d5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:33.001059 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a45672-a532-4e9a-85c6-136da1440ad3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:33.002936 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 223/451] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Jul 24 00:58:32 2022] GET /identity/v3/groups/7bdd9aeba62d400a9484db6d706471d5 => generated 229 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:33.007267 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb828b-8b24-410e-b224-67b36b378ee8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:33.009279 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a45672-a532-4e9a-85c6-136da1440ad3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:33.048935 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71e882-c902-436d-a45b-a5b1fdc81757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:33.050125 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71e882-c902-436d-a45b-a5b1fdc81757 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:33.050560 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71e882-c902-436d-a45b-a5b1fdc81757 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:33.050836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e71e882-c902-436d-a45b-a5b1fdc81757 None admin] PATH_INFO: `/v3/projects/60e98823de624a7fa1c311b6f19b75a3` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:33.052080 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71e882-c902-436d-a45b-a5b1fdc81757 None admin] RBAC: Authorizing `identity:get_project(project_id=60e98823de624a7fa1c311b6f19b75a3)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:33.053881 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e71e882-c902-436d-a45b-a5b1fdc81757 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:33.055731 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 229/452] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:58:32 2022] GET /identity/v3/projects/60e98823de624a7fa1c311b6f19b75a3 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:33.061098 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71e882-c902-436d-a45b-a5b1fdc81757 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:33.080740 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:33.114176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a45672-a532-4e9a-85c6-136da1440ad3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:33.158500 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b085c4-59d0-41c7-b9aa-d5dc196c9677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:33.159279 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b085c4-59d0-41c7-b9aa-d5dc196c9677 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:33.159609 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b085c4-59d0-41c7-b9aa-d5dc196c9677 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:33.160343 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b085c4-59d0-41c7-b9aa-d5dc196c9677 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:33.160721 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b085c4-59d0-41c7-b9aa-d5dc196c9677 None admin] RBAC: Adding query filter params (group.id=7bdd9aeba62d400a9484db6d706471d5, role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=05a6eda2714c497da6528545bd5b3ebc) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:33.161035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b085c4-59d0-41c7-b9aa-d5dc196c9677 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:33.162540 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b085c4-59d0-41c7-b9aa-d5dc196c9677 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:33.169362 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 224/453] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Jul 24 00:58:33 2022] GET /identity/v3/role_assignments?group.id=7bdd9aeba62d400a9484db6d706471d5&scope.project.id=05a6eda2714c497da6528545bd5b3ebc&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:33.177121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e71e882-c902-436d-a45b-a5b1fdc81757 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:33.213966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7886f6-4d3b-4cc4-8322-44c99db3ba12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:33.214861 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7886f6-4d3b-4cc4-8322-44c99db3ba12 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:33.215136 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7886f6-4d3b-4cc4-8322-44c99db3ba12 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:33.215453 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7886f6-4d3b-4cc4-8322-44c99db3ba12 None admin] PATH_INFO: `/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:33.216696 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7886f6-4d3b-4cc4-8322-44c99db3ba12 None admin] RBAC: Authorizing `identity:get_group(group_id=02bd74dcdb764e2d8d4a6a9ae36eae8e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:33.218187 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7886f6-4d3b-4cc4-8322-44c99db3ba12 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:33.219994 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 230/454] 10.222.0.42 () {56 vars in 1180 bytes} [Sun Jul 24 00:58:33 2022] GET /identity/v3/groups/02bd74dcdb764e2d8d4a6a9ae36eae8e => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:33.226283 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b085c4-59d0-41c7-b9aa-d5dc196c9677 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:33.334862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b085c4-59d0-41c7-b9aa-d5dc196c9677 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:33.370913 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ae5dc4-9d05-4da3-a1d2-2d2bcd19b236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:33.371534 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae5dc4-9d05-4da3-a1d2-2d2bcd19b236 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:33.371818 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae5dc4-9d05-4da3-a1d2-2d2bcd19b236 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:33.372098 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ae5dc4-9d05-4da3-a1d2-2d2bcd19b236 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:33.372928 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae5dc4-9d05-4da3-a1d2-2d2bcd19b236 None admin] RBAC: Adding query filter params (group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e, role.id=e7e71ae9fccc4607808005a2e261bab1, scope.project.id=60e98823de624a7fa1c311b6f19b75a3) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:33.373264 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae5dc4-9d05-4da3-a1d2-2d2bcd19b236 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:33.374720 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ae5dc4-9d05-4da3-a1d2-2d2bcd19b236 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:33.376623 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:33.381362 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 225/455] 10.222.0.42 () {56 vars in 1376 bytes} [Sun Jul 24 00:58:33 2022] GET /identity/v3/role_assignments?group.id=02bd74dcdb764e2d8d4a6a9ae36eae8e&scope.project.id=60e98823de624a7fa1c311b6f19b75a3&role.id=e7e71ae9fccc4607808005a2e261bab1 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:35.911085 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378479a9-43e1-4264-bacc-87a184031c59 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:35.911657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378479a9-43e1-4264-bacc-87a184031c59 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:35.911657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378479a9-43e1-4264-bacc-87a184031c59 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:35.913293 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 231/456] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:35.918698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190d7ba-3ad0-4d89-ac78-a375b9b7ced9 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:35.919106 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190d7ba-3ad0-4d89-ac78-a375b9b7ced9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:35.919250 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a190d7ba-3ad0-4d89-ac78-a375b9b7ced9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:35.944658 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a190d7ba-3ad0-4d89-ac78-a375b9b7ced9 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:35.946134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a190d7ba-3ad0-4d89-ac78-a375b9b7ced9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:36.025968 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 226/457] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:36.065067 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378479a9-43e1-4264-bacc-87a184031c59 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:36.089391 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:36.223147 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378479a9-43e1-4264-bacc-87a184031c59 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:36.270980 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d4f5a6-f479-4734-a17f-3402182d6af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:36.271827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4f5a6-f479-4734-a17f-3402182d6af7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.272108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4f5a6-f479-4734-a17f-3402182d6af7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.272381 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d4f5a6-f479-4734-a17f-3402182d6af7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.287745 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4f5a6-f479-4734-a17f-3402182d6af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:36.289215 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d4f5a6-f479-4734-a17f-3402182d6af7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:36.307708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d0d4f5a6-f479-4734-a17f-3402182d6af7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:36.307708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:36.307708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:36.307708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:36.307708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:36.307708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:36.307708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:36.307708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:36.307708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:36.307708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:36.307708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:36.307708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:36.307708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:36.307708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:36.307708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:36.308647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:36.309497 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:36.309497 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:36.309497 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:36.309497 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:36.309497 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 232/458] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:36.315135 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190d7ba-3ad0-4d89-ac78-a375b9b7ced9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:36.444711 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a190d7ba-3ad0-4d89-ac78-a375b9b7ced9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:36.464438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da136c-e010-4c65-8015-0e7cecb6bdf7 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.464756 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da136c-e010-4c65-8015-0e7cecb6bdf7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.465001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da136c-e010-4c65-8015-0e7cecb6bdf7 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.467421 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 233/459] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:36.471244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830034bb-e786-4000-a4b5-4a672bc58c86 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.471564 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830034bb-e786-4000-a4b5-4a672bc58c86 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.472075 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830034bb-e786-4000-a4b5-4a672bc58c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.472499 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:36.489813 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b54c9e-708d-4f9c-b4b6-04f0aedd2fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:36.490582 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b54c9e-708d-4f9c-b4b6-04f0aedd2fca None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.490870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b54c9e-708d-4f9c-b4b6-04f0aedd2fca None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.491145 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b54c9e-708d-4f9c-b4b6-04f0aedd2fca None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.491905 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b54c9e-708d-4f9c-b4b6-04f0aedd2fca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:36.492213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b54c9e-708d-4f9c-b4b6-04f0aedd2fca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:36.492525 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-830034bb-e786-4000-a4b5-4a672bc58c86 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:36.493736 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b54c9e-708d-4f9c-b4b6-04f0aedd2fca None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:36.494174 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-830034bb-e786-4000-a4b5-4a672bc58c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:36.516220 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 227/460] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:36.529911 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b54c9e-708d-4f9c-b4b6-04f0aedd2fca None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:36.613338 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:36.623214 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 234/461] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:36.624517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a57725-bbbf-45b6-8fa7-2ae9965f059a None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.624872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a57725-bbbf-45b6-8fa7-2ae9965f059a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.625231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a57725-bbbf-45b6-8fa7-2ae9965f059a None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.626689 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 235/462] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:36.631555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f38227-73d0-48c5-b8ac-2dea8527b588 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.632108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f38227-73d0-48c5-b8ac-2dea8527b588 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.632584 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f38227-73d0-48c5-b8ac-2dea8527b588 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.634345 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 236/463] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:36.635645 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497a85-a2cd-4a84-af27-1f84f3ce45ab None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.636127 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497a85-a2cd-4a84-af27-1f84f3ce45ab None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.636593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2497a85-a2cd-4a84-af27-1f84f3ce45ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.653482 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a2497a85-a2cd-4a84-af27-1f84f3ce45ab None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:36.654768 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a2497a85-a2cd-4a84-af27-1f84f3ce45ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:36.657175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b54c9e-708d-4f9c-b4b6-04f0aedd2fca None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:36.697000 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca3f2a-8cdb-4da6-ab3b-6f64bf4c35d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:36.697683 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca3f2a-8cdb-4da6-ab3b-6f64bf4c35d3 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.697966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca3f2a-8cdb-4da6-ab3b-6f64bf4c35d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.698242 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca3f2a-8cdb-4da6-ab3b-6f64bf4c35d3 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.698951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca3f2a-8cdb-4da6-ab3b-6f64bf4c35d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:36.700451 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca3f2a-8cdb-4da6-ab3b-6f64bf4c35d3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:36.727386 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 228/464] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 00:58:36 2022] POST /identity/v3/users => generated 246 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:58:36.727386 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74984a-752e-48e5-94b8-7f7704a8f061 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.727386 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74984a-752e-48e5-94b8-7f7704a8f061 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.727386 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf74984a-752e-48e5-94b8-7f7704a8f061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.736281 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 237/465] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:36.737344 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2497a85-a2cd-4a84-af27-1f84f3ce45ab None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:36.753967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-cf74984a-752e-48e5-94b8-7f7704a8f061 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:36.755201 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cf74984a-752e-48e5-94b8-7f7704a8f061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:36.819901 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:36.858686 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 229/466] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:36.859972 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74984a-752e-48e5-94b8-7f7704a8f061 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:36.870254 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2497a85-a2cd-4a84-af27-1f84f3ce45ab None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:36.915743 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:36.921123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027786b9-6748-4abd-97ef-dfec0710524b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:36.922286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027786b9-6748-4abd-97ef-dfec0710524b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:36.922787 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027786b9-6748-4abd-97ef-dfec0710524b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:36.923320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027786b9-6748-4abd-97ef-dfec0710524b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:36.937449 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027786b9-6748-4abd-97ef-dfec0710524b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:36.939339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027786b9-6748-4abd-97ef-dfec0710524b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:36.960531 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-027786b9-6748-4abd-97ef-dfec0710524b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:36.960531 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:36.960531 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:36.960531 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:36.960531 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:36.960531 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:36.960531 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:36.960531 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:36.960531 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:36.960531 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:36.960531 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:36.960531 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:36.960531 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:36.960531 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:36.960531 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:36.961461 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:36.962360 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:36.962360 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:36.962360 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:36.962360 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:36.964744 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 238/467] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:36.965895 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027786b9-6748-4abd-97ef-dfec0710524b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:36.999515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf74984a-752e-48e5-94b8-7f7704a8f061 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:37.039586 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e456c9c-2fe3-4106-b3bb-59a6ab1f5198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:37.040472 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e456c9c-2fe3-4106-b3bb-59a6ab1f5198 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:37.040755 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e456c9c-2fe3-4106-b3bb-59a6ab1f5198 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:37.041032 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e456c9c-2fe3-4106-b3bb-59a6ab1f5198 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:37.054848 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e456c9c-2fe3-4106-b3bb-59a6ab1f5198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:37.056403 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e456c9c-2fe3-4106-b3bb-59a6ab1f5198 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:37.075499 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6e456c9c-2fe3-4106-b3bb-59a6ab1f5198 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:37.075499 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:37.075499 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:37.075499 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:37.075499 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:37.075499 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:37.075499 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:37.075499 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:37.075499 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:37.075499 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:37.075499 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:37.075499 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:37.075499 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:37.075499 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:37.075499 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:37.076438 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:37.077324 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:37.077324 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:37.077324 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:37.077324 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:37.077324 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 230/468] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:37.077819 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e456c9c-2fe3-4106-b3bb-59a6ab1f5198 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:37.097618 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027786b9-6748-4abd-97ef-dfec0710524b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:37.115835 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:37.135564 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97681e-121a-4236-9c5a-4bd3ac24e181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:37.136641 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97681e-121a-4236-9c5a-4bd3ac24e181 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:37.136932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97681e-121a-4236-9c5a-4bd3ac24e181 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:37.137360 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd97681e-121a-4236-9c5a-4bd3ac24e181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:37.151529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97681e-121a-4236-9c5a-4bd3ac24e181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:37.153611 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd97681e-121a-4236-9c5a-4bd3ac24e181 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:37.175561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-cd97681e-121a-4236-9c5a-4bd3ac24e181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:37.175561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:37.175561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:37.175561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:37.175561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:37.175561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:37.175561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:37.175561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:37.175561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:37.175561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:37.175561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:37.175561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:37.175561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:37.175561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:37.175561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:37.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:37.177402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:37.177402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:37.177402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:37.177402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:37.177402 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 239/469] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:37.178238 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97681e-121a-4236-9c5a-4bd3ac24e181 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:37.194898 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e456c9c-2fe3-4106-b3bb-59a6ab1f5198 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:37.210484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:37.232426 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b06772-38e2-4a49-96ca-5b0555a61631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:37.233100 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b06772-38e2-4a49-96ca-5b0555a61631 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:37.233387 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b06772-38e2-4a49-96ca-5b0555a61631 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:37.233665 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b06772-38e2-4a49-96ca-5b0555a61631 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:37.234393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b06772-38e2-4a49-96ca-5b0555a61631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:37.234701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b06772-38e2-4a49-96ca-5b0555a61631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:37.236118 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b06772-38e2-4a49-96ca-5b0555a61631 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:37.248042 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 231/470] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:37.249175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba793f3-3bd9-44d7-860f-6b2aa4700fd3 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:37.249463 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba793f3-3bd9-44d7-860f-6b2aa4700fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:37.249735 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba793f3-3bd9-44d7-860f-6b2aa4700fd3 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:37.250958 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 232/471] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:37.255763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba793f3-3bd9-44d7-860f-6b2aa4700fd3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:37.291083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd97681e-121a-4236-9c5a-4bd3ac24e181 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:37.325532 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e20dfd-489b-4a43-948b-4ac518312be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:37.326204 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e20dfd-489b-4a43-948b-4ac518312be0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:37.326486 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e20dfd-489b-4a43-948b-4ac518312be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:37.326757 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e20dfd-489b-4a43-948b-4ac518312be0 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:37.327519 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e20dfd-489b-4a43-948b-4ac518312be0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:37.327824 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e20dfd-489b-4a43-948b-4ac518312be0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:37.329195 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e20dfd-489b-4a43-948b-4ac518312be0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:37.346373 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 240/472] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:37.346373 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e20dfd-489b-4a43-948b-4ac518312be0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:37.351804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:37.369843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba793f3-3bd9-44d7-860f-6b2aa4700fd3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:37.403587 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f358b517-a67b-459b-82ca-3a63ea6e86e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:37.404176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358b517-a67b-459b-82ca-3a63ea6e86e1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:37.404461 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358b517-a67b-459b-82ca-3a63ea6e86e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:37.404760 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f358b517-a67b-459b-82ca-3a63ea6e86e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:37.405460 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358b517-a67b-459b-82ca-3a63ea6e86e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:37.405768 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358b517-a67b-459b-82ca-3a63ea6e86e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:37.407190 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f358b517-a67b-459b-82ca-3a63ea6e86e1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:37.419211 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 233/473] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:37.420292 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e03b88-3f75-4473-8463-44e2d0816594 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:37.420589 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e03b88-3f75-4473-8463-44e2d0816594 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:37.420858 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e03b88-3f75-4473-8463-44e2d0816594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:37.438239 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:37.441257 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-58e03b88-3f75-4473-8463-44e2d0816594 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:37.442470 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-58e03b88-3f75-4473-8463-44e2d0816594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:37.452107 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e20dfd-489b-4a43-948b-4ac518312be0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:37.487552 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515f372-dac7-4112-b7d2-3e9e456d11ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:37.488235 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515f372-dac7-4112-b7d2-3e9e456d11ea None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:37.488519 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515f372-dac7-4112-b7d2-3e9e456d11ea None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:37.488796 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0515f372-dac7-4112-b7d2-3e9e456d11ea None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:37.489507 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515f372-dac7-4112-b7d2-3e9e456d11ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:37.490970 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0515f372-dac7-4112-b7d2-3e9e456d11ea None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:37.511435 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 241/474] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 00:58:37 2022] POST /identity/v3/users => generated 248 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:58:37.512512 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515f372-dac7-4112-b7d2-3e9e456d11ea None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:37.527636 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 234/475] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:37.529181 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e03b88-3f75-4473-8463-44e2d0816594 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:37.637335 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0515f372-dac7-4112-b7d2-3e9e456d11ea None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:37.667433 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e03b88-3f75-4473-8463-44e2d0816594 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:37.671382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:37.678901 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f592c-69df-40bd-9990-1920c567f8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:37.680370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f592c-69df-40bd-9990-1920c567f8a0 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:37.681786 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f592c-69df-40bd-9990-1920c567f8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:37.682401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f592c-69df-40bd-9990-1920c567f8a0 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:37.684140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f592c-69df-40bd-9990-1920c567f8a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:37.686089 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f592c-69df-40bd-9990-1920c567f8a0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:37.707979 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:37.714072 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f13ec-3fcd-4478-aa73-dd154531752f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:37.715080 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f13ec-3fcd-4478-aa73-dd154531752f None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:37.715535 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 242/476] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 00:58:37 2022] POST /identity/v3/users => generated 249 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:58:37.715845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f13ec-3fcd-4478-aa73-dd154531752f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:37.716304 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58f13ec-3fcd-4478-aa73-dd154531752f None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:37.716479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f592c-69df-40bd-9990-1920c567f8a0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:37.717418 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f13ec-3fcd-4478-aa73-dd154531752f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:37.718982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58f13ec-3fcd-4478-aa73-dd154531752f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:37.744312 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 235/477] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 00:58:37 2022] POST /identity/v3/users => generated 248 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:58:37.841126 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f592c-69df-40bd-9990-1920c567f8a0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:37.882595 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51815590-6561-4f5b-9a7f-190f3f050064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:37.883320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51815590-6561-4f5b-9a7f-190f3f050064 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:37.883621 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51815590-6561-4f5b-9a7f-190f3f050064 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:37.883975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51815590-6561-4f5b-9a7f-190f3f050064 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:37.884750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51815590-6561-4f5b-9a7f-190f3f050064 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:37.886167 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51815590-6561-4f5b-9a7f-190f3f050064 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:37.895931 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.sql.core [None req-51815590-6561-4f5b-9a7f-190f3f050064 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 24 00:58:37.895931 dv-cinder-master-3-smb devstack@keystone.service[80519]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 24 00:58:37.895931 dv-cinder-master-3-smb devstack@keystone.service[80519]: [parameters: {'id': 'f875b04865de47888872ae1b7aa38b56', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 24 00:58:37.895931 dv-cinder-master-3-smb devstack@keystone.service[80519]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80519) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 24 00:58:37.914626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-51815590-6561-4f5b-9a7f-190f3f050064 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 24 00:58:37.914626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:37.914626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:58:37.914626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:58:37.914626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:58:37.914626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:58:37.914626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:58:37.914626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:58:37.914626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:58:37.914626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:58:37.914626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:58:37.914626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:58:37.914626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:58:37.914626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application result.read() Jul 24 00:58:37.914626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return ref.to_dict() Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:58:37.915736 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application yield resource Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self.session.rollback() Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self.force_reraise() Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise self.value Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application session.commit() Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 24 00:58:37.917128 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._prepare_impl() Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self.session.flush() Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._flush(objects) Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application compat.raise_( Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application flush_context.execute() Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rec.execute(self) Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 24 00:58:37.918060 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:58:37.919993 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application result.read() Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:58:37.922022 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [parameters: {'id': 'f875b04865de47888872ae1b7aa38b56', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:37.924008 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 24 00:58:37.932331 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:37.934309 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 243/478] 10.222.0.42 () {60 vars in 1131 bytes} [Sun Jul 24 00:58:37 2022] POST /identity/v3/roles => generated 144 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:37.934445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f13ec-3fcd-4478-aa73-dd154531752f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:38.048066 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58f13ec-3fcd-4478-aa73-dd154531752f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:38.086516 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:38.094333 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344016c5-5aba-43d4-b22a-3b3bf3af02ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:38.095173 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344016c5-5aba-43d4-b22a-3b3bf3af02ff None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:38.095485 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344016c5-5aba-43d4-b22a-3b3bf3af02ff None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:38.095765 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344016c5-5aba-43d4-b22a-3b3bf3af02ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:38.108917 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344016c5-5aba-43d4-b22a-3b3bf3af02ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-344016c5-5aba-43d4-b22a-3b3bf3af02ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:38.117135 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:38.118025 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:38.118915 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:38.118915 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:38.118915 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:38.118915 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:38.118915 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:38.118915 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:38.118915 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:38.118915 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:38.118915 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:38.118915 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:38.118915 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 24 00:58:38.118915 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:38.118915 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 236/479] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:58:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:38.124939 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51815590-6561-4f5b-9a7f-190f3f050064 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:38.193988 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:38.250950 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51815590-6561-4f5b-9a7f-190f3f050064 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:38.295371 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93866de0-877b-4e6d-9d42-d2f1d7a20fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:38.296059 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93866de0-877b-4e6d-9d42-d2f1d7a20fc1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:38.296338 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93866de0-877b-4e6d-9d42-d2f1d7a20fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:38.296607 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93866de0-877b-4e6d-9d42-d2f1d7a20fc1 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:38.297367 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93866de0-877b-4e6d-9d42-d2f1d7a20fc1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:38.297671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93866de0-877b-4e6d-9d42-d2f1d7a20fc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:38.299107 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93866de0-877b-4e6d-9d42-d2f1d7a20fc1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:38.310766 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 244/480] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:39.040426 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75030d57-c24d-4217-a113-3d09798f7a73 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:39.041117 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75030d57-c24d-4217-a113-3d09798f7a73 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:39.041610 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75030d57-c24d-4217-a113-3d09798f7a73 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:39.043434 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 237/481] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:39.049088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6b9b4-c4e2-4395-b4ac-45bf15019f01 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:39.049938 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6b9b4-c4e2-4395-b4ac-45bf15019f01 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:39.050448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe6b9b4-c4e2-4395-b4ac-45bf15019f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:39.076758 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6fe6b9b4-c4e2-4395-b4ac-45bf15019f01 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:39.078438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6fe6b9b4-c4e2-4395-b4ac-45bf15019f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:39.160285 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 245/482] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:58:39.195644 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75030d57-c24d-4217-a113-3d09798f7a73 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:39.347977 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75030d57-c24d-4217-a113-3d09798f7a73 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:39.392828 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c79fd-e31c-4dd2-9165-f84ad550c2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:39.393863 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c79fd-e31c-4dd2-9165-f84ad550c2d1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:39.394290 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c79fd-e31c-4dd2-9165-f84ad550c2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:39.394707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96c79fd-e31c-4dd2-9165-f84ad550c2d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:39.408881 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96c79fd-e31c-4dd2-9165-f84ad550c2d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a96c79fd-e31c-4dd2-9165-f84ad550c2d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:39.416793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:39.417860 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:39.418882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:39.418882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:39.418882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:39.418882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:39.418882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:39.418882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:39.418882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:39.418882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:39.418882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:39.418882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:39.418882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:39.418882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:39.421199 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 238/483] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:39.426775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6b9b4-c4e2-4395-b4ac-45bf15019f01 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:39.491389 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:39.536747 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe6b9b4-c4e2-4395-b4ac-45bf15019f01 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:39.571845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5ecd6-ad87-4724-ab16-b8ce8b35fc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:39.572530 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5ecd6-ad87-4724-ab16-b8ce8b35fc95 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:39.572818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5ecd6-ad87-4724-ab16-b8ce8b35fc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:39.573096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad5ecd6-ad87-4724-ab16-b8ce8b35fc95 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:39.573855 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5ecd6-ad87-4724-ab16-b8ce8b35fc95 None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:39.574162 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5ecd6-ad87-4724-ab16-b8ce8b35fc95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:39.575593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad5ecd6-ad87-4724-ab16-b8ce8b35fc95 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:39.584294 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 246/484] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:58:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:39.589510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c79fd-e31c-4dd2-9165-f84ad550c2d1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:39.740903 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:39.858170 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96c79fd-e31c-4dd2-9165-f84ad550c2d1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:39.901925 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ce6dea-d439-498c-be8f-d948dfdd2377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:39.902741 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce6dea-d439-498c-be8f-d948dfdd2377 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:39.903020 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce6dea-d439-498c-be8f-d948dfdd2377 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:39.903306 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ce6dea-d439-498c-be8f-d948dfdd2377 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:39.921297 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce6dea-d439-498c-be8f-d948dfdd2377 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:39.922772 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ce6dea-d439-498c-be8f-d948dfdd2377 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:39.946574 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-f7ce6dea-d439-498c-be8f-d948dfdd2377 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:39.946574 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:39.946574 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:39.946574 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:39.946574 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:39.946574 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:39.946574 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:39.946574 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:39.946574 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:39.946574 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:39.946574 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:39.946574 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:39.946574 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:39.946574 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:39.946574 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:39.947520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:39.948391 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:39.948391 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:39.948391 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:39.948391 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:39.948391 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 239/485] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:39.956420 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5ecd6-ad87-4724-ab16-b8ce8b35fc95 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:40.102323 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad5ecd6-ad87-4724-ab16-b8ce8b35fc95 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:40.121361 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:40.127529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c922e9a-af15-422d-b91c-645c45f7132c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.128082 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c922e9a-af15-422d-b91c-645c45f7132c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.128564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c922e9a-af15-422d-b91c-645c45f7132c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.131451 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 240/486] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:58:40.136196 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a74aa-a111-4d4c-a04c-99e304dc8861 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.136889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a74aa-a111-4d4c-a04c-99e304dc8861 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.137365 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a74aa-a111-4d4c-a04c-99e304dc8861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.156554 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1a2a74aa-a111-4d4c-a04c-99e304dc8861 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:40.157211 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f203432-301e-4b6b-a74a-ee611abae432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:40.157893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203432-301e-4b6b-a74a-ee611abae432 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.157992 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1a2a74aa-a111-4d4c-a04c-99e304dc8861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:40.158166 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203432-301e-4b6b-a74a-ee611abae432 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.158438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f203432-301e-4b6b-a74a-ee611abae432 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.159163 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f203432-301e-4b6b-a74a-ee611abae432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:40.159494 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f203432-301e-4b6b-a74a-ee611abae432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:40.160881 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f203432-301e-4b6b-a74a-ee611abae432 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:40.174659 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 247/487] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:40.176082 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48b5b0-6336-4d9e-a75a-2b230d036d66 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.176427 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48b5b0-6336-4d9e-a75a-2b230d036d66 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.176921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b48b5b0-6336-4d9e-a75a-2b230d036d66 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.178293 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 248/488] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:40.183042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48b5b0-6336-4d9e-a75a-2b230d036d66 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:40.239491 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 241/489] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:40.241349 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8b565-5d35-40d3-bf53-2288aa149f03 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.241775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8b565-5d35-40d3-bf53-2288aa149f03 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.242263 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8b565-5d35-40d3-bf53-2288aa149f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.259596 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a8e8b565-5d35-40d3-bf53-2288aa149f03 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:40.260963 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a8e8b565-5d35-40d3-bf53-2288aa149f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:40.298927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:40.333075 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b48b5b0-6336-4d9e-a75a-2b230d036d66 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:40.347994 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 242/490] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:40.351359 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8b565-5d35-40d3-bf53-2288aa149f03 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:40.377040 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719fa9a0-5ec8-4c6f-8ad8-2dcffeeeb1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:40.378077 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fa9a0-5ec8-4c6f-8ad8-2dcffeeeb1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.378534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fa9a0-5ec8-4c6f-8ad8-2dcffeeeb1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.378913 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719fa9a0-5ec8-4c6f-8ad8-2dcffeeeb1d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.387111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fa9a0-5ec8-4c6f-8ad8-2dcffeeeb1d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:40.388610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719fa9a0-5ec8-4c6f-8ad8-2dcffeeeb1d1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-719fa9a0-5ec8-4c6f-8ad8-2dcffeeeb1d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:40.404501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:40.405603 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:40.414884 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:40.414884 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:40.414884 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:40.414884 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:40.414884 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:40.414884 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:40.414884 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:40.414884 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:40.414884 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:58:40.414884 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:40.414884 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 249/491] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Jul 24 00:58:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:40.414884 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71952465-36dc-4898-af9d-773d440920c3 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.414884 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71952465-36dc-4898-af9d-773d440920c3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.415654 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71952465-36dc-4898-af9d-773d440920c3 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.415654 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 250/492] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:40.415654 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71952465-36dc-4898-af9d-773d440920c3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:40.458511 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:40.472734 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8b565-5d35-40d3-bf53-2288aa149f03 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:40.509057 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed977-bd58-4c31-b399-91a09d1e287a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:40.509868 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed977-bd58-4c31-b399-91a09d1e287a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.510154 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed977-bd58-4c31-b399-91a09d1e287a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.510432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eed977-bd58-4c31-b399-91a09d1e287a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.521613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eed977-bd58-4c31-b399-91a09d1e287a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:40.522066 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71952465-36dc-4898-af9d-773d440920c3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-c1eed977-bd58-4c31-b399-91a09d1e287a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:40.529700 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:40.530808 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:40.531670 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:40.531670 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:40.531670 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:40.531670 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:40.531670 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:40.531670 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:40.531670 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:40.531670 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:40.531670 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:40.531670 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:40.531670 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:40.531670 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:40.531670 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 243/493] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:40.532330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed977-bd58-4c31-b399-91a09d1e287a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:40.559522 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:40.563155 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea748fd-acdd-4fdf-93dd-0abdbe91c920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:40.564005 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea748fd-acdd-4fdf-93dd-0abdbe91c920 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.564297 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea748fd-acdd-4fdf-93dd-0abdbe91c920 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.564579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea748fd-acdd-4fdf-93dd-0abdbe91c920 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.575182 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea748fd-acdd-4fdf-93dd-0abdbe91c920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-0ea748fd-acdd-4fdf-93dd-0abdbe91c920 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:40.582969 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:40.583883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:40.584671 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:40.584671 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:40.584671 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:40.584671 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:40.584671 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:40.584671 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:40.584671 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:40.584671 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:40.584671 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:40.584671 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:40.584671 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:40.584671 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:40.584671 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 251/494] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:40.585941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf62ef-ac11-40d4-9397-7e4a70f05ea7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.585941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf62ef-ac11-40d4-9397-7e4a70f05ea7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.585941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcf62ef-ac11-40d4-9397-7e4a70f05ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.602043 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1dcf62ef-ac11-40d4-9397-7e4a70f05ea7 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:40.603436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1dcf62ef-ac11-40d4-9397-7e4a70f05ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:40.641471 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eed977-bd58-4c31-b399-91a09d1e287a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:40.671543 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 252/495] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:40.679512 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf62ef-ac11-40d4-9397-7e4a70f05ea7 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:40.683966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae3329-579d-471c-af5b-30df01fefbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:40.684648 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae3329-579d-471c-af5b-30df01fefbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.684975 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae3329-579d-471c-af5b-30df01fefbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.685247 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae3329-579d-471c-af5b-30df01fefbc5 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.686082 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae3329-579d-471c-af5b-30df01fefbc5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:40.686388 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae3329-579d-471c-af5b-30df01fefbc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:40.687932 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ae3329-579d-471c-af5b-30df01fefbc5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:40.707187 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:40.731725 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 244/496] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Jul 24 00:58:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:40.731725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae3329-579d-471c-af5b-30df01fefbc5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:40.779030 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcf62ef-ac11-40d4-9397-7e4a70f05ea7 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:40.816000 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3e67c-771b-42ed-a36b-caa4c48ec0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:40.816787 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3e67c-771b-42ed-a36b-caa4c48ec0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.817066 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3e67c-771b-42ed-a36b-caa4c48ec0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.817595 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:40.818133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe3e67c-771b-42ed-a36b-caa4c48ec0c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.819219 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3e67c-771b-42ed-a36b-caa4c48ec0c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:40.819588 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3e67c-771b-42ed-a36b-caa4c48ec0c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:40.821367 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe3e67c-771b-42ed-a36b-caa4c48ec0c9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:40.834524 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 253/497] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:58:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:40.835261 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3e67c-771b-42ed-a36b-caa4c48ec0c9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:40.837774 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae3329-579d-471c-af5b-30df01fefbc5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:40.872439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35c9fe-7ccd-40d9-890d-347bfe23ba31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:40.873077 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35c9fe-7ccd-40d9-890d-347bfe23ba31 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.873362 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35c9fe-7ccd-40d9-890d-347bfe23ba31 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.873633 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35c9fe-7ccd-40d9-890d-347bfe23ba31 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.874412 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35c9fe-7ccd-40d9-890d-347bfe23ba31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:40.874717 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35c9fe-7ccd-40d9-890d-347bfe23ba31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:40.876151 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d35c9fe-7ccd-40d9-890d-347bfe23ba31 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:40.885661 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 245/498] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:58:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:40.886447 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35c9fe-7ccd-40d9-890d-347bfe23ba31 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:40.931495 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:40.943948 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe3e67c-771b-42ed-a36b-caa4c48ec0c9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:40.980433 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de8f6b-a638-45db-a15d-84fd01d735f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:40.981250 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de8f6b-a638-45db-a15d-84fd01d735f8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:40.981533 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de8f6b-a638-45db-a15d-84fd01d735f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:40.981810 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9de8f6b-a638-45db-a15d-84fd01d735f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:40.992570 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9de8f6b-a638-45db-a15d-84fd01d735f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:40.997467 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35c9fe-7ccd-40d9-890d-347bfe23ba31 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-b9de8f6b-a638-45db-a15d-84fd01d735f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:41.000451 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:41.001416 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:41.002226 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:41.002226 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:41.002226 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:41.002226 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:41.002226 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:41.002226 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:41.002226 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:41.002226 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:41.002226 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:41.002226 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:41.002226 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:41.002226 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:41.002226 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 254/499] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:41.002924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de8f6b-a638-45db-a15d-84fd01d735f8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:41.035716 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811fca7-5690-425a-8dd9-753851971315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:41.036669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811fca7-5690-425a-8dd9-753851971315 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:41.037128 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811fca7-5690-425a-8dd9-753851971315 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:41.037564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9811fca7-5690-425a-8dd9-753851971315 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:41.052557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:41.112113 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811fca7-5690-425a-8dd9-753851971315 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:41.113108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9de8f6b-a638-45db-a15d-84fd01d735f8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:41.114312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9811fca7-5690-425a-8dd9-753851971315 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:41.148430 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecda255-d36e-4c00-bcf2-c79fc361bcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:41.149331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecda255-d36e-4c00-bcf2-c79fc361bcd7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:41.149721 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecda255-d36e-4c00-bcf2-c79fc361bcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:41.150005 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecda255-d36e-4c00-bcf2-c79fc361bcd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:41.161066 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecda255-d36e-4c00-bcf2-c79fc361bcd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:41.162619 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecda255-d36e-4c00-bcf2-c79fc361bcd7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:41.180827 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-7ecda255-d36e-4c00-bcf2-c79fc361bcd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:41.180827 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:41.180827 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:41.180827 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:41.180827 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:41.180827 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:41.180827 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:41.180827 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:41.180827 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:41.180827 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:41.180827 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:41.180827 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:41.180827 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:41.180827 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:41.180827 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:41.181745 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:41.182631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:41.182631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:41.182631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:41.182631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:41.184191 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 255/500] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:41.185107 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecda255-d36e-4c00-bcf2-c79fc361bcd7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:41.187841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:41.228296 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 246/501] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:41.228296 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811fca7-5690-425a-8dd9-753851971315 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:41.271810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:41.293012 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecda255-d36e-4c00-bcf2-c79fc361bcd7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:41.323751 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9811fca7-5690-425a-8dd9-753851971315 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:41.324995 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1666d32-6f81-4416-b67c-52f10e95f127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:41.325800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1666d32-6f81-4416-b67c-52f10e95f127 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:41.326090 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1666d32-6f81-4416-b67c-52f10e95f127 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:41.326359 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1666d32-6f81-4416-b67c-52f10e95f127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:41.336455 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1666d32-6f81-4416-b67c-52f10e95f127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:41.338161 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1666d32-6f81-4416-b67c-52f10e95f127 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:41.355342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-a1666d32-6f81-4416-b67c-52f10e95f127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:41.355342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:41.355342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:41.355342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:41.355342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:41.355342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:41.355342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:41.355342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:41.355342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:41.355342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:41.355342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:41.355342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:41.355342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:41.355342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:41.355342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:41.356375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:41.357471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:41.357471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:41.357471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:41.357471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:41.357471 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 256/502] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:41.357471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1666d32-6f81-4416-b67c-52f10e95f127 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:41.363238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793e2af-90c9-4b16-8e69-6400baf46d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:41.364184 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793e2af-90c9-4b16-8e69-6400baf46d60 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:41.365267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793e2af-90c9-4b16-8e69-6400baf46d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:41.365553 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793e2af-90c9-4b16-8e69-6400baf46d60 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:41.366315 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793e2af-90c9-4b16-8e69-6400baf46d60 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:41.366627 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793e2af-90c9-4b16-8e69-6400baf46d60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:41.368057 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1793e2af-90c9-4b16-8e69-6400baf46d60 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:41.376937 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 247/503] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:58:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:41.377775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793e2af-90c9-4b16-8e69-6400baf46d60 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:41.417294 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:41.461547 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1666d32-6f81-4416-b67c-52f10e95f127 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:41.476624 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793e2af-90c9-4b16-8e69-6400baf46d60 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:41.483378 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:41.493615 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011b576-6a56-4120-a5d1-693dbaebf3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:41.494324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011b576-6a56-4120-a5d1-693dbaebf3ff None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:41.494605 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011b576-6a56-4120-a5d1-693dbaebf3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:41.494877 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011b576-6a56-4120-a5d1-693dbaebf3ff None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:41.495638 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011b576-6a56-4120-a5d1-693dbaebf3ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:41.495945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011b576-6a56-4120-a5d1-693dbaebf3ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:41.497340 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011b576-6a56-4120-a5d1-693dbaebf3ff None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:41.508841 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 257/504] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:41.509811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643d833-e425-4841-b86a-aa9aca5e39a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:41.510031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02112b-9c40-48fc-ba87-d7fed1879f6e None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:41.510317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02112b-9c40-48fc-ba87-d7fed1879f6e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:41.510591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec02112b-9c40-48fc-ba87-d7fed1879f6e None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:41.510685 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643d833-e425-4841-b86a-aa9aca5e39a5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:41.510957 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643d833-e425-4841-b86a-aa9aca5e39a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:41.511234 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0643d833-e425-4841-b86a-aa9aca5e39a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:41.511843 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 258/505] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:41.512516 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02112b-9c40-48fc-ba87-d7fed1879f6e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:41.526534 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643d833-e425-4841-b86a-aa9aca5e39a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:41.528116 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0643d833-e425-4841-b86a-aa9aca5e39a5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:41.545993 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-0643d833-e425-4841-b86a-aa9aca5e39a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:41.545993 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:41.545993 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:41.545993 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:41.545993 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:41.545993 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:41.545993 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:41.545993 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:41.545993 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:41.545993 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:41.545993 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:41.545993 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:41.545993 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:41.545993 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:41.545993 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:41.546882 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:41.547785 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:41.547785 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:41.547785 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:41.547785 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:41.547785 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 248/506] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:41.548392 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643d833-e425-4841-b86a-aa9aca5e39a5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:41.616649 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec02112b-9c40-48fc-ba87-d7fed1879f6e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:41.630853 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:41.645154 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0643d833-e425-4841-b86a-aa9aca5e39a5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:41.651097 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba0011-27f4-4ebc-bfb2-41e9083d8a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:41.651822 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba0011-27f4-4ebc-bfb2-41e9083d8a97 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:41.652102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba0011-27f4-4ebc-bfb2-41e9083d8a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:41.652369 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baba0011-27f4-4ebc-bfb2-41e9083d8a97 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:41.653089 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba0011-27f4-4ebc-bfb2-41e9083d8a97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:41.653395 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba0011-27f4-4ebc-bfb2-41e9083d8a97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:41.654778 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baba0011-27f4-4ebc-bfb2-41e9083d8a97 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:41.666260 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 259/507] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:41.667015 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba0011-27f4-4ebc-bfb2-41e9083d8a97 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:41.680400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87234d-7bf7-428a-a97c-a036c75d12a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:41.681246 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87234d-7bf7-428a-a97c-a036c75d12a1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:41.681518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87234d-7bf7-428a-a97c-a036c75d12a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:41.681843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87234d-7bf7-428a-a97c-a036c75d12a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:41.692382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87234d-7bf7-428a-a97c-a036c75d12a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:41.694210 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87234d-7bf7-428a-a97c-a036c75d12a1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:41.710851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-4b87234d-7bf7-428a-a97c-a036c75d12a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:41.710851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:41.710851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:41.710851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:41.710851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:41.710851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:41.710851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:41.710851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:41.710851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:41.710851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:41.710851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:41.710851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:41.710851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:41.710851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:41.710851 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:41.711844 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:41.712798 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:41.712798 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:41.712798 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:41.712798 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:41.712798 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 249/508] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:41.713259 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c43b6c-19ec-4886-b1ee-4a558950dcd6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:41.713556 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c43b6c-19ec-4886-b1ee-4a558950dcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:41.713819 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c43b6c-19ec-4886-b1ee-4a558950dcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:41.729464 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d4c43b6c-19ec-4886-b1ee-4a558950dcd6 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:41.730645 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d4c43b6c-19ec-4886-b1ee-4a558950dcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:41.733331 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:41.770098 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baba0011-27f4-4ebc-bfb2-41e9083d8a97 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:41.797200 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 250/509] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:41.798052 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c43b6c-19ec-4886-b1ee-4a558950dcd6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:41.814160 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833f469-af17-45c1-b63a-ab6e2b5eadde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:41.814978 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833f469-af17-45c1-b63a-ab6e2b5eadde None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:41.815260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833f469-af17-45c1-b63a-ab6e2b5eadde None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:41.815578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833f469-af17-45c1-b63a-ab6e2b5eadde None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:41.823628 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833f469-af17-45c1-b63a-ab6e2b5eadde None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:41.825088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833f469-af17-45c1-b63a-ab6e2b5eadde None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-c833f469-af17-45c1-b63a-ab6e2b5eadde None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:41.838961 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:41.839953 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:41.840854 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:41.840854 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:41.840854 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:41.840854 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:41.840854 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:41.840854 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:41.840854 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:41.840854 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:41.840854 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:58:41.840854 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:41.840854 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 260/510] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:41 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:41.841439 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833f469-af17-45c1-b63a-ab6e2b5eadde None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:41.873756 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:41.901229 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c43b6c-19ec-4886-b1ee-4a558950dcd6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:41.934641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9340d57-6bbe-4ef6-9d5f-1dc4bcf1a35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:41.935331 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9340d57-6bbe-4ef6-9d5f-1dc4bcf1a35b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:41.935622 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9340d57-6bbe-4ef6-9d5f-1dc4bcf1a35b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:41.935898 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9340d57-6bbe-4ef6-9d5f-1dc4bcf1a35b None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:41.936625 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9340d57-6bbe-4ef6-9d5f-1dc4bcf1a35b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:41.936933 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9340d57-6bbe-4ef6-9d5f-1dc4bcf1a35b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:41.938333 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9340d57-6bbe-4ef6-9d5f-1dc4bcf1a35b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:41.938921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833f469-af17-45c1-b63a-ab6e2b5eadde None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:41.946710 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:41.955098 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 251/511] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:41.956043 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9340d57-6bbe-4ef6-9d5f-1dc4bcf1a35b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:41.972625 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacf80b-074b-43fa-8706-357bb01086ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:41.973339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacf80b-074b-43fa-8706-357bb01086ea None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:41.973632 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacf80b-074b-43fa-8706-357bb01086ea None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:41.973871 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feacf80b-074b-43fa-8706-357bb01086ea None admin] PATH_INFO: `/v3/users/glance` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:41.981425 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacf80b-074b-43fa-8706-357bb01086ea None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:41.982885 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feacf80b-074b-43fa-8706-357bb01086ea None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-feacf80b-074b-43fa-8706-357bb01086ea None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:41.998273 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:41.999219 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:42.000149 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:42.000149 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:42.000149 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:42.000149 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:42.000149 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:42.000149 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:42.000149 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:42.000149 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:42.000149 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:58:42.000149 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:42.000149 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 261/512] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:42.000749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacf80b-074b-43fa-8706-357bb01086ea None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:42.055221 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9340d57-6bbe-4ef6-9d5f-1dc4bcf1a35b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:42.087951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02513ee0-7d24-414d-8a20-8ffe2737dd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:42.088595 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02513ee0-7d24-414d-8a20-8ffe2737dd2f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:42.088881 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02513ee0-7d24-414d-8a20-8ffe2737dd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:42.089158 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02513ee0-7d24-414d-8a20-8ffe2737dd2f None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:42.089891 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02513ee0-7d24-414d-8a20-8ffe2737dd2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:42.090194 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02513ee0-7d24-414d-8a20-8ffe2737dd2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:42.091602 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02513ee0-7d24-414d-8a20-8ffe2737dd2f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:42.093480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:42.100262 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feacf80b-074b-43fa-8706-357bb01086ea None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:42.103194 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 252/513] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:42.104012 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02513ee0-7d24-414d-8a20-8ffe2737dd2f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:42.133675 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301017a8-1e64-41cb-b413-aa6ca8546259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:42.134500 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301017a8-1e64-41cb-b413-aa6ca8546259 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:42.134787 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301017a8-1e64-41cb-b413-aa6ca8546259 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:42.135065 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301017a8-1e64-41cb-b413-aa6ca8546259 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:42.145046 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301017a8-1e64-41cb-b413-aa6ca8546259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:42.146524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301017a8-1e64-41cb-b413-aa6ca8546259 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:42.160772 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:42.164188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-301017a8-1e64-41cb-b413-aa6ca8546259 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:42.164188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:42.164188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:42.164188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:42.164188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:42.164188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:42.164188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:42.164188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:42.164188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:42.164188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:42.164188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:42.164188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:42.164188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:42.164188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:42.164188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:42.165030 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:42.165935 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:42.165935 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:42.165935 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:42.165935 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:42.165935 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 262/514] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:42.166492 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301017a8-1e64-41cb-b413-aa6ca8546259 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:42.202661 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02513ee0-7d24-414d-8a20-8ffe2737dd2f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:42.235386 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3f57c-f7a2-4319-a810-0d73ed9824b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:42.236007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3f57c-f7a2-4319-a810-0d73ed9824b4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:42.236291 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3f57c-f7a2-4319-a810-0d73ed9824b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:42.236574 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f3f57c-f7a2-4319-a810-0d73ed9824b4 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:42.237439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3f57c-f7a2-4319-a810-0d73ed9824b4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:42.237752 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3f57c-f7a2-4319-a810-0d73ed9824b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:42.239205 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f3f57c-f7a2-4319-a810-0d73ed9824b4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:42.255787 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 253/515] 10.222.0.42 () {56 vars in 1137 bytes} [Sun Jul 24 00:58:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:42.256576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3f57c-f7a2-4319-a810-0d73ed9824b4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:42.268124 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301017a8-1e64-41cb-b413-aa6ca8546259 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:42.300858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a86e5-3f83-4ae1-8ffc-4a20ea631904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:42.301671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a86e5-3f83-4ae1-8ffc-4a20ea631904 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:42.302024 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a86e5-3f83-4ae1-8ffc-4a20ea631904 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:42.302310 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a86e5-3f83-4ae1-8ffc-4a20ea631904 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:42.308982 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a86e5-3f83-4ae1-8ffc-4a20ea631904 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:42.310452 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a86e5-3f83-4ae1-8ffc-4a20ea631904 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:42.326032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-ed9a86e5-3f83-4ae1-8ffc-4a20ea631904 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:42.326032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:42.326032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:42.326032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:42.326032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:42.326032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:42.326032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:42.326032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:42.326032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:42.326032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:42.326032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:42.326032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:42.326032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:58:42.326032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:58:42.326032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:42.326877 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:42.327769 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:58:42.327769 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:58:42.327769 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:58:42.327769 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:58:42.327769 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:58:42.327769 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:58:42.327769 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:42.327769 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:42.327769 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 263/516] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:42.328259 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a86e5-3f83-4ae1-8ffc-4a20ea631904 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:42.337732 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:42.356343 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f3f57c-f7a2-4319-a810-0d73ed9824b4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:42.373119 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:42.390059 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505d926-cf7e-4275-9dfd-4d1491f8695b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:42.390721 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505d926-cf7e-4275-9dfd-4d1491f8695b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:42.391004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505d926-cf7e-4275-9dfd-4d1491f8695b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:42.391278 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d505d926-cf7e-4275-9dfd-4d1491f8695b None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:42.392140 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505d926-cf7e-4275-9dfd-4d1491f8695b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:42.392453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505d926-cf7e-4275-9dfd-4d1491f8695b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:42.394303 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d505d926-cf7e-4275-9dfd-4d1491f8695b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:42.410637 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 254/517] 10.222.0.42 () {56 vars in 1137 bytes} [Sun Jul 24 00:58:42 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:42.411479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505d926-cf7e-4275-9dfd-4d1491f8695b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:42.428074 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a86e5-3f83-4ae1-8ffc-4a20ea631904 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:42.464686 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4f6e7-a60b-4846-b2b9-264fb57543da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:42.465506 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4f6e7-a60b-4846-b2b9-264fb57543da None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:42.466410 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4f6e7-a60b-4846-b2b9-264fb57543da None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:42.466698 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b4f6e7-a60b-4846-b2b9-264fb57543da None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:42.474310 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4f6e7-a60b-4846-b2b9-264fb57543da None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:42.475837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b4f6e7-a60b-4846-b2b9-264fb57543da None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-b6b4f6e7-a60b-4846-b2b9-264fb57543da None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:42.490046 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:42.491068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:42.491997 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:42.491997 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:42.491997 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:42.491997 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:42.491997 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:42.491997 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:42.491997 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:42.491997 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:42.491997 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:58:42.491997 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:42.491997 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 264/518] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:42 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:42.491997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4f6e7-a60b-4846-b2b9-264fb57543da None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:42.515860 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d505d926-cf7e-4275-9dfd-4d1491f8695b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:42.550328 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050ee84-fc56-4aaf-9f35-eaa70adb3c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:42.550988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050ee84-fc56-4aaf-9f35-eaa70adb3c28 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:42.551271 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050ee84-fc56-4aaf-9f35-eaa70adb3c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:42.551843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050ee84-fc56-4aaf-9f35-eaa70adb3c28 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:42.552291 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050ee84-fc56-4aaf-9f35-eaa70adb3c28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:42.552610 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050ee84-fc56-4aaf-9f35-eaa70adb3c28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:42.553986 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050ee84-fc56-4aaf-9f35-eaa70adb3c28 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:42.557972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:42.565085 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 255/519] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:42.565864 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050ee84-fc56-4aaf-9f35-eaa70adb3c28 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:42.593176 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b4f6e7-a60b-4846-b2b9-264fb57543da None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:42.600477 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:42.625654 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ce5b2-642a-4fa4-93d5-0a7ecdf6999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:42.626310 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ce5b2-642a-4fa4-93d5-0a7ecdf6999c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:42.626598 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ce5b2-642a-4fa4-93d5-0a7ecdf6999c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:42.626867 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ce5b2-642a-4fa4-93d5-0a7ecdf6999c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:42.662786 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050ee84-fc56-4aaf-9f35-eaa70adb3c28 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:42.692671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ce5b2-642a-4fa4-93d5-0a7ecdf6999c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:42.694506 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ce5b2-642a-4fa4-93d5-0a7ecdf6999c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:42.694653 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66fad5-e9bb-48bf-9d5f-43550002ec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:42.695334 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66fad5-e9bb-48bf-9d5f-43550002ec6a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:42.695622 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66fad5-e9bb-48bf-9d5f-43550002ec6a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:42.695898 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66fad5-e9bb-48bf-9d5f-43550002ec6a None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:42.696716 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66fad5-e9bb-48bf-9d5f-43550002ec6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:42.697026 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66fad5-e9bb-48bf-9d5f-43550002ec6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:42.698462 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66fad5-e9bb-48bf-9d5f-43550002ec6a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:42.715394 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 256/520] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:58:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:42.716197 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66fad5-e9bb-48bf-9d5f-43550002ec6a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:42.759891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:42.802051 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 265/521] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:42.802051 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ce5b2-642a-4fa4-93d5-0a7ecdf6999c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:42.829331 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:42.835283 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66fad5-e9bb-48bf-9d5f-43550002ec6a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:42.869195 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988c33b-873e-4654-9751-dab4dd0749bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:42.869855 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988c33b-873e-4654-9751-dab4dd0749bc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:42.870160 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988c33b-873e-4654-9751-dab4dd0749bc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:42.870435 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b988c33b-873e-4654-9751-dab4dd0749bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:42.900079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ce5b2-642a-4fa4-93d5-0a7ecdf6999c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:42.933145 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38ceff-a191-454e-9d66-2a0da4f67849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:42.933828 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38ceff-a191-454e-9d66-2a0da4f67849 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:42.934111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38ceff-a191-454e-9d66-2a0da4f67849 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:42.934394 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38ceff-a191-454e-9d66-2a0da4f67849 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:42.934831 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988c33b-873e-4654-9751-dab4dd0749bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:42.935235 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38ceff-a191-454e-9d66-2a0da4f67849 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:42.935588 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38ceff-a191-454e-9d66-2a0da4f67849 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:42.936353 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b988c33b-873e-4654-9751-dab4dd0749bc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:42.937032 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38ceff-a191-454e-9d66-2a0da4f67849 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:42.973532 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 266/522] 10.222.0.42 () {56 vars in 1139 bytes} [Sun Jul 24 00:58:42 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:42.974333 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38ceff-a191-454e-9d66-2a0da4f67849 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:43.001798 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:43.031062 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:43.038397 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 257/523] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:43.039411 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988c33b-873e-4654-9751-dab4dd0749bc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:43.083108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38ceff-a191-454e-9d66-2a0da4f67849 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:43.130039 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ef059-0e0b-417f-946f-cef8c7b350bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:43.130714 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ef059-0e0b-417f-946f-cef8c7b350bb None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:43.130998 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ef059-0e0b-417f-946f-cef8c7b350bb None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:43.131273 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ef059-0e0b-417f-946f-cef8c7b350bb None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:43.132004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ef059-0e0b-417f-946f-cef8c7b350bb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:43.133462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ef059-0e0b-417f-946f-cef8c7b350bb None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:43.140271 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b988c33b-873e-4654-9751-dab4dd0749bc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:43.153946 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 267/524] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 00:58:42 2022] POST /identity/v3/users => generated 247 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:58:43.154760 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ef059-0e0b-417f-946f-cef8c7b350bb None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:43.185559 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962504b7-aba6-41e9-b2a1-5dd25f60acde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:43.186265 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962504b7-aba6-41e9-b2a1-5dd25f60acde None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:43.186546 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962504b7-aba6-41e9-b2a1-5dd25f60acde None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:43.186830 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962504b7-aba6-41e9-b2a1-5dd25f60acde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:43.187731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962504b7-aba6-41e9-b2a1-5dd25f60acde None admin] RBAC: Adding query filter params (role.id=566ec5e1e87245cea292823f58d150fd, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=6c32c443ee1a421e98e7656e8e86e27a) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:43.188034 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962504b7-aba6-41e9-b2a1-5dd25f60acde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:43.189543 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962504b7-aba6-41e9-b2a1-5dd25f60acde None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:43.196153 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 258/525] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:43 2022] GET /identity/v3/role_assignments?user.id=6c32c443ee1a421e98e7656e8e86e27a&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=566ec5e1e87245cea292823f58d150fd => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:43.196926 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962504b7-aba6-41e9-b2a1-5dd25f60acde None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:43.262704 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:43.265479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:43.297400 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ef059-0e0b-417f-946f-cef8c7b350bb None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:43.317197 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962504b7-aba6-41e9-b2a1-5dd25f60acde None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:43.350857 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6fc69-a873-4094-85ca-79e8f15cb213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:43.353141 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6fc69-a873-4094-85ca-79e8f15cb213 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:43.353141 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6fc69-a873-4094-85ca-79e8f15cb213 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:43.353141 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6fc69-a873-4094-85ca-79e8f15cb213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:43.361510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910824b-24c1-4020-a4e1-cae878b9084b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:43.362176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910824b-24c1-4020-a4e1-cae878b9084b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:43.362457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910824b-24c1-4020-a4e1-cae878b9084b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:43.362733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910824b-24c1-4020-a4e1-cae878b9084b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:43.364934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6fc69-a873-4094-85ca-79e8f15cb213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:43.366508 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6fc69-a873-4094-85ca-79e8f15cb213 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:43.387075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-eff6fc69-a873-4094-85ca-79e8f15cb213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:43.387075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:43.387075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:43.387075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:43.387075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:43.387075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:43.387075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:43.387075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:43.387075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:43.387075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:43.387075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:43.387075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:43.387075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:43.387075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:43.387075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:43.388045 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:43.388892 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:43.388892 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:43.388892 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:43.388892 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:43.388892 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 268/526] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:43.389189 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6fc69-a873-4094-85ca-79e8f15cb213 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:43.461982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910824b-24c1-4020-a4e1-cae878b9084b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:43.463507 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b910824b-24c1-4020-a4e1-cae878b9084b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:43.499755 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6fc69-a873-4094-85ca-79e8f15cb213 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:43.527074 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:43.530537 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:43.538006 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13903a0f-b3ef-4e58-8ae6-077637de66e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:43.538838 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13903a0f-b3ef-4e58-8ae6-077637de66e7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:43.539432 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13903a0f-b3ef-4e58-8ae6-077637de66e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:43.539760 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13903a0f-b3ef-4e58-8ae6-077637de66e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:43.551869 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13903a0f-b3ef-4e58-8ae6-077637de66e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:43.553488 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13903a0f-b3ef-4e58-8ae6-077637de66e7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:43.573088 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-13903a0f-b3ef-4e58-8ae6-077637de66e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:43.573088 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:43.573088 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:43.573088 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:43.573088 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:43.573088 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:43.573088 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:43.573088 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:43.573088 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:43.573088 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:43.573088 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:43.573088 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:43.573088 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:43.573088 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:43.573088 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:43.574237 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:43.575335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:43.575335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:43.575335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:43.575335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:43.576688 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 259/528] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:43.576808 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 269/528] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:43.577000 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910824b-24c1-4020-a4e1-cae878b9084b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:43.583340 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13903a0f-b3ef-4e58-8ae6-077637de66e7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:43.680907 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b910824b-24c1-4020-a4e1-cae878b9084b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:43.713250 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13903a0f-b3ef-4e58-8ae6-077637de66e7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:43.721143 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f1580-c484-4a1e-a065-111044c7a146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:43.722144 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f1580-c484-4a1e-a065-111044c7a146 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:43.722431 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f1580-c484-4a1e-a065-111044c7a146 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:43.722705 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70f1580-c484-4a1e-a065-111044c7a146 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:43.723469 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f1580-c484-4a1e-a065-111044c7a146 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:43.723775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f1580-c484-4a1e-a065-111044c7a146 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:43.725291 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70f1580-c484-4a1e-a065-111044c7a146 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:43.737233 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 260/529] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:43.738048 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f1580-c484-4a1e-a065-111044c7a146 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:43.751186 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb17a01-bb33-4974-b02e-60cd51ab4dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:43.752115 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17a01-bb33-4974-b02e-60cd51ab4dff None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:43.752474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17a01-bb33-4974-b02e-60cd51ab4dff None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:43.752829 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb17a01-bb33-4974-b02e-60cd51ab4dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:43.761882 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:43.766299 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb17a01-bb33-4974-b02e-60cd51ab4dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:43.768186 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb17a01-bb33-4974-b02e-60cd51ab4dff None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:43.787772 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-4fb17a01-bb33-4974-b02e-60cd51ab4dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:43.787772 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:43.787772 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:43.787772 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:43.787772 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:43.787772 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:43.787772 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:43.787772 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:43.787772 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:43.787772 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:43.787772 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:43.787772 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:43.787772 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:43.787772 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:43.787772 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:43.788839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:43.789895 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:43.789895 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:43.789895 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:43.789895 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:43.791284 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 270/530] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:43.792138 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb17a01-bb33-4974-b02e-60cd51ab4dff None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:43.843712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:43.854301 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70f1580-c484-4a1e-a065-111044c7a146 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:43.891689 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108db05-1ce0-402c-9ec5-0fce554d2f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:43.892359 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108db05-1ce0-402c-9ec5-0fce554d2f10 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:43.892642 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108db05-1ce0-402c-9ec5-0fce554d2f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:43.892919 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108db05-1ce0-402c-9ec5-0fce554d2f10 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:43.893643 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108db05-1ce0-402c-9ec5-0fce554d2f10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:43.893953 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108db05-1ce0-402c-9ec5-0fce554d2f10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:43.895367 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a108db05-1ce0-402c-9ec5-0fce554d2f10 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:43.907858 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 261/531] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:43.908773 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108db05-1ce0-402c-9ec5-0fce554d2f10 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:43.915327 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb17a01-bb33-4974-b02e-60cd51ab4dff None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:43.950992 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc267c-bf13-43ab-8aeb-2eb214203b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:43.951836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc267c-bf13-43ab-8aeb-2eb214203b6d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:43.952119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc267c-bf13-43ab-8aeb-2eb214203b6d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:43.952395 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc267c-bf13-43ab-8aeb-2eb214203b6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:43.959207 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc267c-bf13-43ab-8aeb-2eb214203b6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:43.960750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc267c-bf13-43ab-8aeb-2eb214203b6d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:43.975626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-f6fc267c-bf13-43ab-8aeb-2eb214203b6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:43.975626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:43.975626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:43.975626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:43.975626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:43.975626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:43.975626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:43.975626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:43.975626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:43.975626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:43.975626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:43.975626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:43.975626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:58:43.975626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:58:43.975626 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:43.976538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:43.977397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:58:43.977397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:58:43.977397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:58:43.977397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:58:43.977397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:58:43.977397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:58:43.977397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:43.977397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:43.977397 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 271/532] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:43.977993 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc267c-bf13-43ab-8aeb-2eb214203b6d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:44.010918 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:44.039793 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108db05-1ce0-402c-9ec5-0fce554d2f10 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:44.080907 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:44.087202 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc267c-bf13-43ab-8aeb-2eb214203b6d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:44.089209 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2f8c8-f949-49cc-9fb5-d18f5af61087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:44.091372 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2f8c8-f949-49cc-9fb5-d18f5af61087 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:44.091808 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2f8c8-f949-49cc-9fb5-d18f5af61087 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:44.092247 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d2f8c8-f949-49cc-9fb5-d18f5af61087 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:44.093127 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2f8c8-f949-49cc-9fb5-d18f5af61087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:44.093594 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2f8c8-f949-49cc-9fb5-d18f5af61087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:44.095148 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d2f8c8-f949-49cc-9fb5-d18f5af61087 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:44.111279 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 262/533] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:44.112264 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2f8c8-f949-49cc-9fb5-d18f5af61087 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:44.128310 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7730a6-9fa8-4d98-8d43-9bb31dc13690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:44.129249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7730a6-9fa8-4d98-8d43-9bb31dc13690 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:44.129656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7730a6-9fa8-4d98-8d43-9bb31dc13690 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:44.130025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7730a6-9fa8-4d98-8d43-9bb31dc13690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:44.137252 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7730a6-9fa8-4d98-8d43-9bb31dc13690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:44.139022 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7730a6-9fa8-4d98-8d43-9bb31dc13690 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:44.152824 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-fb7730a6-9fa8-4d98-8d43-9bb31dc13690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:44.152824 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:44.152824 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:44.152824 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:44.152824 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:44.152824 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:44.152824 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:44.152824 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:44.152824 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:44.152824 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:44.152824 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:44.152824 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:44.152824 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:58:44.152824 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:58:44.152824 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:44.153881 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:44.155425 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:58:44.155425 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:58:44.155425 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:58:44.155425 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:58:44.155425 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:58:44.155425 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:58:44.155425 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:44.155425 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:44.156699 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 272/534] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:44.157137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7730a6-9fa8-4d98-8d43-9bb31dc13690 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:44.248542 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d2f8c8-f949-49cc-9fb5-d18f5af61087 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:44.259553 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7730a6-9fa8-4d98-8d43-9bb31dc13690 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:44.293314 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74f1cb-c638-4c34-bbd9-03aca4376a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:44.294033 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74f1cb-c638-4c34-bbd9-03aca4376a25 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:44.294329 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74f1cb-c638-4c34-bbd9-03aca4376a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:44.294576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74f1cb-c638-4c34-bbd9-03aca4376a25 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:44.295437 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74f1cb-c638-4c34-bbd9-03aca4376a25 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:44.295745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74f1cb-c638-4c34-bbd9-03aca4376a25 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:44.297209 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74f1cb-c638-4c34-bbd9-03aca4376a25 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:44.298958 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1e219-738e-461d-94c4-539ddf212656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:44.300477 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1e219-738e-461d-94c4-539ddf212656 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:44.300965 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1e219-738e-461d-94c4-539ddf212656 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:44.301436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1e219-738e-461d-94c4-539ddf212656 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:44.307186 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:44.311501 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1e219-738e-461d-94c4-539ddf212656 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:44.313325 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1e219-738e-461d-94c4-539ddf212656 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:44.316342 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 263/535] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:58:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:44.317093 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74f1cb-c638-4c34-bbd9-03aca4376a25 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:44.331723 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-0ff1e219-738e-461d-94c4-539ddf212656 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:44.331723 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:44.331723 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:44.331723 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:44.331723 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:44.331723 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:44.331723 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:44.331723 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:44.331723 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:44.331723 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:44.331723 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:44.331723 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:44.331723 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:58:44.331723 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:58:44.331723 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:44.332819 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:44.333904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:58:44.333904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:58:44.333904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:58:44.333904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:58:44.333904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:58:44.333904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:58:44.333904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:44.333904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:44.335891 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 273/536] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:44.336889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1e219-738e-461d-94c4-539ddf212656 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:44.359573 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:44.437562 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74f1cb-c638-4c34-bbd9-03aca4376a25 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:44.472482 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b3507-3dbd-4cd5-aed9-0c17043fc95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:44.473152 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b3507-3dbd-4cd5-aed9-0c17043fc95a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:44.473433 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b3507-3dbd-4cd5-aed9-0c17043fc95a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:44.473702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b3507-3dbd-4cd5-aed9-0c17043fc95a None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:44.474372 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1e219-738e-461d-94c4-539ddf212656 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:44.474480 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b3507-3dbd-4cd5-aed9-0c17043fc95a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:44.474767 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b3507-3dbd-4cd5-aed9-0c17043fc95a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:44.476272 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8b3507-3dbd-4cd5-aed9-0c17043fc95a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:44.489050 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 264/537] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:58:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:44.489935 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b3507-3dbd-4cd5-aed9-0c17043fc95a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:44.516205 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286c777-5232-43b0-8a3d-849dbb499eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:44.517081 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286c777-5232-43b0-8a3d-849dbb499eea None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:44.517366 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286c777-5232-43b0-8a3d-849dbb499eea None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:44.517642 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4286c777-5232-43b0-8a3d-849dbb499eea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:44.519023 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286c777-5232-43b0-8a3d-849dbb499eea None admin] RBAC: Adding query filter params (role.id=566ec5e1e87245cea292823f58d150fd, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=fa52d40556494110bf6962e09addfc15) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:44.519495 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286c777-5232-43b0-8a3d-849dbb499eea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:44.521117 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4286c777-5232-43b0-8a3d-849dbb499eea None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:44.535709 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 274/538] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:44 2022] GET /identity/v3/role_assignments?user.id=fa52d40556494110bf6962e09addfc15&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=566ec5e1e87245cea292823f58d150fd => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:44.536881 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286c777-5232-43b0-8a3d-849dbb499eea None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:44.563595 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:44.612887 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8b3507-3dbd-4cd5-aed9-0c17043fc95a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:44.653281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ec1d4-a3fb-44af-9600-7b401cf72eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:44.654387 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ec1d4-a3fb-44af-9600-7b401cf72eae None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:44.654897 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ec1d4-a3fb-44af-9600-7b401cf72eae None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:44.655420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6ec1d4-a3fb-44af-9600-7b401cf72eae None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:44.656422 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ec1d4-a3fb-44af-9600-7b401cf72eae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:44.657636 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ec1d4-a3fb-44af-9600-7b401cf72eae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:44.659503 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6ec1d4-a3fb-44af-9600-7b401cf72eae None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:44.674808 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 265/539] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:58:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:44.680567 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ec1d4-a3fb-44af-9600-7b401cf72eae None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:44.733265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:44.755051 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4286c777-5232-43b0-8a3d-849dbb499eea None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:44.820995 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6ec1d4-a3fb-44af-9600-7b401cf72eae None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:44.836032 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d9f252-8d9b-4989-8e1a-98b72a96a90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:44.836884 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9f252-8d9b-4989-8e1a-98b72a96a90f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:44.837126 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9f252-8d9b-4989-8e1a-98b72a96a90f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:44.837405 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d9f252-8d9b-4989-8e1a-98b72a96a90f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:44.838308 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9f252-8d9b-4989-8e1a-98b72a96a90f None admin] RBAC: Adding query filter params (role.id=566ec5e1e87245cea292823f58d150fd, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=adbdf910e67d4185a0ae14edf34ee3b9) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:44.838627 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9f252-8d9b-4989-8e1a-98b72a96a90f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:44.840136 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d9f252-8d9b-4989-8e1a-98b72a96a90f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:44.842437 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:44.856278 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 275/540] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:44 2022] GET /identity/v3/role_assignments?user.id=adbdf910e67d4185a0ae14edf34ee3b9&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=566ec5e1e87245cea292823f58d150fd => generated 259 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:44.865191 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6d586-9520-4408-80a8-c4d8cdb1fbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:44.865794 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6d586-9520-4408-80a8-c4d8cdb1fbe2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:44.866078 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6d586-9520-4408-80a8-c4d8cdb1fbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:44.866356 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6d586-9520-4408-80a8-c4d8cdb1fbe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:44.867218 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6d586-9520-4408-80a8-c4d8cdb1fbe2 None admin] RBAC: Adding query filter params (role.id=566ec5e1e87245cea292823f58d150fd, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=a3efd3928e334e78b4c87bb695718299) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:44.867555 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6d586-9520-4408-80a8-c4d8cdb1fbe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:44.869157 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6d586-9520-4408-80a8-c4d8cdb1fbe2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:44.881706 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 266/541] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:44 2022] GET /identity/v3/role_assignments?user.id=a3efd3928e334e78b4c87bb695718299&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=566ec5e1e87245cea292823f58d150fd => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:45.326478 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c56cb-b6b4-4269-9522-5b319d837819 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:45.327488 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c56cb-b6b4-4269-9522-5b319d837819 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:45.327992 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c56cb-b6b4-4269-9522-5b319d837819 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:45.329796 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 276/542] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:45.335527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f535b-246d-4e25-ab15-bc51746994c3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:45.336083 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f535b-246d-4e25-ab15-bc51746994c3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:45.336560 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8f535b-246d-4e25-ab15-bc51746994c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:45.360281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-dd8f535b-246d-4e25-ab15-bc51746994c3 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:45.361793 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dd8f535b-246d-4e25-ab15-bc51746994c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:45.428561 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 267/543] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:45.436900 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f19e98-208c-4cf9-afd0-25eaf3cb75f7 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:45.437436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f19e98-208c-4cf9-afd0-25eaf3cb75f7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:45.437929 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f19e98-208c-4cf9-afd0-25eaf3cb75f7 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:45.439787 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 277/544] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:45.445678 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b1bb3-0f04-4d50-8448-5896b286898e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:45.446661 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b1bb3-0f04-4d50-8448-5896b286898e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:45.447132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b1bb3-0f04-4d50-8448-5896b286898e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:45.474671 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-565b1bb3-0f04-4d50-8448-5896b286898e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:45.474867 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f19e98-208c-4cf9-afd0-25eaf3cb75f7 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:45.476371 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-565b1bb3-0f04-4d50-8448-5896b286898e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:45.609995 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 268/545] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:45.616583 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f19e98-208c-4cf9-afd0-25eaf3cb75f7 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:45.636647 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b1bb3-0f04-4d50-8448-5896b286898e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:45.657250 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989dc32-76ba-453c-bd21-6f9c09e246e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:45.658857 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989dc32-76ba-453c-bd21-6f9c09e246e5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:45.659498 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989dc32-76ba-453c-bd21-6f9c09e246e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:45.659963 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b989dc32-76ba-453c-bd21-6f9c09e246e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:45.671809 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b989dc32-76ba-453c-bd21-6f9c09e246e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-b989dc32-76ba-453c-bd21-6f9c09e246e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:45.681739 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:45.682643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:45.683490 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:45.683490 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:45.683490 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:45.683490 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:45.683490 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:45.683490 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:45.683490 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:45.683490 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:45.683490 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:45.683490 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:45.683490 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:45.683490 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:45.686447 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 278/546] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:45.692624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989dc32-76ba-453c-bd21-6f9c09e246e5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:45.698376 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:45.776707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:45.855772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b989dc32-76ba-453c-bd21-6f9c09e246e5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:45.872910 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b1bb3-0f04-4d50-8448-5896b286898e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:45.923497 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4f8cf-1400-4103-95e7-9188215177b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:45.924186 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4f8cf-1400-4103-95e7-9188215177b7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:45.924472 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4f8cf-1400-4103-95e7-9188215177b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:45.924750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c4f8cf-1400-4103-95e7-9188215177b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:45.925517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4f8cf-1400-4103-95e7-9188215177b7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:45.925834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4f8cf-1400-4103-95e7-9188215177b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:45.927237 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c4f8cf-1400-4103-95e7-9188215177b7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:45.942311 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574217be-c06e-4439-a79c-9a073dbd7479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:45.943141 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574217be-c06e-4439-a79c-9a073dbd7479 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:45.943828 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574217be-c06e-4439-a79c-9a073dbd7479 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:45.944108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574217be-c06e-4439-a79c-9a073dbd7479 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:45.950830 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 279/547] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:58:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:45.954924 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574217be-c06e-4439-a79c-9a073dbd7479 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:45.956075 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4f8cf-1400-4103-95e7-9188215177b7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-574217be-c06e-4439-a79c-9a073dbd7479 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:45.963198 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:45.964122 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:45.964926 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:45.964926 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:45.964926 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:45.964926 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:45.964926 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:45.964926 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:45.964926 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:45.964926 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:45.964926 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:45.964926 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:45.964926 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:45.964926 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:45.964926 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 269/548] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:45.970101 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574217be-c06e-4439-a79c-9a073dbd7479 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:46.097968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:46.120686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574217be-c06e-4439-a79c-9a073dbd7479 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:46.124045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:46.159889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c4f8cf-1400-4103-95e7-9188215177b7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:46.179893 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd5690-651c-4620-bc03-0fb7d3ff54eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:46.180609 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd5690-651c-4620-bc03-0fb7d3ff54eb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:46.180891 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd5690-651c-4620-bc03-0fb7d3ff54eb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:46.181165 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bd5690-651c-4620-bc03-0fb7d3ff54eb None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:46.181910 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd5690-651c-4620-bc03-0fb7d3ff54eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:46.182215 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd5690-651c-4620-bc03-0fb7d3ff54eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:46.183642 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bd5690-651c-4620-bc03-0fb7d3ff54eb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:46.197929 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 270/549] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:58:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:46.205054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd5690-651c-4620-bc03-0fb7d3ff54eb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:46.220634 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ede7c-845b-499a-884d-d0b7fc664d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:46.221451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ede7c-845b-499a-884d-d0b7fc664d02 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:46.221732 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ede7c-845b-499a-884d-d0b7fc664d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:46.222004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9ede7c-845b-499a-884d-d0b7fc664d02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:46.239317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ede7c-845b-499a-884d-d0b7fc664d02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:46.239317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9ede7c-845b-499a-884d-d0b7fc664d02 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:46.251907 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-2d9ede7c-845b-499a-884d-d0b7fc664d02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:46.251907 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:46.251907 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:46.251907 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:46.251907 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:46.251907 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:46.251907 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:46.251907 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:46.251907 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:46.251907 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:46.251907 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:46.251907 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:46.251907 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:46.251907 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:46.251907 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:46.253336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:46.254392 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:46.254392 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:46.254392 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:46.254392 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:46.254392 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 280/550] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:58:46.258959 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ede7c-845b-499a-884d-d0b7fc664d02 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:46.379358 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bd5690-651c-4620-bc03-0fb7d3ff54eb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:46.392348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9ede7c-845b-499a-884d-d0b7fc664d02 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:46.430063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:46.446050 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff600e7-0080-4efb-aab6-e56d1085fc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:46.446896 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff600e7-0080-4efb-aab6-e56d1085fc30 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:46.447179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff600e7-0080-4efb-aab6-e56d1085fc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:46.447600 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff600e7-0080-4efb-aab6-e56d1085fc30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:46.458972 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff600e7-0080-4efb-aab6-e56d1085fc30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:46.460647 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff600e7-0080-4efb-aab6-e56d1085fc30 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:46.479564 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6ff600e7-0080-4efb-aab6-e56d1085fc30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:46.479564 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:46.479564 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:46.479564 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:46.479564 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:46.479564 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:46.479564 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:46.479564 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:46.479564 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:46.479564 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:46.479564 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:46.479564 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:46.479564 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:46.479564 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:46.479564 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:46.480516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:46.481407 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:46.481407 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:46.481407 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:46.481407 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:46.481407 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 271/551] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:58:46.487088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff600e7-0080-4efb-aab6-e56d1085fc30 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:46.507109 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:46.516029 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb0144-b5fb-4c08-9ef7-1e8d90427421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:46.516730 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb0144-b5fb-4c08-9ef7-1e8d90427421 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:46.517023 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb0144-b5fb-4c08-9ef7-1e8d90427421 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:46.517495 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb0144-b5fb-4c08-9ef7-1e8d90427421 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:46.518044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb0144-b5fb-4c08-9ef7-1e8d90427421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:46.518355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb0144-b5fb-4c08-9ef7-1e8d90427421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:46.519803 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb0144-b5fb-4c08-9ef7-1e8d90427421 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:46.549880 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 281/552] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:46.554949 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb0144-b5fb-4c08-9ef7-1e8d90427421 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:46.619765 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff600e7-0080-4efb-aab6-e56d1085fc30 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:46.679934 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415386e1-93c0-48d9-9fa0-39c6a0210bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:46.680559 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415386e1-93c0-48d9-9fa0-39c6a0210bcf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:46.680843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415386e1-93c0-48d9-9fa0-39c6a0210bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:46.681119 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415386e1-93c0-48d9-9fa0-39c6a0210bcf None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:46.681846 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415386e1-93c0-48d9-9fa0-39c6a0210bcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:46.682150 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415386e1-93c0-48d9-9fa0-39c6a0210bcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:46.683567 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415386e1-93c0-48d9-9fa0-39c6a0210bcf None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:46.706614 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 272/553] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:46.707181 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415386e1-93c0-48d9-9fa0-39c6a0210bcf None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:46.749270 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb0144-b5fb-4c08-9ef7-1e8d90427421 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:46.817483 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0088db30-9fdd-4931-9c7a-9e0ddacd1994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:46.818946 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088db30-9fdd-4931-9c7a-9e0ddacd1994 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:46.819234 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088db30-9fdd-4931-9c7a-9e0ddacd1994 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:46.819554 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0088db30-9fdd-4931-9c7a-9e0ddacd1994 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:46.829280 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088db30-9fdd-4931-9c7a-9e0ddacd1994 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:46.830860 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0088db30-9fdd-4931-9c7a-9e0ddacd1994 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:46.843072 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-0088db30-9fdd-4931-9c7a-9e0ddacd1994 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:46.847032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:46.848178 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:46.849142 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:46.849142 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:46.849142 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:46.849142 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:46.849142 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:46.849142 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:46.849142 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:46.849142 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:46.849142 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:58:46.849142 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:46.849142 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 282/554] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Jul 24 00:58:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:58:46.850185 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33283463-ca7b-425d-88ca-b245186a9ed5 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:46.850534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33283463-ca7b-425d-88ca-b245186a9ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:46.850818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33283463-ca7b-425d-88ca-b245186a9ed5 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:46.856410 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 283/555] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:46.856410 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33283463-ca7b-425d-88ca-b245186a9ed5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:46.874364 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415386e1-93c0-48d9-9fa0-39c6a0210bcf None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:46.910379 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09927203-b4dc-4309-8e1d-f7e333630471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:46.911195 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09927203-b4dc-4309-8e1d-f7e333630471 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:46.911500 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09927203-b4dc-4309-8e1d-f7e333630471 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:46.911787 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09927203-b4dc-4309-8e1d-f7e333630471 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:46.915530 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:46.919966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09927203-b4dc-4309-8e1d-f7e333630471 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:46.921533 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09927203-b4dc-4309-8e1d-f7e333630471 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-09927203-b4dc-4309-8e1d-f7e333630471 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:46.939888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:46.940853 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:46.942240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:46.942240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:46.942240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:46.942240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:46.942240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:46.942240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:46.942240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:46.942240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:46.942240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:58:46.942240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:46.946395 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 273/556] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:58:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:46.947827 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf5fe6-f9e1-4fa0-a678-ae39f63daf57 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:46.948120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf5fe6-f9e1-4fa0-a678-ae39f63daf57 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:46.948405 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf5fe6-f9e1-4fa0-a678-ae39f63daf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:46.972492 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-efaf5fe6-f9e1-4fa0-a678-ae39f63daf57 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:46.974691 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-efaf5fe6-f9e1-4fa0-a678-ae39f63daf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:46.987106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33283463-ca7b-425d-88ca-b245186a9ed5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:47.025645 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f52e97-95ef-4301-88f4-e6197f8221c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:47.026454 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f52e97-95ef-4301-88f4-e6197f8221c7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:47.026811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f52e97-95ef-4301-88f4-e6197f8221c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:47.027157 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f52e97-95ef-4301-88f4-e6197f8221c7 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:47.028174 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f52e97-95ef-4301-88f4-e6197f8221c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:47.028551 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f52e97-95ef-4301-88f4-e6197f8221c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:47.030362 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f52e97-95ef-4301-88f4-e6197f8221c7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:47.049468 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 284/557] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Jul 24 00:58:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:47.050392 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f52e97-95ef-4301-88f4-e6197f8221c7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:47.063483 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 274/558] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:47.064579 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf5fe6-f9e1-4fa0-a678-ae39f63daf57 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:47.139351 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:47.172364 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:47.179948 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f52e97-95ef-4301-88f4-e6197f8221c7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:47.185171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf5fe6-f9e1-4fa0-a678-ae39f63daf57 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:47.221671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676eaac-6a19-468a-afe4-5642b3847c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:47.222502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676eaac-6a19-468a-afe4-5642b3847c0e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:47.222796 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676eaac-6a19-468a-afe4-5642b3847c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:47.223076 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676eaac-6a19-468a-afe4-5642b3847c0e None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:47.224315 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676eaac-6a19-468a-afe4-5642b3847c0e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:47.224636 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676eaac-6a19-468a-afe4-5642b3847c0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:47.226366 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676eaac-6a19-468a-afe4-5642b3847c0e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:47.229334 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e8cd1-b75e-456f-9435-11b4ca4094c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:47.230368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e8cd1-b75e-456f-9435-11b4ca4094c8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:47.230914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e8cd1-b75e-456f-9435-11b4ca4094c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:47.231504 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e8cd1-b75e-456f-9435-11b4ca4094c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:47.242527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e8cd1-b75e-456f-9435-11b4ca4094c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:47.244483 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238e8cd1-b75e-456f-9435-11b4ca4094c8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:47.247450 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 285/559] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Jul 24 00:58:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:47.248535 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676eaac-6a19-468a-afe4-5642b3847c0e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:47.268613 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-238e8cd1-b75e-456f-9435-11b4ca4094c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:47.268613 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:47.268613 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:47.268613 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:47.268613 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:47.268613 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:47.268613 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:47.268613 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:47.268613 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:47.268613 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:47.268613 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:47.268613 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:47.268613 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:47.268613 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:47.268613 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:47.269532 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:47.270419 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:47.270419 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:47.270419 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:47.270419 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:47.272916 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 275/560] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:47.273979 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e8cd1-b75e-456f-9435-11b4ca4094c8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:47.370939 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676eaac-6a19-468a-afe4-5642b3847c0e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:47.382351 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238e8cd1-b75e-456f-9435-11b4ca4094c8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:47.403655 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:47.406624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bb35f-b230-4859-813e-f46b30e97296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:47.407994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bb35f-b230-4859-813e-f46b30e97296 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:47.408284 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bb35f-b230-4859-813e-f46b30e97296 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:47.408562 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472bb35f-b230-4859-813e-f46b30e97296 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:47.419170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472bb35f-b230-4859-813e-f46b30e97296 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:47.419989 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2640d3f-1681-4ef5-b54c-005b8c747cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:47.420644 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2640d3f-1681-4ef5-b54c-005b8c747cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:47.420927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2640d3f-1681-4ef5-b54c-005b8c747cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:47.421198 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2640d3f-1681-4ef5-b54c-005b8c747cf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-472bb35f-b230-4859-813e-f46b30e97296 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:47.426930 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:47.427980 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:47.434522 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:47.434522 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:47.434522 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:47.434522 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:47.434522 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:47.434522 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:47.434522 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:47.434522 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:47.434522 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:47.434522 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:47.434522 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:47.434522 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:47.434522 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 286/561] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:47.434522 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bb35f-b230-4859-813e-f46b30e97296 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:47.447866 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:47.492200 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2640d3f-1681-4ef5-b54c-005b8c747cf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:47.493735 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2640d3f-1681-4ef5-b54c-005b8c747cf2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:47.533363 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472bb35f-b230-4859-813e-f46b30e97296 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:47.565555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644bdf4-e3df-408a-8be1-a4aac0f774d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:47.566208 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644bdf4-e3df-408a-8be1-a4aac0f774d5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:47.566494 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644bdf4-e3df-408a-8be1-a4aac0f774d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:47.566768 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644bdf4-e3df-408a-8be1-a4aac0f774d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:47.567534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644bdf4-e3df-408a-8be1-a4aac0f774d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:47.567841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644bdf4-e3df-408a-8be1-a4aac0f774d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:47.569555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644bdf4-e3df-408a-8be1-a4aac0f774d5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:47.581424 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 287/562] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:47.582654 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5535ea-b5b4-415a-8a9d-492f409df19d None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:47.582945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5535ea-b5b4-415a-8a9d-492f409df19d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:47.583213 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5535ea-b5b4-415a-8a9d-492f409df19d None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:47.584608 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 288/563] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:47.585134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5535ea-b5b4-415a-8a9d-492f409df19d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:47.597549 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 276/564] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:47.597549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9dca7-aa74-45c4-acf1-512b4ad267a8 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:47.597549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9dca7-aa74-45c4-acf1-512b4ad267a8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:47.597549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a9dca7-aa74-45c4-acf1-512b4ad267a8 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:47.597549 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 277/565] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:47.597549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9dca7-aa74-45c4-acf1-512b4ad267a8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:47.619557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:47.664902 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:47.690709 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5535ea-b5b4-415a-8a9d-492f409df19d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:47.698390 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a9dca7-aa74-45c4-acf1-512b4ad267a8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:47.724907 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db47433b-cee8-449e-8392-1ec5bfe54ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:47.725552 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47433b-cee8-449e-8392-1ec5bfe54ecc None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:47.725835 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47433b-cee8-449e-8392-1ec5bfe54ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:47.726121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db47433b-cee8-449e-8392-1ec5bfe54ecc None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:47.726871 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47433b-cee8-449e-8392-1ec5bfe54ecc None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:47.727182 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47433b-cee8-449e-8392-1ec5bfe54ecc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:47.728661 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db47433b-cee8-449e-8392-1ec5bfe54ecc None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:47.733081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e393d-042e-46fe-8c72-a7862dbd720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:47.733884 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e393d-042e-46fe-8c72-a7862dbd720a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:47.734166 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e393d-042e-46fe-8c72-a7862dbd720a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:47.734445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e393d-042e-46fe-8c72-a7862dbd720a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:47.736665 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 289/566] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:58:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:47.737834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f54bc-e122-4593-a082-0d85d6c07cc3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:47.738123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f54bc-e122-4593-a082-0d85d6c07cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:47.738399 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77f54bc-e122-4593-a082-0d85d6c07cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:47.745914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e393d-042e-46fe-8c72-a7862dbd720a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:47.747357 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e393d-042e-46fe-8c72-a7862dbd720a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:47.754067 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a77f54bc-e122-4593-a082-0d85d6c07cc3 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:47.755383 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a77f54bc-e122-4593-a082-0d85d6c07cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:47.761707 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-8a5e393d-042e-46fe-8c72-a7862dbd720a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:47.761707 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:47.761707 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:47.761707 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:47.761707 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:47.761707 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:47.761707 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:47.761707 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:47.761707 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:47.761707 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:47.761707 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:47.761707 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:47.761707 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:58:47.761707 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:58:47.761707 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:47.762565 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:47.763764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:58:47.763764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:58:47.763764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:58:47.763764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:58:47.763764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:58:47.763764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:58:47.763764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:47.763764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:47.763764 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 278/567] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:47.763764 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e393d-042e-46fe-8c72-a7862dbd720a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:47.825534 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 290/568] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:47.826845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b74e7b-7673-4bd1-b903-30528c8cb40e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:47.827133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b74e7b-7673-4bd1-b903-30528c8cb40e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:47.827435 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b74e7b-7673-4bd1-b903-30528c8cb40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:47.848330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:47.855595 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-10b74e7b-7673-4bd1-b903-30528c8cb40e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:47.856779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-10b74e7b-7673-4bd1-b903-30528c8cb40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:47.867271 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e393d-042e-46fe-8c72-a7862dbd720a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:47.899773 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8c23b-4d0a-4bbd-acde-a84de08161b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:47.900578 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8c23b-4d0a-4bbd-acde-a84de08161b9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:47.900890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8c23b-4d0a-4bbd-acde-a84de08161b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:47.901166 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8c23b-4d0a-4bbd-acde-a84de08161b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:47.911952 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8c23b-4d0a-4bbd-acde-a84de08161b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:47.913267 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:47.913407 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8c23b-4d0a-4bbd-acde-a84de08161b9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:47.921096 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 291/569] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:47.921899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b74e7b-7673-4bd1-b903-30528c8cb40e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:47.930769 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-bdb8c23b-4d0a-4bbd-acde-a84de08161b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:47.930769 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:47.930769 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:47.930769 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:47.930769 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:47.930769 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:47.930769 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:47.930769 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:47.930769 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:47.930769 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:47.930769 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:47.930769 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:47.930769 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:47.930769 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:47.930769 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:47.931756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:47.932679 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:47.932679 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:47.932679 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:47.932679 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:47.932679 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 279/570] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:47.932970 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8c23b-4d0a-4bbd-acde-a84de08161b9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:48.023674 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b74e7b-7673-4bd1-b903-30528c8cb40e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:48.030970 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8c23b-4d0a-4bbd-acde-a84de08161b9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:48.057446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83deb9a1-caba-4ccc-a470-0bd5fe64faf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:48.058260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83deb9a1-caba-4ccc-a470-0bd5fe64faf4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:48.058543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83deb9a1-caba-4ccc-a470-0bd5fe64faf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:48.058820 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83deb9a1-caba-4ccc-a470-0bd5fe64faf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:48.059764 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:48.064989 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ba83b-b59c-4f19-9209-0eeef88cc8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:48.065654 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ba83b-b59c-4f19-9209-0eeef88cc8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:48.065934 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ba83b-b59c-4f19-9209-0eeef88cc8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:48.066207 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ba83b-b59c-4f19-9209-0eeef88cc8f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:48.066988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ba83b-b59c-4f19-9209-0eeef88cc8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:48.067310 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ba83b-b59c-4f19-9209-0eeef88cc8f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:48.069138 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3ba83b-b59c-4f19-9209-0eeef88cc8f6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:48.070140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83deb9a1-caba-4ccc-a470-0bd5fe64faf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:48.071674 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83deb9a1-caba-4ccc-a470-0bd5fe64faf4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:48.081056 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 280/571] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:58:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:48.081848 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ba83b-b59c-4f19-9209-0eeef88cc8f6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:48.090509 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-83deb9a1-caba-4ccc-a470-0bd5fe64faf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:48.090509 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:48.090509 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:48.090509 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:48.090509 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:48.090509 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:48.090509 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:48.090509 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:48.090509 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:48.090509 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:48.090509 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:48.090509 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:48.090509 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:48.090509 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:48.090509 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:48.091471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:48.092389 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:48.092389 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:48.092389 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:48.092389 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:48.092389 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 292/572] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:48.092756 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83deb9a1-caba-4ccc-a470-0bd5fe64faf4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:48.140024 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:48.182947 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ba83b-b59c-4f19-9209-0eeef88cc8f6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:48.188996 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83deb9a1-caba-4ccc-a470-0bd5fe64faf4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:48.217331 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b00602-b226-4e65-bc35-9e4edc29418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:48.218136 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b00602-b226-4e65-bc35-9e4edc29418c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:48.218414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b00602-b226-4e65-bc35-9e4edc29418c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:48.218681 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b00602-b226-4e65-bc35-9e4edc29418c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:48.222232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75f4ac-9d0c-4d31-94ae-98b6f9eac296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:48.222890 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75f4ac-9d0c-4d31-94ae-98b6f9eac296 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:48.223176 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75f4ac-9d0c-4d31-94ae-98b6f9eac296 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:48.223484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be75f4ac-9d0c-4d31-94ae-98b6f9eac296 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:48.224211 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75f4ac-9d0c-4d31-94ae-98b6f9eac296 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:48.224520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75f4ac-9d0c-4d31-94ae-98b6f9eac296 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:48.225906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be75f4ac-9d0c-4d31-94ae-98b6f9eac296 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:48.229159 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b00602-b226-4e65-bc35-9e4edc29418c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-13b00602-b226-4e65-bc35-9e4edc29418c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:48.236914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:48.237849 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:48.238702 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:48.238702 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:48.238702 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:48.238702 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:48.238702 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:48.238702 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:48.238702 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:48.238702 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:48.238702 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:48.238702 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:48.238702 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:48.238702 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:48.239387 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 293/573] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:48.239387 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75f4ac-9d0c-4d31-94ae-98b6f9eac296 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:48.239539 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 281/574] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:48.239539 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b00602-b226-4e65-bc35-9e4edc29418c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:48.295675 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:48.335735 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be75f4ac-9d0c-4d31-94ae-98b6f9eac296 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:48.342613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b00602-b226-4e65-bc35-9e4edc29418c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:48.344273 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:48.369098 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725da3e-e451-4571-bfb0-c5d8c49d8ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:48.369996 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725da3e-e451-4571-bfb0-c5d8c49d8ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:48.370371 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725da3e-e451-4571-bfb0-c5d8c49d8ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:48.370655 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725da3e-e451-4571-bfb0-c5d8c49d8ca1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:48.375659 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f97ea-8e1e-43c9-9d23-5743af1dc1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:48.376560 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f97ea-8e1e-43c9-9d23-5743af1dc1fa None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:48.376844 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f97ea-8e1e-43c9-9d23-5743af1dc1fa None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:48.377126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780f97ea-8e1e-43c9-9d23-5743af1dc1fa None admin] PATH_INFO: `/v3/projects/604801625292482a9fb4b70c416dc438/users/6c32c443ee1a421e98e7656e8e86e27a/roles/566ec5e1e87245cea292823f58d150fd` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:48.380753 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725da3e-e451-4571-bfb0-c5d8c49d8ca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-c725da3e-e451-4571-bfb0-c5d8c49d8ca1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:48.388652 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:48.389721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:48.390589 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:48.390589 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:48.390589 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:48.390589 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:48.390589 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:48.390589 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:48.390589 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:48.390589 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:48.390589 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:48.390589 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:48.390589 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:48.390589 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:48.392506 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f97ea-8e1e-43c9-9d23-5743af1dc1fa None admin] RBAC: Authorizing `identity:create_grant(project_id=604801625292482a9fb4b70c416dc438, user_id=6c32c443ee1a421e98e7656e8e86e27a, role_id=566ec5e1e87245cea292823f58d150fd)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:48.393981 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780f97ea-8e1e-43c9-9d23-5743af1dc1fa None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:48.394737 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 294/575] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:48.395450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725da3e-e451-4571-bfb0-c5d8c49d8ca1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:48.427648 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 282/576] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:58:48 2022] PUT /identity/v3/projects/604801625292482a9fb4b70c416dc438/users/6c32c443ee1a421e98e7656e8e86e27a/roles/566ec5e1e87245cea292823f58d150fd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:58:48.427648 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f97ea-8e1e-43c9-9d23-5743af1dc1fa None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:48.504688 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725da3e-e451-4571-bfb0-c5d8c49d8ca1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:48.538077 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780f97ea-8e1e-43c9-9d23-5743af1dc1fa None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:48.539843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:48.543044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb2ddb-962f-4889-98b8-615b3a817773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:48.543763 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb2ddb-962f-4889-98b8-615b3a817773 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:48.544049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb2ddb-962f-4889-98b8-615b3a817773 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:48.544321 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb2ddb-962f-4889-98b8-615b3a817773 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:48.545058 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb2ddb-962f-4889-98b8-615b3a817773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:48.545364 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb2ddb-962f-4889-98b8-615b3a817773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:48.546817 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cb2ddb-962f-4889-98b8-615b3a817773 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:48.567682 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 295/577] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:48.569324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb2ddb-962f-4889-98b8-615b3a817773 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:48.584926 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d708561-fa96-451b-9327-9382c5f8e1e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:48.585743 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d708561-fa96-451b-9327-9382c5f8e1e8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:48.586027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d708561-fa96-451b-9327-9382c5f8e1e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:48.586543 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d708561-fa96-451b-9327-9382c5f8e1e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:48.594780 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d708561-fa96-451b-9327-9382c5f8e1e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:48.596287 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d708561-fa96-451b-9327-9382c5f8e1e8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:48.600888 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:48.611051 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-0d708561-fa96-451b-9327-9382c5f8e1e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:48.611051 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:48.611051 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:48.611051 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:48.611051 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:48.611051 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:48.611051 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:48.611051 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:48.611051 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:48.611051 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:48.611051 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:48.611051 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:48.611051 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:58:48.611051 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:58:48.611051 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:48.612044 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:48.616780 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:58:48.616780 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:58:48.616780 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:58:48.616780 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:58:48.616780 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:58:48.616780 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:58:48.616780 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:48.616780 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:48.616780 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 283/578] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:48.616780 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d708561-fa96-451b-9327-9382c5f8e1e8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:48.672690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb2ddb-962f-4889-98b8-615b3a817773 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:48.705980 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678e5de-9ebe-49d4-84b3-c2454ab81267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:48.706654 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678e5de-9ebe-49d4-84b3-c2454ab81267 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:48.706937 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678e5de-9ebe-49d4-84b3-c2454ab81267 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:48.707210 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678e5de-9ebe-49d4-84b3-c2454ab81267 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:48.707996 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678e5de-9ebe-49d4-84b3-c2454ab81267 None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:48.708305 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678e5de-9ebe-49d4-84b3-c2454ab81267 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:48.709671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678e5de-9ebe-49d4-84b3-c2454ab81267 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:48.717796 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 296/579] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:58:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:48.718603 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678e5de-9ebe-49d4-84b3-c2454ab81267 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:48.747540 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d708561-fa96-451b-9327-9382c5f8e1e8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:48.790323 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223f0c1-93ba-433a-a26f-2dd465d921b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:48.791277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223f0c1-93ba-433a-a26f-2dd465d921b8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:48.792040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223f0c1-93ba-433a-a26f-2dd465d921b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:48.792465 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223f0c1-93ba-433a-a26f-2dd465d921b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:48.793926 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223f0c1-93ba-433a-a26f-2dd465d921b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:48.794404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223f0c1-93ba-433a-a26f-2dd465d921b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:48.796472 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223f0c1-93ba-433a-a26f-2dd465d921b8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:48.804649 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:48.810820 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 284/580] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:58:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:48.810820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223f0c1-93ba-433a-a26f-2dd465d921b8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:48.821690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678e5de-9ebe-49d4-84b3-c2454ab81267 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:48.840861 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:48.856160 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba936f9-aae8-4407-a667-e0506effc871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:48.856976 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba936f9-aae8-4407-a667-e0506effc871 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:48.857261 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba936f9-aae8-4407-a667-e0506effc871 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:48.857513 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba936f9-aae8-4407-a667-e0506effc871 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:48.867076 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba936f9-aae8-4407-a667-e0506effc871 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:48.868667 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba936f9-aae8-4407-a667-e0506effc871 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-7ba936f9-aae8-4407-a667-e0506effc871 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:48.884675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:48.885724 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:48.886675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:48.886675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:48.886675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:48.886675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:48.886675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:48.886675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:48.886675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:48.886675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:48.886675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:58:48.886675 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:48.886675 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 297/581] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:48.886675 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba936f9-aae8-4407-a667-e0506effc871 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:48.929325 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223f0c1-93ba-433a-a26f-2dd465d921b8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:48.969062 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd300b4-eef3-47a2-b79e-86c98d1838bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:48.969885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd300b4-eef3-47a2-b79e-86c98d1838bb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:48.970170 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd300b4-eef3-47a2-b79e-86c98d1838bb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:48.970448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd300b4-eef3-47a2-b79e-86c98d1838bb None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:48.971246 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd300b4-eef3-47a2-b79e-86c98d1838bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:48.971598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd300b4-eef3-47a2-b79e-86c98d1838bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:48.973045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd300b4-eef3-47a2-b79e-86c98d1838bb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:48.989627 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 285/582] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:58:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:48.989627 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd300b4-eef3-47a2-b79e-86c98d1838bb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:48.997467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba936f9-aae8-4407-a667-e0506effc871 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:49.031446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347092fb-6d4d-4fed-b287-ab46795f18c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:49.032247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347092fb-6d4d-4fed-b287-ab46795f18c3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:49.032538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347092fb-6d4d-4fed-b287-ab46795f18c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:49.032800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347092fb-6d4d-4fed-b287-ab46795f18c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:49.044906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347092fb-6d4d-4fed-b287-ab46795f18c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:49.046370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347092fb-6d4d-4fed-b287-ab46795f18c3 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:49.063916 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-347092fb-6d4d-4fed-b287-ab46795f18c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:49.063916 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:49.063916 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:49.063916 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:49.063916 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:49.063916 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:49.063916 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:49.063916 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:49.063916 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:49.063916 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:49.063916 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:49.063916 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:49.063916 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:49.063916 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:49.063916 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:49.064832 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:49.065766 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:49.065766 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:49.065766 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:49.065766 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:49.070058 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 298/583] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:49.070892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347092fb-6d4d-4fed-b287-ab46795f18c3 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:49.073704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:49.074377 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:49.090221 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd300b4-eef3-47a2-b79e-86c98d1838bb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:49.125659 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0be12-f98a-46ac-9747-0de884bb6ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:49.126472 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0be12-f98a-46ac-9747-0de884bb6ddb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:49.126759 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0be12-f98a-46ac-9747-0de884bb6ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:49.127035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0be12-f98a-46ac-9747-0de884bb6ddb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:49.137620 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0be12-f98a-46ac-9747-0de884bb6ddb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:49.139083 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0be12-f98a-46ac-9747-0de884bb6ddb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:49.156824 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-63e0be12-f98a-46ac-9747-0de884bb6ddb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:49.156824 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:49.156824 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:49.156824 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:49.156824 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:49.156824 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:49.156824 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:49.156824 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:49.156824 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:49.156824 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:49.156824 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:49.156824 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:49.156824 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:49.156824 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:49.156824 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:49.157760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:49.158649 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:49.158649 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:49.158649 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:49.158649 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:49.158649 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 286/584] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:49.158956 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0be12-f98a-46ac-9747-0de884bb6ddb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:49.178748 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347092fb-6d4d-4fed-b287-ab46795f18c3 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:49.214924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a89137-01b7-4b2b-8516-15a499daeedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:49.215627 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a89137-01b7-4b2b-8516-15a499daeedc None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:49.215911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a89137-01b7-4b2b-8516-15a499daeedc None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:49.216338 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a89137-01b7-4b2b-8516-15a499daeedc None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:49.217028 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a89137-01b7-4b2b-8516-15a499daeedc None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:49.217339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a89137-01b7-4b2b-8516-15a499daeedc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:49.218876 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a89137-01b7-4b2b-8516-15a499daeedc None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:49.236888 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 299/585] 10.222.0.42 () {56 vars in 1137 bytes} [Sun Jul 24 00:58:49 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:49.237681 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a89137-01b7-4b2b-8516-15a499daeedc None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:49.265680 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0be12-f98a-46ac-9747-0de884bb6ddb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:49.297519 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:49.301427 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1a84f-5eff-45ff-a68b-36deb5ac6506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:49.302091 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1a84f-5eff-45ff-a68b-36deb5ac6506 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:49.302377 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1a84f-5eff-45ff-a68b-36deb5ac6506 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:49.302658 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d1a84f-5eff-45ff-a68b-36deb5ac6506 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:49.303505 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1a84f-5eff-45ff-a68b-36deb5ac6506 None admin] RBAC: Adding query filter params (role.id=566ec5e1e87245cea292823f58d150fd, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=dea37db9b0f3432093e8fe89d5fcc687) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:49.303817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1a84f-5eff-45ff-a68b-36deb5ac6506 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:49.305373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d1a84f-5eff-45ff-a68b-36deb5ac6506 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:49.308143 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:49.319415 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 287/586] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:49 2022] GET /identity/v3/role_assignments?user.id=dea37db9b0f3432093e8fe89d5fcc687&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=566ec5e1e87245cea292823f58d150fd => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:49.319415 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1a84f-5eff-45ff-a68b-36deb5ac6506 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:49.354873 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a89137-01b7-4b2b-8516-15a499daeedc None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:49.392511 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff0f59-d2ea-4b47-b0cc-2d3bcb1e43f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:49.393258 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff0f59-d2ea-4b47-b0cc-2d3bcb1e43f9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:49.393539 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff0f59-d2ea-4b47-b0cc-2d3bcb1e43f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:49.393853 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff0f59-d2ea-4b47-b0cc-2d3bcb1e43f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:49.394594 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff0f59-d2ea-4b47-b0cc-2d3bcb1e43f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:49.394899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff0f59-d2ea-4b47-b0cc-2d3bcb1e43f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:49.396345 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff0f59-d2ea-4b47-b0cc-2d3bcb1e43f9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:49.409119 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 300/587] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:49.414857 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff0f59-d2ea-4b47-b0cc-2d3bcb1e43f9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:49.446588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d1a84f-5eff-45ff-a68b-36deb5ac6506 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:49.492355 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553c20d-a086-4256-8eb6-a80cc257ba0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:49.493247 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553c20d-a086-4256-8eb6-a80cc257ba0f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:49.493600 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553c20d-a086-4256-8eb6-a80cc257ba0f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:49.493966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7553c20d-a086-4256-8eb6-a80cc257ba0f None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:49.496077 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553c20d-a086-4256-8eb6-a80cc257ba0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:49.496077 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553c20d-a086-4256-8eb6-a80cc257ba0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:49.496589 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7553c20d-a086-4256-8eb6-a80cc257ba0f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:49.512655 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 288/588] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:49.513565 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553c20d-a086-4256-8eb6-a80cc257ba0f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:49.533616 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff0f59-d2ea-4b47-b0cc-2d3bcb1e43f9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:49.556088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:49.572323 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44058bb1-a255-4965-9900-507c974757b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:49.573209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44058bb1-a255-4965-9900-507c974757b0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:49.573548 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44058bb1-a255-4965-9900-507c974757b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:49.573885 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44058bb1-a255-4965-9900-507c974757b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:49.585615 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44058bb1-a255-4965-9900-507c974757b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:49.587484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44058bb1-a255-4965-9900-507c974757b0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:49.590285 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:49.607672 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-44058bb1-a255-4965-9900-507c974757b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:49.607672 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:49.607672 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:49.607672 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:49.607672 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:49.607672 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:49.607672 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:49.607672 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:49.607672 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:49.607672 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:49.607672 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:49.607672 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:49.607672 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:49.607672 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:49.607672 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:49.608792 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:49.609897 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:49.609897 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:49.609897 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:49.609897 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:49.611832 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 301/589] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:49.611832 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44058bb1-a255-4965-9900-507c974757b0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:49.644510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7553c20d-a086-4256-8eb6-a80cc257ba0f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:49.688233 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c1cac-2fcd-4bc5-b342-721c4fc986bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:49.689144 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c1cac-2fcd-4bc5-b342-721c4fc986bc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:49.689492 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c1cac-2fcd-4bc5-b342-721c4fc986bc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:49.689834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c1cac-2fcd-4bc5-b342-721c4fc986bc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:49.701141 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c1cac-2fcd-4bc5-b342-721c4fc986bc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:49.703129 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4c1cac-2fcd-4bc5-b342-721c4fc986bc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:49.716805 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44058bb1-a255-4965-9900-507c974757b0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9e4c1cac-2fcd-4bc5-b342-721c4fc986bc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:49.722090 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:49.723220 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:49.724239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:49.724239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:49.724239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:49.724239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:49.724239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:49.724239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:49.724239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:49.724239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:49.724239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:58:49.724239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:49.724239 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 289/590] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:49 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:49.724239 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c1cac-2fcd-4bc5-b342-721c4fc986bc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:49.762301 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd425833-40b3-4907-a91b-ba07f50e0e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:49.763667 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd425833-40b3-4907-a91b-ba07f50e0e9b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:49.764148 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd425833-40b3-4907-a91b-ba07f50e0e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:49.764630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd425833-40b3-4907-a91b-ba07f50e0e9b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:49.772914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd425833-40b3-4907-a91b-ba07f50e0e9b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:49.774813 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd425833-40b3-4907-a91b-ba07f50e0e9b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-cd425833-40b3-4907-a91b-ba07f50e0e9b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:49.790357 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:49.791622 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:49.792625 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:49.792625 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:49.792625 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:49.792625 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:49.792625 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:49.792625 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:49.792625 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:49.792625 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:49.792625 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:58:49.792625 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:49.795104 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 302/591] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:49 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:49.796182 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd425833-40b3-4907-a91b-ba07f50e0e9b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:49.831503 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:49.832367 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c1cac-2fcd-4bc5-b342-721c4fc986bc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:49.853457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:49.868378 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56ae35-1b8f-44f2-816b-3cd67ee85c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:49.869049 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56ae35-1b8f-44f2-816b-3cd67ee85c9f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:49.869335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56ae35-1b8f-44f2-816b-3cd67ee85c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:49.869613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d56ae35-1b8f-44f2-816b-3cd67ee85c9f None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:49.870394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56ae35-1b8f-44f2-816b-3cd67ee85c9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:49.870646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56ae35-1b8f-44f2-816b-3cd67ee85c9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:49.872066 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d56ae35-1b8f-44f2-816b-3cd67ee85c9f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:49.889305 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 290/592] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:49.889305 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56ae35-1b8f-44f2-816b-3cd67ee85c9f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:49.916079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd425833-40b3-4907-a91b-ba07f50e0e9b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:49.952745 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebe7f2-e57e-43dd-b94d-0cefe13e1f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:49.953850 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebe7f2-e57e-43dd-b94d-0cefe13e1f93 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:49.954329 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebe7f2-e57e-43dd-b94d-0cefe13e1f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:49.954883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcebe7f2-e57e-43dd-b94d-0cefe13e1f93 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:49.956032 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebe7f2-e57e-43dd-b94d-0cefe13e1f93 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:49.956542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebe7f2-e57e-43dd-b94d-0cefe13e1f93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:49.958173 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcebe7f2-e57e-43dd-b94d-0cefe13e1f93 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:49.977386 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 303/593] 10.222.0.42 () {56 vars in 1139 bytes} [Sun Jul 24 00:58:49 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:49.978700 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebe7f2-e57e-43dd-b94d-0cefe13e1f93 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:49.985294 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d56ae35-1b8f-44f2-816b-3cd67ee85c9f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:50.019716 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0612f9-f896-4b21-83da-d5484a0bb6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:50.020402 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0612f9-f896-4b21-83da-d5484a0bb6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:50.020686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0612f9-f896-4b21-83da-d5484a0bb6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:50.020961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0612f9-f896-4b21-83da-d5484a0bb6a1 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:50.021802 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0612f9-f896-4b21-83da-d5484a0bb6a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:50.022109 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0612f9-f896-4b21-83da-d5484a0bb6a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:50.023612 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0612f9-f896-4b21-83da-d5484a0bb6a1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:50.042016 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 291/594] 10.222.0.42 () {56 vars in 1137 bytes} [Sun Jul 24 00:58:49 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:50.042943 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0612f9-f896-4b21-83da-d5484a0bb6a1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:50.081171 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:50.094994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcebe7f2-e57e-43dd-b94d-0cefe13e1f93 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:50.099933 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:50.139162 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85591a73-a18a-4908-8310-471abb951048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:50.140020 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85591a73-a18a-4908-8310-471abb951048 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:50.140321 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85591a73-a18a-4908-8310-471abb951048 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:50.141105 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85591a73-a18a-4908-8310-471abb951048 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:50.150395 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85591a73-a18a-4908-8310-471abb951048 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:50.152613 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85591a73-a18a-4908-8310-471abb951048 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:50.168295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-85591a73-a18a-4908-8310-471abb951048 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:50.168295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:50.168295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:50.168295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:50.168295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:50.168295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:50.168295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:50.168295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:50.168295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:50.168295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:50.168295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:50.168295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:50.168295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:58:50.168295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:58:50.168295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:50.169204 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:50.170108 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:58:50.170108 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:58:50.170108 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:58:50.170108 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:58:50.170108 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:58:50.170108 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:58:50.170108 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:50.170108 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:50.170970 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0612f9-f896-4b21-83da-d5484a0bb6a1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:50.177120 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 304/595] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:50.178229 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85591a73-a18a-4908-8310-471abb951048 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:50.211733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9b239-a19c-41a3-8139-626cac12aac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:50.212545 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9b239-a19c-41a3-8139-626cac12aac8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:50.212824 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9b239-a19c-41a3-8139-626cac12aac8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:50.213095 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9b239-a19c-41a3-8139-626cac12aac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:50.231244 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9b239-a19c-41a3-8139-626cac12aac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:50.232734 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c9b239-a19c-41a3-8139-626cac12aac8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:50.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-63c9b239-a19c-41a3-8139-626cac12aac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:50.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:50.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:50.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:50.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:50.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:50.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:50.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:50.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:50.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:50.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:50.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:50.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:50.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:50.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:50.256747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:50.257654 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:50.257654 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:50.257654 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:50.257654 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:50.259606 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 292/596] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:50.260582 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9b239-a19c-41a3-8139-626cac12aac8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:50.288330 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85591a73-a18a-4908-8310-471abb951048 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:50.326184 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088950d-1a99-4e3f-ad37-27c002c43108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:50.327424 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088950d-1a99-4e3f-ad37-27c002c43108 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:50.327901 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088950d-1a99-4e3f-ad37-27c002c43108 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:50.328376 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3088950d-1a99-4e3f-ad37-27c002c43108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:50.341112 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088950d-1a99-4e3f-ad37-27c002c43108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:50.342577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3088950d-1a99-4e3f-ad37-27c002c43108 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:50.366102 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-3088950d-1a99-4e3f-ad37-27c002c43108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:50.366102 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:50.366102 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:50.366102 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:50.366102 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:50.366102 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:50.366102 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:50.366102 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:50.366102 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:50.366102 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:50.366102 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:50.366102 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:50.366102 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:50.366102 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:50.366102 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:50.367033 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:50.368139 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:50.368139 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:50.368139 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:50.368139 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:50.375079 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 305/597] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:50.375079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088950d-1a99-4e3f-ad37-27c002c43108 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:50.376377 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:50.379361 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:50.393831 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9b239-a19c-41a3-8139-626cac12aac8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:50.440659 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b90fe6-ce69-4741-8b4c-5b118fd950ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:50.441771 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b90fe6-ce69-4741-8b4c-5b118fd950ba None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:50.442445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b90fe6-ce69-4741-8b4c-5b118fd950ba None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:50.442974 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b90fe6-ce69-4741-8b4c-5b118fd950ba None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:50.444864 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b90fe6-ce69-4741-8b4c-5b118fd950ba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:50.445431 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b90fe6-ce69-4741-8b4c-5b118fd950ba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:50.447100 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b90fe6-ce69-4741-8b4c-5b118fd950ba None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:50.462433 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 293/598] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:58:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:50.463269 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b90fe6-ce69-4741-8b4c-5b118fd950ba None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:50.490725 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3088950d-1a99-4e3f-ad37-27c002c43108 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:50.532558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cdc7ee-e200-47cf-aa08-692440d0ed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:50.533490 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdc7ee-e200-47cf-aa08-692440d0ed6a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:50.533967 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdc7ee-e200-47cf-aa08-692440d0ed6a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:50.534552 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cdc7ee-e200-47cf-aa08-692440d0ed6a None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:50.535220 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdc7ee-e200-47cf-aa08-692440d0ed6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:50.535750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdc7ee-e200-47cf-aa08-692440d0ed6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:50.537384 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cdc7ee-e200-47cf-aa08-692440d0ed6a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:50.551716 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 306/599] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:50.553820 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac909e-b72d-4c33-ad00-e37e920ebdfc None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:50.554299 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac909e-b72d-4c33-ad00-e37e920ebdfc None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:50.554785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac909e-b72d-4c33-ad00-e37e920ebdfc None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:50.560988 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 307/600] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:50.560988 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac909e-b72d-4c33-ad00-e37e920ebdfc None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:50.590682 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b90fe6-ce69-4741-8b4c-5b118fd950ba None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:50.627016 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:50.629266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19c112-1d03-4f11-bbc3-00a70e0f3b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:50.630153 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19c112-1d03-4f11-bbc3-00a70e0f3b6f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:50.630660 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19c112-1d03-4f11-bbc3-00a70e0f3b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:50.631249 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c19c112-1d03-4f11-bbc3-00a70e0f3b6f None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:50.632152 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19c112-1d03-4f11-bbc3-00a70e0f3b6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:50.632457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19c112-1d03-4f11-bbc3-00a70e0f3b6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:50.633901 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c19c112-1d03-4f11-bbc3-00a70e0f3b6f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:50.646712 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 294/601] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:50.647554 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19c112-1d03-4f11-bbc3-00a70e0f3b6f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:50.659337 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:50.675432 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac909e-b72d-4c33-ad00-e37e920ebdfc None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:50.710978 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a40f841-34b9-4f0e-b679-5e597948b76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:50.711945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40f841-34b9-4f0e-b679-5e597948b76c None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:50.712228 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40f841-34b9-4f0e-b679-5e597948b76c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:50.712497 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a40f841-34b9-4f0e-b679-5e597948b76c None admin] PATH_INFO: `/v3/projects/604801625292482a9fb4b70c416dc438/users/fa52d40556494110bf6962e09addfc15/roles/566ec5e1e87245cea292823f58d150fd` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:50.726933 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40f841-34b9-4f0e-b679-5e597948b76c None admin] RBAC: Authorizing `identity:create_grant(project_id=604801625292482a9fb4b70c416dc438, user_id=fa52d40556494110bf6962e09addfc15, role_id=566ec5e1e87245cea292823f58d150fd)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:50.728687 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a40f841-34b9-4f0e-b679-5e597948b76c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:50.749802 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 308/602] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:58:50 2022] PUT /identity/v3/projects/604801625292482a9fb4b70c416dc438/users/fa52d40556494110bf6962e09addfc15/roles/566ec5e1e87245cea292823f58d150fd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:58:50.749802 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039f1ed-591a-4f7b-b746-bbce0b915c51 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:50.749802 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039f1ed-591a-4f7b-b746-bbce0b915c51 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:50.749802 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039f1ed-591a-4f7b-b746-bbce0b915c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:50.762573 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c19c112-1d03-4f11-bbc3-00a70e0f3b6f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:50.768173 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4039f1ed-591a-4f7b-b746-bbce0b915c51 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:50.769630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4039f1ed-591a-4f7b-b746-bbce0b915c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:50.816122 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f41f41-b1a9-449c-b829-8145b4b1c19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:50.817061 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f41f41-b1a9-449c-b829-8145b4b1c19a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:50.817344 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f41f41-b1a9-449c-b829-8145b4b1c19a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:50.817701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f41f41-b1a9-449c-b829-8145b4b1c19a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:50.827326 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f41f41-b1a9-449c-b829-8145b4b1c19a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:50.828944 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f41f41-b1a9-449c-b829-8145b4b1c19a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:50.845551 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-60f41f41-b1a9-449c-b829-8145b4b1c19a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:50.845551 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:50.845551 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:50.845551 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:50.845551 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:50.845551 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:50.845551 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:50.845551 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:50.845551 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:50.845551 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:50.845551 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:50.845551 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:50.845551 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:58:50.845551 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:58:50.845551 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:50.846556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:50.847483 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:58:50.847483 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:58:50.847483 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:58:50.847483 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:58:50.847483 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:58:50.847483 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:58:50.847483 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:50.847483 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:50.851518 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 295/603] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:50.855140 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f41f41-b1a9-449c-b829-8145b4b1c19a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:50.870526 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 309/604] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:50.872008 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039f1ed-591a-4f7b-b746-bbce0b915c51 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:50.919342 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:50.969341 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:50.991484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039f1ed-591a-4f7b-b746-bbce0b915c51 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:51.006913 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f41f41-b1a9-449c-b829-8145b4b1c19a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:51.027765 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cb48f-2366-4998-bd6a-09b59a390133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:51.028804 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cb48f-2366-4998-bd6a-09b59a390133 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:51.029300 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cb48f-2366-4998-bd6a-09b59a390133 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:51.029764 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751cb48f-2366-4998-bd6a-09b59a390133 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:51.030980 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cb48f-2366-4998-bd6a-09b59a390133 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:51.031516 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cb48f-2366-4998-bd6a-09b59a390133 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:51.033295 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751cb48f-2366-4998-bd6a-09b59a390133 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:51.041820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538f62c-613a-4134-b544-127700384240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:51.042676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538f62c-613a-4134-b544-127700384240 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:51.042961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538f62c-613a-4134-b544-127700384240 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:51.043236 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1538f62c-613a-4134-b544-127700384240 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:51.052781 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538f62c-613a-4134-b544-127700384240 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:51.054274 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1538f62c-613a-4134-b544-127700384240 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:51.061216 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 310/605] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:58:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:51.062511 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cb48f-2366-4998-bd6a-09b59a390133 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:51.071031 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1538f62c-613a-4134-b544-127700384240 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:51.071031 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:51.071031 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:51.071031 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:51.071031 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:51.071031 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:51.071031 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:51.071031 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:51.071031 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:51.071031 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:51.071031 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:51.071031 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:51.071031 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:58:51.071031 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:58:51.071031 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:51.071951 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:51.073441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:58:51.073441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:58:51.073441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:58:51.073441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:58:51.073441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:58:51.073441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:58:51.073441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:51.073441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:51.073441 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 296/606] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:51.073441 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538f62c-613a-4134-b544-127700384240 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:51.177571 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751cb48f-2366-4998-bd6a-09b59a390133 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:51.179092 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1538f62c-613a-4134-b544-127700384240 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:51.179738 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:51.211906 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:51.217915 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596040c-0a62-48d3-8696-5f16cf5527d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:51.218338 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67042f-e699-4522-80e2-0cd338c779db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:51.219322 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596040c-0a62-48d3-8696-5f16cf5527d0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:51.219526 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67042f-e699-4522-80e2-0cd338c779db None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:51.220148 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596040c-0a62-48d3-8696-5f16cf5527d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:51.220267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67042f-e699-4522-80e2-0cd338c779db None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:51.220510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67042f-e699-4522-80e2-0cd338c779db None admin] PATH_INFO: `/v3/projects/604801625292482a9fb4b70c416dc438/users/a3efd3928e334e78b4c87bb695718299/roles/566ec5e1e87245cea292823f58d150fd` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:51.221113 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596040c-0a62-48d3-8696-5f16cf5527d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:51.232502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596040c-0a62-48d3-8696-5f16cf5527d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:51.236571 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67042f-e699-4522-80e2-0cd338c779db None admin] RBAC: Authorizing `identity:create_grant(project_id=604801625292482a9fb4b70c416dc438, user_id=a3efd3928e334e78b4c87bb695718299, role_id=566ec5e1e87245cea292823f58d150fd)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:51.238160 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67042f-e699-4522-80e2-0cd338c779db None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-8596040c-0a62-48d3-8696-5f16cf5527d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:51.241814 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:51.242715 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:51.243693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:51.243693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:51.243693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:51.243693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:51.243693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:51.243693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:51.243693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:51.243693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:51.243693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:51.243693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:51.243693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:51.243693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:51.245134 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 311/607] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:51.246053 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596040c-0a62-48d3-8696-5f16cf5527d0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:51.264002 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 297/608] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:58:51 2022] PUT /identity/v3/projects/604801625292482a9fb4b70c416dc438/users/a3efd3928e334e78b4c87bb695718299/roles/566ec5e1e87245cea292823f58d150fd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:58:51.264002 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67042f-e699-4522-80e2-0cd338c779db None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:51.405945 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67042f-e699-4522-80e2-0cd338c779db None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:51.442329 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596040c-0a62-48d3-8696-5f16cf5527d0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:51.447707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b353735b-d512-498b-b90d-c9a1e50461ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:51.448777 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353735b-d512-498b-b90d-c9a1e50461ea None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:51.449058 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353735b-d512-498b-b90d-c9a1e50461ea None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:51.449333 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b353735b-d512-498b-b90d-c9a1e50461ea None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:51.450098 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353735b-d512-498b-b90d-c9a1e50461ea None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:51.450403 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353735b-d512-498b-b90d-c9a1e50461ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:51.451863 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b353735b-d512-498b-b90d-c9a1e50461ea None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:51.461486 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 298/609] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:58:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:51.462950 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11f864-eaf2-41ac-8a69-39192912d11b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:51.463240 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11f864-eaf2-41ac-8a69-39192912d11b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:51.463550 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11f864-eaf2-41ac-8a69-39192912d11b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:51.469371 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 299/610] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:51.470297 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11f864-eaf2-41ac-8a69-39192912d11b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:51.488748 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843030c2-e07e-4247-9db5-4c16c3fa5c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:51.490051 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843030c2-e07e-4247-9db5-4c16c3fa5c79 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:51.490927 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843030c2-e07e-4247-9db5-4c16c3fa5c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:51.491481 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843030c2-e07e-4247-9db5-4c16c3fa5c79 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:51.492554 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843030c2-e07e-4247-9db5-4c16c3fa5c79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:51.493163 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843030c2-e07e-4247-9db5-4c16c3fa5c79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:51.495560 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843030c2-e07e-4247-9db5-4c16c3fa5c79 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:51.513102 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 312/611] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:58:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:51.514501 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd437-a8dd-4a9c-b8eb-cc16b2e282b0 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:51.514856 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd437-a8dd-4a9c-b8eb-cc16b2e282b0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:51.515127 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fcd437-a8dd-4a9c-b8eb-cc16b2e282b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:51.527083 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:51.536033 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-89fcd437-a8dd-4a9c-b8eb-cc16b2e282b0 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:51.537248 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-89fcd437-a8dd-4a9c-b8eb-cc16b2e282b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:51.555814 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:51.610638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11f864-eaf2-41ac-8a69-39192912d11b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:51.616387 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 313/612] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:51.617219 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcd437-a8dd-4a9c-b8eb-cc16b2e282b0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:51.650291 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a609fe8-2753-47ee-b865-35698df264a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:51.651369 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a609fe8-2753-47ee-b865-35698df264a3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:51.651666 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a609fe8-2753-47ee-b865-35698df264a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:51.651944 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a609fe8-2753-47ee-b865-35698df264a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:51.667204 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a609fe8-2753-47ee-b865-35698df264a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:51.669638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a609fe8-2753-47ee-b865-35698df264a3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:51.692555 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-8a609fe8-2753-47ee-b865-35698df264a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:51.692555 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:51.692555 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:51.692555 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:51.692555 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:51.692555 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:51.692555 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:51.692555 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:51.692555 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:51.692555 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:51.692555 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:51.692555 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:51.692555 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:51.692555 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:51.692555 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:51.693879 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:51.694801 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:51.694801 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:51.694801 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:51.694801 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:51.695203 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 300/613] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:51.696299 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a609fe8-2753-47ee-b865-35698df264a3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:51.740704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fcd437-a8dd-4a9c-b8eb-cc16b2e282b0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:51.789312 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0b0d7-e1d1-442c-8ed5-aa241b862b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:51.790538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0b0d7-e1d1-442c-8ed5-aa241b862b46 None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:51.790825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0b0d7-e1d1-442c-8ed5-aa241b862b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:51.791105 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd0b0d7-e1d1-442c-8ed5-aa241b862b46 None admin] PATH_INFO: `/v3/projects/604801625292482a9fb4b70c416dc438/users/adbdf910e67d4185a0ae14edf34ee3b9/roles/566ec5e1e87245cea292823f58d150fd` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:51.808228 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:51.810916 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0b0d7-e1d1-442c-8ed5-aa241b862b46 None admin] RBAC: Authorizing `identity:create_grant(project_id=604801625292482a9fb4b70c416dc438, user_id=adbdf910e67d4185a0ae14edf34ee3b9, role_id=566ec5e1e87245cea292823f58d150fd)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:51.812859 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd0b0d7-e1d1-442c-8ed5-aa241b862b46 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:51.819018 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a609fe8-2753-47ee-b865-35698df264a3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:51.831220 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 314/614] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:58:51 2022] PUT /identity/v3/projects/604801625292482a9fb4b70c416dc438/users/adbdf910e67d4185a0ae14edf34ee3b9/roles/566ec5e1e87245cea292823f58d150fd => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:58:51.832115 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0b0d7-e1d1-442c-8ed5-aa241b862b46 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:51.836253 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:51.858067 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca493d63-1ef5-45c6-8b57-8f99cbce3b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:51.859046 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca493d63-1ef5-45c6-8b57-8f99cbce3b65 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:51.859469 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca493d63-1ef5-45c6-8b57-8f99cbce3b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:51.859839 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca493d63-1ef5-45c6-8b57-8f99cbce3b65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:51.872524 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca493d63-1ef5-45c6-8b57-8f99cbce3b65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ca493d63-1ef5-45c6-8b57-8f99cbce3b65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:51.882173 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:51.883507 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:51.884591 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:51.884591 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:51.884591 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:51.884591 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:51.884591 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:51.884591 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:51.884591 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:51.884591 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:51.884591 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:51.884591 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:51.884591 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:51.884591 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:51.885977 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 301/615] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:51.892145 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca493d63-1ef5-45c6-8b57-8f99cbce3b65 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:51.979263 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd0b0d7-e1d1-442c-8ed5-aa241b862b46 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:52.044810 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91620612-5b4d-4eb9-915d-6dbc0fe96881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:52.045660 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91620612-5b4d-4eb9-915d-6dbc0fe96881 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:52.046196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91620612-5b4d-4eb9-915d-6dbc0fe96881 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:52.047866 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91620612-5b4d-4eb9-915d-6dbc0fe96881 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:52.048747 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91620612-5b4d-4eb9-915d-6dbc0fe96881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:52.049918 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91620612-5b4d-4eb9-915d-6dbc0fe96881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:52.051485 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91620612-5b4d-4eb9-915d-6dbc0fe96881 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:52.065436 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca493d63-1ef5-45c6-8b57-8f99cbce3b65 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:52.082565 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 315/616] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:52.090380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91620612-5b4d-4eb9-915d-6dbc0fe96881 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:52.118723 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b967e-33db-4fb3-83ef-e7b47e469dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:52.119750 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b967e-33db-4fb3-83ef-e7b47e469dfe None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:52.120236 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b967e-33db-4fb3-83ef-e7b47e469dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:52.120656 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364b967e-33db-4fb3-83ef-e7b47e469dfe None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:52.122039 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b967e-33db-4fb3-83ef-e7b47e469dfe None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:52.122495 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b967e-33db-4fb3-83ef-e7b47e469dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:52.124517 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364b967e-33db-4fb3-83ef-e7b47e469dfe None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:52.136694 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 302/617] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:58:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:52.144416 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b967e-33db-4fb3-83ef-e7b47e469dfe None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:52.165620 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:52.170021 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:52.215536 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91620612-5b4d-4eb9-915d-6dbc0fe96881 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:52.251657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa450468-e5d4-48bb-b7f5-edddd88eb420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:52.252760 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa450468-e5d4-48bb-b7f5-edddd88eb420 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:52.253192 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa450468-e5d4-48bb-b7f5-edddd88eb420 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:52.253610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa450468-e5d4-48bb-b7f5-edddd88eb420 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:52.258085 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364b967e-33db-4fb3-83ef-e7b47e469dfe None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:52.262462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa450468-e5d4-48bb-b7f5-edddd88eb420 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:52.264169 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa450468-e5d4-48bb-b7f5-edddd88eb420 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-fa450468-e5d4-48bb-b7f5-edddd88eb420 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:52.293239 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:52.294468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:52.295693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:52.295693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:52.295693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:52.295693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:52.295693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:52.295693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:52.295693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:52.295693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:52.295693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:58:52.295693 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:52.299266 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 316/618] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Jul 24 00:58:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:52.304968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa450468-e5d4-48bb-b7f5-edddd88eb420 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:52.319503 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd24a59-6a77-44a3-9977-5c72bcd761bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:52.320449 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd24a59-6a77-44a3-9977-5c72bcd761bb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:52.320875 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd24a59-6a77-44a3-9977-5c72bcd761bb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:52.321266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd24a59-6a77-44a3-9977-5c72bcd761bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:52.334428 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd24a59-6a77-44a3-9977-5c72bcd761bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:52.336038 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd24a59-6a77-44a3-9977-5c72bcd761bb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:52.354076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1dd24a59-6a77-44a3-9977-5c72bcd761bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:52.354076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:52.354076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:52.354076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:52.354076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:52.354076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:52.354076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:52.354076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:52.354076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:52.354076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:52.354076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:52.354076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:52.354076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:52.354076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:52.354076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:52.355823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:52.358008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:52.358008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:52.358008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:52.358008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:52.358008 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 303/619] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:52.362457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd24a59-6a77-44a3-9977-5c72bcd761bb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:52.455743 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:52.471916 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd24a59-6a77-44a3-9977-5c72bcd761bb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:52.507285 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2556e-7c55-46dc-bb91-987fee1cad26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:52.508090 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2556e-7c55-46dc-bb91-987fee1cad26 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:52.508485 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2556e-7c55-46dc-bb91-987fee1cad26 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:52.508914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee2556e-7c55-46dc-bb91-987fee1cad26 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:52.509768 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2556e-7c55-46dc-bb91-987fee1cad26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:52.510161 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2556e-7c55-46dc-bb91-987fee1cad26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:52.511692 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee2556e-7c55-46dc-bb91-987fee1cad26 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:52.521871 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa450468-e5d4-48bb-b7f5-edddd88eb420 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:52.525458 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 304/620] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:52.531034 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2556e-7c55-46dc-bb91-987fee1cad26 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:52.571155 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:52.585042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1af27-0d3e-41ab-93a2-11fcc56b6fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:52.585777 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1af27-0d3e-41ab-93a2-11fcc56b6fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:52.586079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1af27-0d3e-41ab-93a2-11fcc56b6fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:52.586340 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1af27-0d3e-41ab-93a2-11fcc56b6fc9 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:52.587524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1af27-0d3e-41ab-93a2-11fcc56b6fc9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:52.587839 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1af27-0d3e-41ab-93a2-11fcc56b6fc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:52.589557 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1af27-0d3e-41ab-93a2-11fcc56b6fc9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:52.621991 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 317/621] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Jul 24 00:58:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:52.628105 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1af27-0d3e-41ab-93a2-11fcc56b6fc9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:52.689764 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee2556e-7c55-46dc-bb91-987fee1cad26 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:52.742123 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:52.759123 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59ce6c-a590-48fa-a772-abda86cc6cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:52.759895 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59ce6c-a590-48fa-a772-abda86cc6cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:52.760174 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59ce6c-a590-48fa-a772-abda86cc6cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:52.760449 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59ce6c-a590-48fa-a772-abda86cc6cc3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:52.774093 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59ce6c-a590-48fa-a772-abda86cc6cc3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:52.775578 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec59ce6c-a590-48fa-a772-abda86cc6cc3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ec59ce6c-a590-48fa-a772-abda86cc6cc3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:52.803939 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:52.804952 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:52.806110 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:52.806110 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:52.806110 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:52.806110 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:52.806110 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:52.806110 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:52.806110 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:52.806110 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:52.806110 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:58:52.806110 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:52.807166 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 305/622] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:58:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:58:52.817127 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59ce6c-a590-48fa-a772-abda86cc6cc3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:52.820720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1af27-0d3e-41ab-93a2-11fcc56b6fc9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:52.896894 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305b100c-74bb-41df-b48a-02627f5bee90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:52.897979 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b100c-74bb-41df-b48a-02627f5bee90 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:52.898470 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b100c-74bb-41df-b48a-02627f5bee90 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:52.898947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305b100c-74bb-41df-b48a-02627f5bee90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:52.925185 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59ce6c-a590-48fa-a772-abda86cc6cc3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:52.962096 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89a0fe-5c89-47f9-ab6a-8fe2421ef5c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:52.962789 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89a0fe-5c89-47f9-ab6a-8fe2421ef5c0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:52.963070 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89a0fe-5c89-47f9-ab6a-8fe2421ef5c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:52.963368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89a0fe-5c89-47f9-ab6a-8fe2421ef5c0 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:52.964525 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89a0fe-5c89-47f9-ab6a-8fe2421ef5c0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:52.964896 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89a0fe-5c89-47f9-ab6a-8fe2421ef5c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:52.966646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89a0fe-5c89-47f9-ab6a-8fe2421ef5c0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:52.987378 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 306/623] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Jul 24 00:58:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:52.997476 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89a0fe-5c89-47f9-ab6a-8fe2421ef5c0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:53.014220 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:53.045980 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b100c-74bb-41df-b48a-02627f5bee90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:53.047489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305b100c-74bb-41df-b48a-02627f5bee90 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:53.083345 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:53.158853 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89a0fe-5c89-47f9-ab6a-8fe2421ef5c0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:53.195334 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 318/624] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:53.195334 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e99d92-f2ed-42fa-97fb-5cb6f7390425 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:53.195334 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e99d92-f2ed-42fa-97fb-5cb6f7390425 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:53.195334 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e99d92-f2ed-42fa-97fb-5cb6f7390425 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:53.195979 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 319/625] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:53.198902 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e99d92-f2ed-42fa-97fb-5cb6f7390425 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:53.207913 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c2179-fda4-4c29-886a-3525ecd2e0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:53.209172 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c2179-fda4-4c29-886a-3525ecd2e0bd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:53.209654 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c2179-fda4-4c29-886a-3525ecd2e0bd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:53.210145 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c2179-fda4-4c29-886a-3525ecd2e0bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:53.223343 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c2179-fda4-4c29-886a-3525ecd2e0bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:53.223755 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445c2179-fda4-4c29-886a-3525ecd2e0bd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:53.242936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-445c2179-fda4-4c29-886a-3525ecd2e0bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:53.242936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:53.242936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:53.242936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:53.242936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:53.242936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:53.242936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:53.242936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:53.242936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:53.242936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:53.242936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:53.242936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:53.242936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:53.242936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:53.242936 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:53.243949 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:53.244876 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:53.244876 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:53.244876 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:53.244876 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:53.247220 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 307/626] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:58:53.248790 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f56a60-ca78-48e3-9696-63df9f3b38c1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:53.249277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f56a60-ca78-48e3-9696-63df9f3b38c1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:53.249727 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f56a60-ca78-48e3-9696-63df9f3b38c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:53.269606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b1f56a60-ca78-48e3-9696-63df9f3b38c1 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:53.271267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b1f56a60-ca78-48e3-9696-63df9f3b38c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:53.301913 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:53.333558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e99d92-f2ed-42fa-97fb-5cb6f7390425 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:53.355339 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 308/627] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:53.355339 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f56a60-ca78-48e3-9696-63df9f3b38c1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:53.389984 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e244abb-f106-4a17-aa64-e45160da8695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:53.390806 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e244abb-f106-4a17-aa64-e45160da8695 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:53.391083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e244abb-f106-4a17-aa64-e45160da8695 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:53.391408 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e244abb-f106-4a17-aa64-e45160da8695 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:53.396536 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:53.402228 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e244abb-f106-4a17-aa64-e45160da8695 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:53.403800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e244abb-f106-4a17-aa64-e45160da8695 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:53.422939 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-6e244abb-f106-4a17-aa64-e45160da8695 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:53.422939 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:53.422939 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:53.422939 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:53.422939 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:53.422939 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:53.422939 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:53.422939 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:53.422939 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:53.422939 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:53.422939 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:53.422939 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:53.422939 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:53.422939 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:53.422939 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:53.423945 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:53.424935 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:53.424935 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:53.424935 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:53.424935 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:53.424935 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 320/628] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:58:53.425630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e244abb-f106-4a17-aa64-e45160da8695 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:53.478862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f56a60-ca78-48e3-9696-63df9f3b38c1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:53.516864 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbb852-09b2-4dee-98e4-d58c8e1f1c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:53.517885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbb852-09b2-4dee-98e4-d58c8e1f1c6a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:53.518410 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbb852-09b2-4dee-98e4-d58c8e1f1c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:53.519036 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dbb852-09b2-4dee-98e4-d58c8e1f1c6a None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:53.520178 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbb852-09b2-4dee-98e4-d58c8e1f1c6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:53.520707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbb852-09b2-4dee-98e4-d58c8e1f1c6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:53.522557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dbb852-09b2-4dee-98e4-d58c8e1f1c6a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:53.525414 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e244abb-f106-4a17-aa64-e45160da8695 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:53.536588 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 309/629] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:53.537798 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbb852-09b2-4dee-98e4-d58c8e1f1c6a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:53.560324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:53.566201 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401adc2-82a7-4182-81cb-b2f2dfc38434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:53.567029 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401adc2-82a7-4182-81cb-b2f2dfc38434 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:53.568432 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401adc2-82a7-4182-81cb-b2f2dfc38434 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:53.568432 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d401adc2-82a7-4182-81cb-b2f2dfc38434 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:53.580175 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d401adc2-82a7-4182-81cb-b2f2dfc38434 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d401adc2-82a7-4182-81cb-b2f2dfc38434 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:53.588643 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:53.589750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:53.590613 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:53.590613 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:53.590613 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:53.590613 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:53.590613 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:53.590613 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:53.590613 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:53.590613 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:53.590613 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:53.590613 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:53.590613 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:53.590613 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:53.598169 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 321/630] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:53.599991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401adc2-82a7-4182-81cb-b2f2dfc38434 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:53.641293 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:53.655464 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dbb852-09b2-4dee-98e4-d58c8e1f1c6a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:53.693885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce400a6-5562-4846-867b-0ffc8eb6abf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:53.695855 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce400a6-5562-4846-867b-0ffc8eb6abf6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:53.696393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce400a6-5562-4846-867b-0ffc8eb6abf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:53.696870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce400a6-5562-4846-867b-0ffc8eb6abf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:53.697824 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce400a6-5562-4846-867b-0ffc8eb6abf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:53.698747 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce400a6-5562-4846-867b-0ffc8eb6abf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:53.700634 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce400a6-5562-4846-867b-0ffc8eb6abf6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:53.709995 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d401adc2-82a7-4182-81cb-b2f2dfc38434 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:53.716713 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 310/631] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:53.718094 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce400a6-5562-4846-867b-0ffc8eb6abf6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:53.745480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d805d-c538-49de-ac6a-ac9e9c55e566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:53.746311 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d805d-c538-49de-ac6a-ac9e9c55e566 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:53.746588 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d805d-c538-49de-ac6a-ac9e9c55e566 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:53.746866 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d805d-c538-49de-ac6a-ac9e9c55e566 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:53.753782 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d805d-c538-49de-ac6a-ac9e9c55e566 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:53.755252 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d805d-c538-49de-ac6a-ac9e9c55e566 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:53.769702 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-6a4d805d-c538-49de-ac6a-ac9e9c55e566 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:53.769702 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:53.769702 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:53.769702 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:53.769702 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:53.769702 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:53.769702 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:53.769702 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:53.769702 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:53.769702 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:53.769702 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:53.769702 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:53.769702 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:58:53.769702 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:58:53.769702 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:53.770904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:53.772026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:58:53.772026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:58:53.772026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:58:53.772026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:58:53.772026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:58:53.772026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:58:53.772026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:53.772026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:53.772026 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 322/632] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:53.772556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc5613-4fb2-47bd-abd2-1881623fc9e6 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:53.772717 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc5613-4fb2-47bd-abd2-1881623fc9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:53.772996 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc5613-4fb2-47bd-abd2-1881623fc9e6 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:53.778487 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 323/633] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:53.778487 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc5613-4fb2-47bd-abd2-1881623fc9e6 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:53.835045 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:53.844069 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce400a6-5562-4846-867b-0ffc8eb6abf6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:53.887252 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101da66e-7860-4e91-a59a-ed85b3008f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:53.887632 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc5613-4fb2-47bd-abd2-1881623fc9e6 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:53.887955 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101da66e-7860-4e91-a59a-ed85b3008f0a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:53.888236 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101da66e-7860-4e91-a59a-ed85b3008f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:53.888509 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101da66e-7860-4e91-a59a-ed85b3008f0a None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:53.889368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101da66e-7860-4e91-a59a-ed85b3008f0a None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:53.889673 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101da66e-7860-4e91-a59a-ed85b3008f0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:53.891174 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101da66e-7860-4e91-a59a-ed85b3008f0a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:53.904855 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 311/634] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:58:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:53.905827 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101da66e-7860-4e91-a59a-ed85b3008f0a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:53.919472 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:53.921854 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f374d2-3405-4935-8b2e-74234c0af67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:53.922765 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f374d2-3405-4935-8b2e-74234c0af67e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:53.923090 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f374d2-3405-4935-8b2e-74234c0af67e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:53.923359 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f374d2-3405-4935-8b2e-74234c0af67e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:53.930095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f374d2-3405-4935-8b2e-74234c0af67e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:53.931673 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f374d2-3405-4935-8b2e-74234c0af67e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:53.946220 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-23f374d2-3405-4935-8b2e-74234c0af67e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:53.946220 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:53.946220 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:53.946220 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:53.946220 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:53.946220 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:53.946220 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:53.946220 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:53.946220 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:53.946220 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:53.946220 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:53.946220 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:53.946220 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:58:53.946220 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:58:53.946220 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:53.947161 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:53.948098 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:58:53.948098 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:58:53.948098 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:58:53.948098 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:58:53.948098 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:58:53.948098 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:58:53.948098 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:53.948098 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:53.952207 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 324/635] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:53.953510 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5436ae-aa8e-4525-acdc-0b0791759d4d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:53.953856 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5436ae-aa8e-4525-acdc-0b0791759d4d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:53.954114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5436ae-aa8e-4525-acdc-0b0791759d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:53.971287 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1d5436ae-aa8e-4525-acdc-0b0791759d4d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:53.972524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1d5436ae-aa8e-4525-acdc-0b0791759d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:54.011399 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101da66e-7860-4e91-a59a-ed85b3008f0a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:54.042671 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 325/636] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:54.044397 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5436ae-aa8e-4525-acdc-0b0791759d4d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:54.046093 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e31680-7771-408a-bc04-c1db1021afb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:54.046769 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31680-7771-408a-bc04-c1db1021afb0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:54.047052 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31680-7771-408a-bc04-c1db1021afb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:54.047356 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e31680-7771-408a-bc04-c1db1021afb0 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:54.048154 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e31680-7771-408a-bc04-c1db1021afb0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:54.048466 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e31680-7771-408a-bc04-c1db1021afb0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:54.050023 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e31680-7771-408a-bc04-c1db1021afb0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:54.067453 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 312/637] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:58:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:54.067453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e31680-7771-408a-bc04-c1db1021afb0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:54.098639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:54.141928 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:54.156975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5436ae-aa8e-4525-acdc-0b0791759d4d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:54.177088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e31680-7771-408a-bc04-c1db1021afb0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:54.190440 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c61d58-cbf2-4ac5-abb1-72855163031f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:54.191262 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c61d58-cbf2-4ac5-abb1-72855163031f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:54.191582 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c61d58-cbf2-4ac5-abb1-72855163031f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:54.191863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c61d58-cbf2-4ac5-abb1-72855163031f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:54.202318 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c61d58-cbf2-4ac5-abb1-72855163031f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:54.203877 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c61d58-cbf2-4ac5-abb1-72855163031f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:54.212052 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9106ce1-90ae-4e4a-99a6-998ba6e19141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:54.212728 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9106ce1-90ae-4e4a-99a6-998ba6e19141 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:54.213008 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9106ce1-90ae-4e4a-99a6-998ba6e19141 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:54.213284 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9106ce1-90ae-4e4a-99a6-998ba6e19141 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:54.214069 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9106ce1-90ae-4e4a-99a6-998ba6e19141 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:54.214376 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9106ce1-90ae-4e4a-99a6-998ba6e19141 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:54.215857 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9106ce1-90ae-4e4a-99a6-998ba6e19141 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:54.221598 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-12c61d58-cbf2-4ac5-abb1-72855163031f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:54.221598 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:54.221598 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:54.221598 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:54.221598 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:54.221598 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:54.221598 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:54.221598 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:54.221598 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:54.221598 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:54.221598 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:54.221598 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:54.221598 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:54.221598 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:54.221598 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:54.222562 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:54.223498 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:54.223498 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:54.223498 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:54.223498 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:54.223498 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 326/638] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:54.223803 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c61d58-cbf2-4ac5-abb1-72855163031f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:54.227099 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 313/639] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:58:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:54.227942 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9106ce1-90ae-4e4a-99a6-998ba6e19141 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:54.323702 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:54.328763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9106ce1-90ae-4e4a-99a6-998ba6e19141 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:54.330854 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c61d58-cbf2-4ac5-abb1-72855163031f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:54.356609 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:54.363362 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa5731-bce2-48ca-a93e-0c0975ee306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:54.364160 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228025c-f1a4-4e6a-83de-720421df9ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:54.364317 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa5731-bce2-48ca-a93e-0c0975ee306a None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:54.364533 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa5731-bce2-48ca-a93e-0c0975ee306a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:54.364810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa5731-bce2-48ca-a93e-0c0975ee306a None admin] PATH_INFO: `/v3/projects/604801625292482a9fb4b70c416dc438/users/dea37db9b0f3432093e8fe89d5fcc687/roles/566ec5e1e87245cea292823f58d150fd` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:54.364956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228025c-f1a4-4e6a-83de-720421df9ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:54.365228 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228025c-f1a4-4e6a-83de-720421df9ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:54.365503 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228025c-f1a4-4e6a-83de-720421df9ed2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:54.375330 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228025c-f1a4-4e6a-83de-720421df9ed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:54.378980 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa5731-bce2-48ca-a93e-0c0975ee306a None admin] RBAC: Authorizing `identity:create_grant(project_id=604801625292482a9fb4b70c416dc438, user_id=dea37db9b0f3432093e8fe89d5fcc687, role_id=566ec5e1e87245cea292823f58d150fd)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:54.380490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34aa5731-bce2-48ca-a93e-0c0975ee306a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-0228025c-f1a4-4e6a-83de-720421df9ed2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:54.383065 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:54.384193 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:54.385212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:54.385212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:54.385212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:54.385212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:54.385212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:54.385212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:54.385212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:54.385212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:54.385212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:54.385212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:54.385212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:54.385212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:54.385212 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 327/640] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:54.386134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12219dc-08c3-4d23-8d05-f3e3a4bd52f3 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:54.386134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12219dc-08c3-4d23-8d05-f3e3a4bd52f3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:54.386134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12219dc-08c3-4d23-8d05-f3e3a4bd52f3 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:54.387531 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 328/641] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:54.389336 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12219dc-08c3-4d23-8d05-f3e3a4bd52f3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:54.399256 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 314/642] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:58:54 2022] PUT /identity/v3/projects/604801625292482a9fb4b70c416dc438/users/dea37db9b0f3432093e8fe89d5fcc687/roles/566ec5e1e87245cea292823f58d150fd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:58:54.400116 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa5731-bce2-48ca-a93e-0c0975ee306a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:54.515813 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa5731-bce2-48ca-a93e-0c0975ee306a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:54.520716 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12219dc-08c3-4d23-8d05-f3e3a4bd52f3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:54.559235 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e28630-c3c7-49fb-b367-58a525e4c03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:54.561676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e28630-c3c7-49fb-b367-58a525e4c03c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:54.561676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e28630-c3c7-49fb-b367-58a525e4c03c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:54.561676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e28630-c3c7-49fb-b367-58a525e4c03c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:54.561676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e28630-c3c7-49fb-b367-58a525e4c03c None admin] RBAC: Adding query filter params (role.id=566ec5e1e87245cea292823f58d150fd, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=6c32c443ee1a421e98e7656e8e86e27a) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:54.561997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4015a1-272a-46f9-8149-01f002605743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:54.562086 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e28630-c3c7-49fb-b367-58a525e4c03c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:54.562388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4015a1-272a-46f9-8149-01f002605743 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:54.562676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4015a1-272a-46f9-8149-01f002605743 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:54.562952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4015a1-272a-46f9-8149-01f002605743 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:54.563179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e28630-c3c7-49fb-b367-58a525e4c03c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:54.563711 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4015a1-272a-46f9-8149-01f002605743 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:54.564021 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4015a1-272a-46f9-8149-01f002605743 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:54.565385 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4015a1-272a-46f9-8149-01f002605743 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:54.570388 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 315/643] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:54 2022] GET /identity/v3/role_assignments?user.id=6c32c443ee1a421e98e7656e8e86e27a&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=566ec5e1e87245cea292823f58d150fd => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:54.571244 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e28630-c3c7-49fb-b367-58a525e4c03c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:54.586507 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 329/644] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:54.588287 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c46f1-32cb-441d-b152-a54ec6804242 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:54.588586 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c46f1-32cb-441d-b152-a54ec6804242 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:54.588870 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9c46f1-32cb-441d-b152-a54ec6804242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:54.607269 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3c9c46f1-32cb-441d-b152-a54ec6804242 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:54.608545 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3c9c46f1-32cb-441d-b152-a54ec6804242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:54.619750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:54.626079 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:54.689201 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 330/645] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:54.690090 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c46f1-32cb-441d-b152-a54ec6804242 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:54.719515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e28630-c3c7-49fb-b367-58a525e4c03c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:54.758790 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386713a6-099e-49e9-81e1-7b7538441ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:54.759535 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386713a6-099e-49e9-81e1-7b7538441ccf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:54.759888 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386713a6-099e-49e9-81e1-7b7538441ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:54.760174 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386713a6-099e-49e9-81e1-7b7538441ccf None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:54.761032 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386713a6-099e-49e9-81e1-7b7538441ccf None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:54.761480 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386713a6-099e-49e9-81e1-7b7538441ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:54.762817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386713a6-099e-49e9-81e1-7b7538441ccf None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:54.776566 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 316/646] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:58:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:54.777427 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386713a6-099e-49e9-81e1-7b7538441ccf None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:54.828484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9c46f1-32cb-441d-b152-a54ec6804242 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:54.874264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21138f38-fdf4-48c7-8c99-b1f32cbe5ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:54.875014 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21138f38-fdf4-48c7-8c99-b1f32cbe5ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:54.875358 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21138f38-fdf4-48c7-8c99-b1f32cbe5ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:54.875607 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21138f38-fdf4-48c7-8c99-b1f32cbe5ae7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:54.884230 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21138f38-fdf4-48c7-8c99-b1f32cbe5ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:54.885716 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21138f38-fdf4-48c7-8c99-b1f32cbe5ae7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-21138f38-fdf4-48c7-8c99-b1f32cbe5ae7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:54.901072 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:54.902093 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:54.903231 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:54.903231 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:54.903231 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:54.903231 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:54.903231 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:54.903231 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:54.903231 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:54.903231 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:54.903231 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:58:54.903231 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:54.903231 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 331/647] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:54.903231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21138f38-fdf4-48c7-8c99-b1f32cbe5ae7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:54.907662 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:54.922747 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386713a6-099e-49e9-81e1-7b7538441ccf None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:54.929430 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:54.965495 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7a9bd-5688-42b6-b610-26dd3ee907b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:54.966315 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7a9bd-5688-42b6-b610-26dd3ee907b5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:54.966839 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7a9bd-5688-42b6-b610-26dd3ee907b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:54.967179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a7a9bd-5688-42b6-b610-26dd3ee907b5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:54.982425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a7a9bd-5688-42b6-b610-26dd3ee907b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-f8a7a9bd-5688-42b6-b610-26dd3ee907b5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:54.993656 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:54.994842 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:54.995924 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:54.995924 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:54.995924 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:54.995924 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:54.995924 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:54.995924 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:54.995924 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:54.995924 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:54.995924 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:54.995924 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:54.995924 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:54.995924 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:54.995924 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 317/648] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:55.000133 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7a9bd-5688-42b6-b610-26dd3ee907b5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:55.025570 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21138f38-fdf4-48c7-8c99-b1f32cbe5ae7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:55.061032 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdb2c1-ce45-4d20-a7d2-70371feae866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:55.062042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdb2c1-ce45-4d20-a7d2-70371feae866 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:55.062320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdb2c1-ce45-4d20-a7d2-70371feae866 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:55.062589 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdb2c1-ce45-4d20-a7d2-70371feae866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:55.081231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdb2c1-ce45-4d20-a7d2-70371feae866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:55.083675 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdb2c1-ce45-4d20-a7d2-70371feae866 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:55.110541 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-a8cdb2c1-ce45-4d20-a7d2-70371feae866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:55.110541 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:55.110541 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:55.110541 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:55.110541 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:55.110541 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:55.110541 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:55.110541 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:55.110541 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:55.110541 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:55.110541 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:55.110541 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:55.110541 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:55.110541 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:55.110541 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:55.111555 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:55.112472 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:55.112472 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:55.112472 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:55.112472 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:55.113521 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 332/649] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:55.113767 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdb2c1-ce45-4d20-a7d2-70371feae866 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:55.128088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a7a9bd-5688-42b6-b610-26dd3ee907b5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:55.169529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d198f92-e3f2-4d8e-bcc4-4282e404cba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:55.170332 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d198f92-e3f2-4d8e-bcc4-4282e404cba1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:55.170617 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d198f92-e3f2-4d8e-bcc4-4282e404cba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:55.170897 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d198f92-e3f2-4d8e-bcc4-4282e404cba1 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:55.172155 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d198f92-e3f2-4d8e-bcc4-4282e404cba1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:55.172483 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d198f92-e3f2-4d8e-bcc4-4282e404cba1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:55.174250 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d198f92-e3f2-4d8e-bcc4-4282e404cba1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:55.188370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:55.199376 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 318/650] 10.222.0.42 () {56 vars in 1137 bytes} [Sun Jul 24 00:58:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:55.200523 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d198f92-e3f2-4d8e-bcc4-4282e404cba1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:55.232292 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:55.240617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdb2c1-ce45-4d20-a7d2-70371feae866 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:55.275448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70705292-a518-4886-94bf-8ccf51df54a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:55.276265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705292-a518-4886-94bf-8ccf51df54a1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:55.276553 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705292-a518-4886-94bf-8ccf51df54a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:55.276831 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70705292-a518-4886-94bf-8ccf51df54a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:55.278150 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70705292-a518-4886-94bf-8ccf51df54a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:55.278150 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70705292-a518-4886-94bf-8ccf51df54a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:55.279305 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70705292-a518-4886-94bf-8ccf51df54a1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:55.293163 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 333/651] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:58:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:55.294112 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70705292-a518-4886-94bf-8ccf51df54a1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:55.309389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d198f92-e3f2-4d8e-bcc4-4282e404cba1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:55.350222 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2fb5f-652e-4e6c-ac21-d0caaa5c16a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:55.351460 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2fb5f-652e-4e6c-ac21-d0caaa5c16a3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:55.352257 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2fb5f-652e-4e6c-ac21-d0caaa5c16a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:55.353012 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2fb5f-652e-4e6c-ac21-d0caaa5c16a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:55.354101 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2fb5f-652e-4e6c-ac21-d0caaa5c16a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:55.354929 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2fb5f-652e-4e6c-ac21-d0caaa5c16a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:55.356991 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2fb5f-652e-4e6c-ac21-d0caaa5c16a3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:55.371731 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 319/652] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:55.373268 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2fb5f-652e-4e6c-ac21-d0caaa5c16a3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:55.396848 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70705292-a518-4886-94bf-8ccf51df54a1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:55.416630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:55.438079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f804d5-209f-41b9-89c1-c0d7d05fd168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:55.439053 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f804d5-209f-41b9-89c1-c0d7d05fd168 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:55.439370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f804d5-209f-41b9-89c1-c0d7d05fd168 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:55.439651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f804d5-209f-41b9-89c1-c0d7d05fd168 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:55.475694 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:55.495735 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2fb5f-652e-4e6c-ac21-d0caaa5c16a3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:55.525114 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc410c-e914-47c3-bce4-15307210ddd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:55.525943 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc410c-e914-47c3-bce4-15307210ddd1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:55.526238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc410c-e914-47c3-bce4-15307210ddd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:55.526506 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc410c-e914-47c3-bce4-15307210ddd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:55.528913 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f804d5-209f-41b9-89c1-c0d7d05fd168 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:55.530739 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f804d5-209f-41b9-89c1-c0d7d05fd168 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:55.538989 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc410c-e914-47c3-bce4-15307210ddd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:55.540602 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc410c-e914-47c3-bce4-15307210ddd1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:55.558788 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-37cc410c-e914-47c3-bce4-15307210ddd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:55.558788 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:55.558788 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:55.558788 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:55.558788 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:55.558788 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:55.558788 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:55.558788 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:55.558788 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:55.558788 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:55.558788 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:55.558788 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:55.558788 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:55.558788 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:55.558788 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:55.559980 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:55.561147 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:55.561147 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:55.561147 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:55.561147 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:55.564684 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 320/653] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:55.565553 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc410c-e914-47c3-bce4-15307210ddd1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:55.648446 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 334/654] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:55.650069 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f804d5-209f-41b9-89c1-c0d7d05fd168 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:55.671096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:55.677663 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc410c-e914-47c3-bce4-15307210ddd1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:55.722100 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a0b07-c61c-408c-b9ba-bf6af092cb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:55.722918 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a0b07-c61c-408c-b9ba-bf6af092cb3f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:55.723200 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a0b07-c61c-408c-b9ba-bf6af092cb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:55.723505 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a0b07-c61c-408c-b9ba-bf6af092cb3f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:55.727363 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:55.734228 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a0b07-c61c-408c-b9ba-bf6af092cb3f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:55.736553 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a0b07-c61c-408c-b9ba-bf6af092cb3f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-fd0a0b07-c61c-408c-b9ba-bf6af092cb3f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:55.754209 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:55.755207 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:55.756323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:55.756323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:55.756323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:55.756323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:55.756323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:55.756323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:55.756323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:55.756323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:55.756323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 24 00:58:55.756323 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:55.758815 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 321/655] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:55.759879 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a0b07-c61c-408c-b9ba-bf6af092cb3f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:55.767765 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f804d5-209f-41b9-89c1-c0d7d05fd168 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:55.811538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad52da-d212-4796-a775-c3402c176ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:55.812271 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad52da-d212-4796-a775-c3402c176ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:55.812563 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad52da-d212-4796-a775-c3402c176ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:55.812848 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cad52da-d212-4796-a775-c3402c176ff4 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:55.813583 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad52da-d212-4796-a775-c3402c176ff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:55.813953 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad52da-d212-4796-a775-c3402c176ff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:55.816101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cad52da-d212-4796-a775-c3402c176ff4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:55.835381 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 335/656] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:55.836635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad52da-d212-4796-a775-c3402c176ff4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:55.878465 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a0b07-c61c-408c-b9ba-bf6af092cb3f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:55.925895 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:55.932542 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c60976-7e96-4495-b426-0ac4005e3356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:55.933371 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c60976-7e96-4495-b426-0ac4005e3356 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:55.933660 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c60976-7e96-4495-b426-0ac4005e3356 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:55.933943 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c60976-7e96-4495-b426-0ac4005e3356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:55.947583 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c60976-7e96-4495-b426-0ac4005e3356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:55.949077 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c60976-7e96-4495-b426-0ac4005e3356 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:55.951972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cad52da-d212-4796-a775-c3402c176ff4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:55.968002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-e8c60976-7e96-4495-b426-0ac4005e3356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:55.968002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:55.968002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:55.968002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:55.968002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:55.968002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:55.968002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:55.968002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:55.968002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:55.968002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:55.968002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:55.968002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:55.968002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:55.968002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:55.968002 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:55.969055 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:55.970045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:55.970045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:55.970045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:55.970045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:55.973959 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 322/657] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:55.974982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c60976-7e96-4495-b426-0ac4005e3356 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:55.991734 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff464843-e03d-482a-869e-a52e212bf795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:55.992847 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff464843-e03d-482a-869e-a52e212bf795 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:55.993339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff464843-e03d-482a-869e-a52e212bf795 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:55.993819 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff464843-e03d-482a-869e-a52e212bf795 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:55.994883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff464843-e03d-482a-869e-a52e212bf795 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:55.995440 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff464843-e03d-482a-869e-a52e212bf795 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:55.997096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff464843-e03d-482a-869e-a52e212bf795 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:56.015246 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 336/658] 10.222.0.42 () {56 vars in 1139 bytes} [Sun Jul 24 00:58:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:56.016398 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff464843-e03d-482a-869e-a52e212bf795 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:56.027695 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:56.082682 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c60976-7e96-4495-b426-0ac4005e3356 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:56.118256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9e65d-8883-4013-8312-8171dc9e48e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:56.119324 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9e65d-8883-4013-8312-8171dc9e48e3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:56.119450 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9e65d-8883-4013-8312-8171dc9e48e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:56.119710 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9e65d-8883-4013-8312-8171dc9e48e3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:56.122497 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff464843-e03d-482a-869e-a52e212bf795 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:56.127731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9e65d-8883-4013-8312-8171dc9e48e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:56.129253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9e65d-8883-4013-8312-8171dc9e48e3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-3be9e65d-8883-4013-8312-8171dc9e48e3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:56.144206 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:56.145238 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:56.146243 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:56.146243 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:56.146243 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:56.146243 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:56.146243 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:56.146243 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:56.146243 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:56.146243 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:56.146243 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 24 00:58:56.146243 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:56.150024 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 323/659] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:55 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:56.151118 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9e65d-8883-4013-8312-8171dc9e48e3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:56.161966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68aee1-cefc-47bb-9453-0e2d915a51f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:56.162955 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68aee1-cefc-47bb-9453-0e2d915a51f2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:56.163514 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68aee1-cefc-47bb-9453-0e2d915a51f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:56.164001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68aee1-cefc-47bb-9453-0e2d915a51f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:56.164980 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68aee1-cefc-47bb-9453-0e2d915a51f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:56.165505 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68aee1-cefc-47bb-9453-0e2d915a51f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:56.167091 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68aee1-cefc-47bb-9453-0e2d915a51f2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:56.169726 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:56.180372 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 337/660] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:56.182414 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68aee1-cefc-47bb-9453-0e2d915a51f2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:56.260559 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9e65d-8883-4013-8312-8171dc9e48e3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:56.269931 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:56.285609 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68aee1-cefc-47bb-9453-0e2d915a51f2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:56.296148 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae6555-9c62-450d-8a23-ee2b29cd6fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:56.296815 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae6555-9c62-450d-8a23-ee2b29cd6fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:56.297102 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae6555-9c62-450d-8a23-ee2b29cd6fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:56.297381 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae6555-9c62-450d-8a23-ee2b29cd6fb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:56.322271 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd02aa0-bcd6-4bf8-8583-8c91bf283c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:56.323351 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd02aa0-bcd6-4bf8-8583-8c91bf283c95 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:56.323863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd02aa0-bcd6-4bf8-8583-8c91bf283c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:56.324343 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd02aa0-bcd6-4bf8-8583-8c91bf283c95 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:56.325399 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd02aa0-bcd6-4bf8-8583-8c91bf283c95 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:56.325916 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd02aa0-bcd6-4bf8-8583-8c91bf283c95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:56.327606 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd02aa0-bcd6-4bf8-8583-8c91bf283c95 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:56.350806 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 338/661] 10.222.0.42 () {56 vars in 1137 bytes} [Sun Jul 24 00:58:56 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:56.352123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd02aa0-bcd6-4bf8-8583-8c91bf283c95 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:56.369882 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae6555-9c62-450d-8a23-ee2b29cd6fb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:56.371398 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae6555-9c62-450d-8a23-ee2b29cd6fb4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:56.409717 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:56.457188 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd02aa0-bcd6-4bf8-8583-8c91bf283c95 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:56.475839 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 324/662] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:56.476860 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae6555-9c62-450d-8a23-ee2b29cd6fb4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:56.487583 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:56.495049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95416133-3a9c-4834-9c68-d8deddee1217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:56.495972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95416133-3a9c-4834-9c68-d8deddee1217 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:56.496264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95416133-3a9c-4834-9c68-d8deddee1217 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:56.496596 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95416133-3a9c-4834-9c68-d8deddee1217 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:56.503456 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95416133-3a9c-4834-9c68-d8deddee1217 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:56.504924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95416133-3a9c-4834-9c68-d8deddee1217 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:56.519042 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-95416133-3a9c-4834-9c68-d8deddee1217 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:56.519042 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:56.519042 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:56.519042 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:56.519042 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:56.519042 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:56.519042 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:56.519042 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:56.519042 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:56.519042 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:56.519042 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:56.519042 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:56.519042 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:58:56.519042 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:58:56.519042 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:56.520188 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:56.521129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:58:56.521129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:58:56.521129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:58:56.521129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:58:56.521129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:58:56.521129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:58:56.521129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:56.521129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:56.521129 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 339/663] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:56.521653 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95416133-3a9c-4834-9c68-d8deddee1217 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:56.591869 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae6555-9c62-450d-8a23-ee2b29cd6fb4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:56.624000 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95416133-3a9c-4834-9c68-d8deddee1217 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:56.628241 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b3133-c806-41e0-b2cc-7c45f637f325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:56.628902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b3133-c806-41e0-b2cc-7c45f637f325 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:56.629184 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b3133-c806-41e0-b2cc-7c45f637f325 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:56.629459 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b3133-c806-41e0-b2cc-7c45f637f325 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:56.639284 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:56.662238 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cc5ed-5028-4725-b39b-cdfaec8c2da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:56.663082 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cc5ed-5028-4725-b39b-cdfaec8c2da7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:56.663382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cc5ed-5028-4725-b39b-cdfaec8c2da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:56.663666 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cc5ed-5028-4725-b39b-cdfaec8c2da7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:56.674819 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cc5ed-5028-4725-b39b-cdfaec8c2da7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:56.676386 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cc5ed-5028-4725-b39b-cdfaec8c2da7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:56.695330 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-592cc5ed-5028-4725-b39b-cdfaec8c2da7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:56.695330 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:56.695330 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:56.695330 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:56.695330 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:56.695330 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:56.695330 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:56.695330 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:56.695330 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:56.695330 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:56.695330 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:56.695330 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:56.695330 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:56.695330 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:56.695330 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:56.696316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:56.697223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:56.697223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:56.697223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:56.697223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:56.697223 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 340/664] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:56.698022 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a9253-f295-417b-8688-81c7d8bb6e49 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:56.698122 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a9253-f295-417b-8688-81c7d8bb6e49 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:56.698395 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a9253-f295-417b-8688-81c7d8bb6e49 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:56.703575 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 341/665] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:56.704430 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a9253-f295-417b-8688-81c7d8bb6e49 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:56.705384 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b3133-c806-41e0-b2cc-7c45f637f325 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:56.706884 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45b3133-c806-41e0-b2cc-7c45f637f325 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:56.719717 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:56.815334 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 325/666] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 24 00:58:56.816029 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b3133-c806-41e0-b2cc-7c45f637f325 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:56.817436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a9253-f295-417b-8688-81c7d8bb6e49 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:56.851311 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81700d1d-211e-43c4-aea9-11dda41dea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:56.852009 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81700d1d-211e-43c4-aea9-11dda41dea95 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:56.852297 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81700d1d-211e-43c4-aea9-11dda41dea95 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:56.852572 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81700d1d-211e-43c4-aea9-11dda41dea95 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:56.853362 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81700d1d-211e-43c4-aea9-11dda41dea95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:56.853674 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81700d1d-211e-43c4-aea9-11dda41dea95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:56.855111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81700d1d-211e-43c4-aea9-11dda41dea95 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:56.866359 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 342/667] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:58:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:56.867515 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6d21-dd3a-4f98-9859-3b3899ca79c8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:56.867899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6d21-dd3a-4f98-9859-3b3899ca79c8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:56.868182 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6e6d21-dd3a-4f98-9859-3b3899ca79c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:56.883556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5d6e6d21-dd3a-4f98-9859-3b3899ca79c8 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:56.884763 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5d6e6d21-dd3a-4f98-9859-3b3899ca79c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:56.903997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:56.915495 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45b3133-c806-41e0-b2cc-7c45f637f325 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:56.924732 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:56.949567 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10f232-6d3d-4abf-bc16-f3223f4e6c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:56.950242 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10f232-6d3d-4abf-bc16-f3223f4e6c4a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:56.950529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10f232-6d3d-4abf-bc16-f3223f4e6c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:56.950812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab10f232-6d3d-4abf-bc16-f3223f4e6c4a None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:56.951114 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 343/668] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:56.951562 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10f232-6d3d-4abf-bc16-f3223f4e6c4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:56.951878 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10f232-6d3d-4abf-bc16-f3223f4e6c4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:56.952442 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca772f-50af-41f4-ad38-45b6a33ba095 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:56.952730 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca772f-50af-41f4-ad38-45b6a33ba095 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:56.953005 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca772f-50af-41f4-ad38-45b6a33ba095 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:56.953265 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab10f232-6d3d-4abf-bc16-f3223f4e6c4a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:56.954436 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 344/669] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:56.956023 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca772f-50af-41f4-ad38-45b6a33ba095 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:56.969798 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 326/670] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:56.970405 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10f232-6d3d-4abf-bc16-f3223f4e6c4a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:57.068476 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca772f-50af-41f4-ad38-45b6a33ba095 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:57.071930 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab10f232-6d3d-4abf-bc16-f3223f4e6c4a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:57.101382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a4e5a-20b4-4fa2-be1a-fb6ef33ec487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:57.102200 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a4e5a-20b4-4fa2-be1a-fb6ef33ec487 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:57.102479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a4e5a-20b4-4fa2-be1a-fb6ef33ec487 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:57.102751 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5a4e5a-20b4-4fa2-be1a-fb6ef33ec487 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:57.106002 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865543f-7e13-49d1-a674-458f43c3b788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:57.106653 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865543f-7e13-49d1-a674-458f43c3b788 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:57.106937 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865543f-7e13-49d1-a674-458f43c3b788 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:57.107209 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865543f-7e13-49d1-a674-458f43c3b788 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:57.108057 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865543f-7e13-49d1-a674-458f43c3b788 None admin] RBAC: Adding query filter params (role.id=566ec5e1e87245cea292823f58d150fd, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=fa52d40556494110bf6962e09addfc15) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:57.108369 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865543f-7e13-49d1-a674-458f43c3b788 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:57.109812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865543f-7e13-49d1-a674-458f43c3b788 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:57.112411 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a4e5a-20b4-4fa2-be1a-fb6ef33ec487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:57.113836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5a4e5a-20b4-4fa2-be1a-fb6ef33ec487 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:57.115755 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 327/671] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:56 2022] GET /identity/v3/role_assignments?user.id=fa52d40556494110bf6962e09addfc15&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=566ec5e1e87245cea292823f58d150fd => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:57.116911 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985489e-a353-4e5e-a1ca-c57384f72f3c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:57.117200 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985489e-a353-4e5e-a1ca-c57384f72f3c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:57.117474 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9985489e-a353-4e5e-a1ca-c57384f72f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:57.139826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-3d5a4e5a-20b4-4fa2-be1a-fb6ef33ec487 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:57.139826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:57.139826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:57.139826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:57.139826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:57.139826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:57.139826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:57.139826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:57.139826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:57.139826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:57.139826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:57.139826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:57.139826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:57.139826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:57.139826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:57.140839 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:57.147075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:57.147075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:57.147075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:57.147075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:57.147075 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 345/672] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:57.147436 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9985489e-a353-4e5e-a1ca-c57384f72f3c None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:57.147542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a4e5a-20b4-4fa2-be1a-fb6ef33ec487 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:57.147633 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9985489e-a353-4e5e-a1ca-c57384f72f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:57.158460 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:57.174851 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:57.222084 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 328/673] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:57.223185 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985489e-a353-4e5e-a1ca-c57384f72f3c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:57.274317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5a4e5a-20b4-4fa2-be1a-fb6ef33ec487 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:57.314031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8e162-753a-4278-800f-8905d7eb469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:57.314852 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8e162-753a-4278-800f-8905d7eb469f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:57.315134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8e162-753a-4278-800f-8905d7eb469f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:57.315444 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8e162-753a-4278-800f-8905d7eb469f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:57.324404 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8e162-753a-4278-800f-8905d7eb469f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:57.325989 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8e162-753a-4278-800f-8905d7eb469f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:57.337230 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9985489e-a353-4e5e-a1ca-c57384f72f3c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:57.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-38f8e162-753a-4278-800f-8905d7eb469f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:57.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:57.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:57.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:57.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:57.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:57.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:57.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:57.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:57.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:57.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:57.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:57.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:58:57.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:58:57.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:57.345528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:57.346623 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:58:57.346623 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:58:57.346623 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:58:57.346623 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:58:57.346623 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:58:57.346623 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:58:57.346623 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:57.346623 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:57.347707 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 346/674] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:57.348562 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8e162-753a-4278-800f-8905d7eb469f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:57.381042 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25405c8c-c3f0-4319-aa13-cea0b6b7db41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:57.381878 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25405c8c-c3f0-4319-aa13-cea0b6b7db41 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:57.382161 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25405c8c-c3f0-4319-aa13-cea0b6b7db41 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:57.382429 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25405c8c-c3f0-4319-aa13-cea0b6b7db41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:57.392733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25405c8c-c3f0-4319-aa13-cea0b6b7db41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-25405c8c-c3f0-4319-aa13-cea0b6b7db41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:57.400601 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:57.401604 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:57.402494 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:57.402494 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:57.402494 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:57.402494 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:57.402494 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:57.402494 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:57.402494 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:57.402494 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:57.402494 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:57.402494 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:57.402494 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:58:57.402494 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:57.402494 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 329/675] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:58:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:57.403223 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25405c8c-c3f0-4319-aa13-cea0b6b7db41 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:57.421626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:57.429600 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:57.456727 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8e162-753a-4278-800f-8905d7eb469f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:57.492380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f4be0-3054-4ded-9a72-1541bf66c3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:57.493020 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f4be0-3054-4ded-9a72-1541bf66c3f7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:57.493305 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f4be0-3054-4ded-9a72-1541bf66c3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:57.493577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f4be0-3054-4ded-9a72-1541bf66c3f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:57.494303 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f4be0-3054-4ded-9a72-1541bf66c3f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:57.494608 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f4be0-3054-4ded-9a72-1541bf66c3f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:57.496033 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f4be0-3054-4ded-9a72-1541bf66c3f7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:57.512397 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 347/676] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:57.512397 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f4be0-3054-4ded-9a72-1541bf66c3f7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:57.519015 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25405c8c-c3f0-4319-aa13-cea0b6b7db41 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:57.555186 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38646dc-5ecf-42e1-80b6-8cf856254886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:57.556133 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38646dc-5ecf-42e1-80b6-8cf856254886 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:57.556417 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38646dc-5ecf-42e1-80b6-8cf856254886 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:57.556691 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38646dc-5ecf-42e1-80b6-8cf856254886 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:57.567077 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38646dc-5ecf-42e1-80b6-8cf856254886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a38646dc-5ecf-42e1-80b6-8cf856254886 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:58:57.575843 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:57.577009 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:57.583087 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:57.583087 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:57.583087 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:57.583087 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:57.583087 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:58:57.583087 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:58:57.583087 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:58:57.583087 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:58:57.583087 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:58:57.583087 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:58:57.583087 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:58:57.583087 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:57.583087 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 330/677] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:57.583087 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38646dc-5ecf-42e1-80b6-8cf856254886 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:57.617502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f4be0-3054-4ded-9a72-1541bf66c3f7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:57.644155 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:57.652348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfdc76-c672-4234-966e-ef5a3de419cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:57.653779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfdc76-c672-4234-966e-ef5a3de419cb None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:57.654063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfdc76-c672-4234-966e-ef5a3de419cb None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:57.654335 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfdc76-c672-4234-966e-ef5a3de419cb None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:57.655129 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfdc76-c672-4234-966e-ef5a3de419cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:57.655468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfdc76-c672-4234-966e-ef5a3de419cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:57.656897 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfdc76-c672-4234-966e-ef5a3de419cb None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:57.664791 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:57.675603 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 348/678] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:58:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:57.675603 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfdc76-c672-4234-966e-ef5a3de419cb None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:57.691582 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38646dc-5ecf-42e1-80b6-8cf856254886 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:57.728839 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600097f6-0aee-416b-b861-f07e5d1365a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:57.729621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600097f6-0aee-416b-b861-f07e5d1365a3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:57.730119 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600097f6-0aee-416b-b861-f07e5d1365a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:57.730377 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600097f6-0aee-416b-b861-f07e5d1365a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:57.731129 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600097f6-0aee-416b-b861-f07e5d1365a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:57.731464 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600097f6-0aee-416b-b861-f07e5d1365a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:57.733091 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600097f6-0aee-416b-b861-f07e5d1365a3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:57.746261 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 331/679] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:58:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:57.746261 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600097f6-0aee-416b-b861-f07e5d1365a3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:57.779587 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfdc76-c672-4234-966e-ef5a3de419cb None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:57.824024 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fc5e5-cda4-4f71-a314-e91648d6f439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:57.825153 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fc5e5-cda4-4f71-a314-e91648d6f439 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:57.825441 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fc5e5-cda4-4f71-a314-e91648d6f439 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:57.825867 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fc5e5-cda4-4f71-a314-e91648d6f439 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:57.833004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fc5e5-cda4-4f71-a314-e91648d6f439 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:57.834487 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fc5e5-cda4-4f71-a314-e91648d6f439 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:57.846285 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600097f6-0aee-416b-b861-f07e5d1365a3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:57.849214 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-ae3fc5e5-cda4-4f71-a314-e91648d6f439 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:57.849214 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:57.849214 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:57.849214 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:57.849214 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:57.849214 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:57.849214 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:57.849214 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:57.849214 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:57.849214 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:57.849214 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:57.849214 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:57.849214 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:58:57.849214 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:58:57.849214 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:57.850212 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:57.851259 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:58:57.851259 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:58:57.851259 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:58:57.851259 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:58:57.851259 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:58:57.851259 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:58:57.851259 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:58:57.851259 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:57.851259 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 349/680] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:58:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:57.855518 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fc5e5-cda4-4f71-a314-e91648d6f439 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:57.883727 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f600b3-f72b-4ec6-9442-b09ff1ceee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:57.884401 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f600b3-f72b-4ec6-9442-b09ff1ceee8d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:57.884681 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f600b3-f72b-4ec6-9442-b09ff1ceee8d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:57.884945 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f600b3-f72b-4ec6-9442-b09ff1ceee8d None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:57.885695 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f600b3-f72b-4ec6-9442-b09ff1ceee8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:57.885996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f600b3-f72b-4ec6-9442-b09ff1ceee8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:57.887394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f600b3-f72b-4ec6-9442-b09ff1ceee8d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:57.896814 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 332/681] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:58:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:57.897417 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f600b3-f72b-4ec6-9442-b09ff1ceee8d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:57.906912 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:57.913185 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:57.967192 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fc5e5-cda4-4f71-a314-e91648d6f439 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:58.000998 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101aa1b2-bab8-45a9-ae13-697df85562ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:58.001590 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aa1b2-bab8-45a9-ae13-697df85562ad None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:58.001770 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f600b3-f72b-4ec6-9442-b09ff1ceee8d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:58.001885 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aa1b2-bab8-45a9-ae13-697df85562ad None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:58.002134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101aa1b2-bab8-45a9-ae13-697df85562ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:58.002963 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101aa1b2-bab8-45a9-ae13-697df85562ad None admin] RBAC: Adding query filter params (role.id=566ec5e1e87245cea292823f58d150fd, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=a3efd3928e334e78b4c87bb695718299) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:58.003265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101aa1b2-bab8-45a9-ae13-697df85562ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:58.004732 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101aa1b2-bab8-45a9-ae13-697df85562ad None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:58.010768 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 350/682] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:57 2022] GET /identity/v3/role_assignments?user.id=a3efd3928e334e78b4c87bb695718299&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=566ec5e1e87245cea292823f58d150fd => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:58.011492 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101aa1b2-bab8-45a9-ae13-697df85562ad None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:58.045017 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2460024-3cec-4faf-83b8-63c8f7d21985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:58.046490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2460024-3cec-4faf-83b8-63c8f7d21985 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:58.046996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2460024-3cec-4faf-83b8-63c8f7d21985 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:58.047520 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2460024-3cec-4faf-83b8-63c8f7d21985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:58.060527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2460024-3cec-4faf-83b8-63c8f7d21985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:58.062735 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2460024-3cec-4faf-83b8-63c8f7d21985 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:58.083748 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-f2460024-3cec-4faf-83b8-63c8f7d21985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:58.083748 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:58.083748 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:58.083748 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:58.083748 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:58.083748 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:58.083748 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:58.083748 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:58.083748 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:58.083748 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:58.083748 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:58.083748 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:58.083748 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:58.083748 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:58.083748 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:58.084794 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:58.085686 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:58.085686 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:58.085686 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:58.085686 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:58.088290 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 333/683] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:58.089508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2460024-3cec-4faf-83b8-63c8f7d21985 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:58.126324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101aa1b2-bab8-45a9-ae13-697df85562ad None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:58.140879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:58.159776 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:58.164185 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca390d7-b38a-4f2d-9422-5699bc8c0fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:58.164948 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca390d7-b38a-4f2d-9422-5699bc8c0fcf None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:58.165234 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca390d7-b38a-4f2d-9422-5699bc8c0fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:58.166031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca390d7-b38a-4f2d-9422-5699bc8c0fcf None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:58.166309 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca390d7-b38a-4f2d-9422-5699bc8c0fcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:58.166639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca390d7-b38a-4f2d-9422-5699bc8c0fcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:58.168105 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca390d7-b38a-4f2d-9422-5699bc8c0fcf None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:58.182847 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 351/684] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:58:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:58.184576 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca390d7-b38a-4f2d-9422-5699bc8c0fcf None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:58.213322 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2460024-3cec-4faf-83b8-63c8f7d21985 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:58.257788 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d048ca6-b126-4bd3-9498-fb354a120df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:58.259089 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d048ca6-b126-4bd3-9498-fb354a120df7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:58.259655 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d048ca6-b126-4bd3-9498-fb354a120df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:58.259932 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d048ca6-b126-4bd3-9498-fb354a120df7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:58.275177 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d048ca6-b126-4bd3-9498-fb354a120df7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:58.276707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d048ca6-b126-4bd3-9498-fb354a120df7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:58.300137 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-4d048ca6-b126-4bd3-9498-fb354a120df7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:58.300137 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:58.300137 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:58.300137 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:58.300137 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:58.300137 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:58.300137 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:58.300137 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:58.300137 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:58.300137 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:58.300137 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:58.300137 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:58.300137 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:58.300137 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:58.300137 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:58.301111 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:58.302030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:58.302030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:58.302030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:58.302030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:58.302264 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 334/685] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:58.303457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d048ca6-b126-4bd3-9498-fb354a120df7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:58.305501 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca390d7-b38a-4f2d-9422-5699bc8c0fcf None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:58.345419 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd227a-28ab-479a-88b0-3eddbbc40ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:58.346586 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd227a-28ab-479a-88b0-3eddbbc40ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:58.347044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd227a-28ab-479a-88b0-3eddbbc40ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:58.347526 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cd227a-28ab-479a-88b0-3eddbbc40ff6 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:58.348783 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd227a-28ab-479a-88b0-3eddbbc40ff6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:58.349140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd227a-28ab-479a-88b0-3eddbbc40ff6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:58.350540 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cd227a-28ab-479a-88b0-3eddbbc40ff6 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:58.363213 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 352/686] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:58.364096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd227a-28ab-479a-88b0-3eddbbc40ff6 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:58.401613 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:58.429418 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d048ca6-b126-4bd3-9498-fb354a120df7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:58.472696 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:58.474071 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cd227a-28ab-479a-88b0-3eddbbc40ff6 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:58.479408 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a221e89-1171-4f03-b6a9-31973a53ae9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:58.480288 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221e89-1171-4f03-b6a9-31973a53ae9a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:58.480737 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221e89-1171-4f03-b6a9-31973a53ae9a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:58.481162 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a221e89-1171-4f03-b6a9-31973a53ae9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:58.482130 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a221e89-1171-4f03-b6a9-31973a53ae9a None admin] RBAC: Adding query filter params (role.id=566ec5e1e87245cea292823f58d150fd, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=adbdf910e67d4185a0ae14edf34ee3b9) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:58.483094 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a221e89-1171-4f03-b6a9-31973a53ae9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:58.485164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a221e89-1171-4f03-b6a9-31973a53ae9a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:58.499991 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 335/687] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:58:58 2022] GET /identity/v3/role_assignments?user.id=adbdf910e67d4185a0ae14edf34ee3b9&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=566ec5e1e87245cea292823f58d150fd => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:58.501915 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a221e89-1171-4f03-b6a9-31973a53ae9a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:58.528318 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ac816-db21-4a4f-8e84-61e9ed926d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:58.529192 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ac816-db21-4a4f-8e84-61e9ed926d48 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:58.529475 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ac816-db21-4a4f-8e84-61e9ed926d48 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:58.529749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0ac816-db21-4a4f-8e84-61e9ed926d48 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:58.530492 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ac816-db21-4a4f-8e84-61e9ed926d48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:58.530801 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ac816-db21-4a4f-8e84-61e9ed926d48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:58.534132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0ac816-db21-4a4f-8e84-61e9ed926d48 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:58.552743 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 353/688] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:58.558764 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ac816-db21-4a4f-8e84-61e9ed926d48 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:58.696203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a221e89-1171-4f03-b6a9-31973a53ae9a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:58.742208 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:58.745616 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc8f1e-474d-48e5-a379-7ae08dcf1598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:58.748022 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8f1e-474d-48e5-a379-7ae08dcf1598 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:58.748022 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8f1e-474d-48e5-a379-7ae08dcf1598 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:58.748022 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcc8f1e-474d-48e5-a379-7ae08dcf1598 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:58.756952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0ac816-db21-4a4f-8e84-61e9ed926d48 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:58.760238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc8f1e-474d-48e5-a379-7ae08dcf1598 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:58.762717 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcc8f1e-474d-48e5-a379-7ae08dcf1598 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-8fcc8f1e-474d-48e5-a379-7ae08dcf1598 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:58.783745 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:58.784733 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:58.785683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:58.785683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:58.785683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:58.785683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:58.785683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:58.785683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:58.785683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:58.785683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:58.785683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:58:58.785683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:58.788542 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 336/689] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:58:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:58.794458 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc8f1e-474d-48e5-a379-7ae08dcf1598 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:58.803543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc1964-706b-482b-af05-b39557848200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:58.804493 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc1964-706b-482b-af05-b39557848200 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:58.804871 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc1964-706b-482b-af05-b39557848200 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:58.805282 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc1964-706b-482b-af05-b39557848200 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:58.819784 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc1964-706b-482b-af05-b39557848200 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:58.821634 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfc1964-706b-482b-af05-b39557848200 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-dbfc1964-706b-482b-af05-b39557848200 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:58:58.838903 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:58.839942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:58.840872 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:58.840872 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:58.840872 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:58:58.840872 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:58:58.840872 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:58:58.840872 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:58:58.840872 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:58:58.840872 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:58:58.840872 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:58:58.840872 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:58.842624 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:58.844926 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 354/690] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Jul 24 00:58:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:58.851277 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc1964-706b-482b-af05-b39557848200 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:58.923435 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcc8f1e-474d-48e5-a379-7ae08dcf1598 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:58.958337 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1721a1-8ce9-4a04-bcca-599080774324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:58.959461 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1721a1-8ce9-4a04-bcca-599080774324 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:58.959959 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1721a1-8ce9-4a04-bcca-599080774324 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:58.960484 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1721a1-8ce9-4a04-bcca-599080774324 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:58.961729 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1721a1-8ce9-4a04-bcca-599080774324 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:58.962228 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1721a1-8ce9-4a04-bcca-599080774324 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:58.963902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1721a1-8ce9-4a04-bcca-599080774324 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:58.980557 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc1964-706b-482b-af05-b39557848200 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:58.987057 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 337/691] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Jul 24 00:58:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:58:58.992565 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1721a1-8ce9-4a04-bcca-599080774324 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:59.030300 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f1fe5-2208-42f0-8ab4-db3658ed6c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:59.030981 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f1fe5-2208-42f0-8ab4-db3658ed6c88 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:59.031265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f1fe5-2208-42f0-8ab4-db3658ed6c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:59.031573 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f1fe5-2208-42f0-8ab4-db3658ed6c88 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:59.032575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f1fe5-2208-42f0-8ab4-db3658ed6c88 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:59.032883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f1fe5-2208-42f0-8ab4-db3658ed6c88 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:59.035167 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f1fe5-2208-42f0-8ab4-db3658ed6c88 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:59.056576 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 355/692] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Jul 24 00:58:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:59.063799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f1fe5-2208-42f0-8ab4-db3658ed6c88 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:59.078457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:59.132328 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:59.153818 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1721a1-8ce9-4a04-bcca-599080774324 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:59.178114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f1fe5-2208-42f0-8ab4-db3658ed6c88 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:59.220244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f11339-0df9-4463-a416-c9c618be4423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:59.221262 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f11339-0df9-4463-a416-c9c618be4423 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:59.221756 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f11339-0df9-4463-a416-c9c618be4423 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:59.222219 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f11339-0df9-4463-a416-c9c618be4423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:59.237388 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5408eb-c41b-4fc6-9410-2a494fa03d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:59.238064 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5408eb-c41b-4fc6-9410-2a494fa03d80 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:59.238352 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5408eb-c41b-4fc6-9410-2a494fa03d80 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:59.238692 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5408eb-c41b-4fc6-9410-2a494fa03d80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:59.313189 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f11339-0df9-4463-a416-c9c618be4423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:59.314675 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f11339-0df9-4463-a416-c9c618be4423 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:59.326939 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:59.328564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5408eb-c41b-4fc6-9410-2a494fa03d80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:59.331078 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5408eb-c41b-4fc6-9410-2a494fa03d80 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:59.433909 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 356/693] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:58:59.434855 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:59.440593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe992b-610f-491b-bd00-01bdf85da944 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:59.440841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe992b-610f-491b-bd00-01bdf85da944 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:59.441152 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe992b-610f-491b-bd00-01bdf85da944 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:59.447122 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 357/694] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:58:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:58:59.447909 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe992b-610f-491b-bd00-01bdf85da944 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:59.453066 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 338/695] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 24 00:58:59.454595 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea319cb-72c4-449e-adce-954bb7393e18 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:59.455090 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea319cb-72c4-449e-adce-954bb7393e18 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:59.455590 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea319cb-72c4-449e-adce-954bb7393e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:59.472776 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3ea319cb-72c4-449e-adce-954bb7393e18 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:58:59.474017 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3ea319cb-72c4-449e-adce-954bb7393e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:58:59.551422 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 339/696] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:58:59.552366 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea319cb-72c4-449e-adce-954bb7393e18 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:59.557633 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbe992b-610f-491b-bd00-01bdf85da944 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:59.569212 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:59.593796 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a26e7-6f98-4a97-bd11-499a36554bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:59.594991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a26e7-6f98-4a97-bd11-499a36554bef None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:59.595510 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a26e7-6f98-4a97-bd11-499a36554bef None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:59.595994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a26e7-6f98-4a97-bd11-499a36554bef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:59.607217 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a26e7-6f98-4a97-bd11-499a36554bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:59.609002 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a26e7-6f98-4a97-bd11-499a36554bef None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:59.627184 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-3b9a26e7-6f98-4a97-bd11-499a36554bef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:59.627184 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:59.627184 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:59.627184 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:59.627184 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:59.627184 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:59.627184 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:59.627184 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:59.627184 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:59.627184 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:59.627184 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:59.627184 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:59.627184 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:59.627184 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:59.627184 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:59.628151 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:59.629070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:59.629070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:59.629070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:59.629070 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:59.631255 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 358/697] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:59.636448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a26e7-6f98-4a97-bd11-499a36554bef None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:59.670870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea319cb-72c4-449e-adce-954bb7393e18 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:59.694969 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:59.707540 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001e696-ac8d-446f-ac66-64237b2153dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:59.708364 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001e696-ac8d-446f-ac66-64237b2153dc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:59.708653 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001e696-ac8d-446f-ac66-64237b2153dc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:59.708932 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b001e696-ac8d-446f-ac66-64237b2153dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:59.719450 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001e696-ac8d-446f-ac66-64237b2153dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:59.720943 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b001e696-ac8d-446f-ac66-64237b2153dc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:59.739130 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-b001e696-ac8d-446f-ac66-64237b2153dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:59.739130 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:59.739130 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:59.739130 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:59.739130 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:59.739130 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:59.739130 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:59.739130 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:59.739130 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:59.739130 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:59.739130 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:59.739130 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:59.739130 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:58:59.739130 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:58:59.739130 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:59.740151 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:59.741064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:58:59.741064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:58:59.741064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:58:59.741064 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:58:59.743824 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a26e7-6f98-4a97-bd11-499a36554bef None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:59.745121 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 340/698] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:58:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:59.745999 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001e696-ac8d-446f-ac66-64237b2153dc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:59.779952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f02c9-dacd-46c3-aacf-93e740b12a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:59.781137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f02c9-dacd-46c3-aacf-93e740b12a09 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:59.781648 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f02c9-dacd-46c3-aacf-93e740b12a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:59.782112 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15f02c9-dacd-46c3-aacf-93e740b12a09 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:59.782960 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f02c9-dacd-46c3-aacf-93e740b12a09 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:59.784537 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15f02c9-dacd-46c3-aacf-93e740b12a09 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d15f02c9-dacd-46c3-aacf-93e740b12a09 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:58:59.804233 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:58:59.805363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:58:59.806236 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:58:59.806236 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:58:59.806236 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:58:59.806236 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:58:59.806236 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:58:59.806236 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:58:59.806236 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:58:59.806236 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:58:59.806236 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:58:59.806236 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:58:59.806236 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:58:59.806236 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:58:59.806236 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:58:59.806236 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:58:59.806236 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:58:59.814823 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 359/699] 10.222.0.42 () {56 vars in 1129 bytes} [Sun Jul 24 00:58:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:58:59.815962 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f02c9-dacd-46c3-aacf-93e740b12a09 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:59.854841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:59.862136 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b001e696-ac8d-446f-ac66-64237b2153dc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:59.905793 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbaa5c9-be29-4a08-9055-5c9e5b6f8e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:59.907629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaa5c9-be29-4a08-9055-5c9e5b6f8e6c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:59.908276 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaa5c9-be29-4a08-9055-5c9e5b6f8e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:59.908745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbaa5c9-be29-4a08-9055-5c9e5b6f8e6c None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:59.909831 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbaa5c9-be29-4a08-9055-5c9e5b6f8e6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:59.910377 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbaa5c9-be29-4a08-9055-5c9e5b6f8e6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:59.912495 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbaa5c9-be29-4a08-9055-5c9e5b6f8e6c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:58:59.931662 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 341/700] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:58:59.931662 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbaa5c9-be29-4a08-9055-5c9e5b6f8e6c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:58:59.948046 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15f02c9-dacd-46c3-aacf-93e740b12a09 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:58:59.967573 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:58:59.986767 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ab3d8-0871-437c-847a-26b083d1bd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:58:59.987786 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ab3d8-0871-437c-847a-26b083d1bd34 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:58:59.988315 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ab3d8-0871-437c-847a-26b083d1bd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:58:59.988871 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ab3d8-0871-437c-847a-26b083d1bd34 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:58:59.990014 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ab3d8-0871-437c-847a-26b083d1bd34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:58:59.990519 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ab3d8-0871-437c-847a-26b083d1bd34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:58:59.992307 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ab3d8-0871-437c-847a-26b083d1bd34 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:00.005783 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 360/701] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:58:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:00.006918 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ab3d8-0871-437c-847a-26b083d1bd34 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:00.038751 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbaa5c9-be29-4a08-9055-5c9e5b6f8e6c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:00.077346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7f05d-800e-4836-9342-753717e142d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:00.078189 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f05d-800e-4836-9342-753717e142d3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:00.078475 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f05d-800e-4836-9342-753717e142d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:00.078752 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7f05d-800e-4836-9342-753717e142d3 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:00.079541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7f05d-800e-4836-9342-753717e142d3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:00.079856 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7f05d-800e-4836-9342-753717e142d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:00.081349 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7f05d-800e-4836-9342-753717e142d3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:00.093315 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 342/702] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Jul 24 00:58:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:00.094669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7f05d-800e-4836-9342-753717e142d3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:00.110143 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:00.127121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ab3d8-0871-437c-847a-26b083d1bd34 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:00.164512 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422671d-f69b-4e60-a9f9-b0147753b422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:00.165718 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422671d-f69b-4e60-a9f9-b0147753b422 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:00.166243 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422671d-f69b-4e60-a9f9-b0147753b422 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:00.166710 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422671d-f69b-4e60-a9f9-b0147753b422 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:00.174038 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422671d-f69b-4e60-a9f9-b0147753b422 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:00.175914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422671d-f69b-4e60-a9f9-b0147753b422 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:00.191032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-f422671d-f69b-4e60-a9f9-b0147753b422 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:00.191032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:00.191032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:00.191032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:00.191032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:00.191032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:00.191032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:00.191032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:00.191032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:00.191032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:00.191032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:00.191032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:00.191032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:00.191032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:00.191032 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:00.192056 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:00.193342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:00.193342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:00.193342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:00.193342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:00.193342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:00.193342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:00.193342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:00.193342 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:00.195480 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 361/703] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:00.195480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422671d-f69b-4e60-a9f9-b0147753b422 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:00.198368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:00.202027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7f05d-800e-4836-9342-753717e142d3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:00.236634 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9311efa-96ad-40a4-afec-ec01774a20d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:00.237448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9311efa-96ad-40a4-afec-ec01774a20d8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:00.237734 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9311efa-96ad-40a4-afec-ec01774a20d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:00.238001 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9311efa-96ad-40a4-afec-ec01774a20d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:00.244862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9311efa-96ad-40a4-afec-ec01774a20d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:00.246340 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9311efa-96ad-40a4-afec-ec01774a20d8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:00.260906 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d9311efa-96ad-40a4-afec-ec01774a20d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:00.260906 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:00.260906 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:00.260906 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:00.260906 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:00.260906 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:00.260906 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:00.260906 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:00.260906 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:00.260906 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:00.260906 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:00.260906 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:00.260906 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:00.260906 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:00.260906 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:00.261830 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:00.262771 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:00.262771 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:00.262771 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:00.262771 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:00.262771 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:00.262771 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:00.262771 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:00.262771 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:00.262771 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 343/704] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:00.263885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17f0a8-688d-429e-8699-c016ac55dc39 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:00.263986 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17f0a8-688d-429e-8699-c016ac55dc39 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:00.264202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17f0a8-688d-429e-8699-c016ac55dc39 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:00.267432 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 344/705] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:00.267432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17f0a8-688d-429e-8699-c016ac55dc39 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:00.307260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422671d-f69b-4e60-a9f9-b0147753b422 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:00.343424 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74708bad-bd32-4b94-b6f8-4f54a5fd9454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:00.344094 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74708bad-bd32-4b94-b6f8-4f54a5fd9454 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:00.344374 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74708bad-bd32-4b94-b6f8-4f54a5fd9454 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:00.344646 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74708bad-bd32-4b94-b6f8-4f54a5fd9454 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:00.345369 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74708bad-bd32-4b94-b6f8-4f54a5fd9454 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:00.345704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74708bad-bd32-4b94-b6f8-4f54a5fd9454 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:00.347098 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74708bad-bd32-4b94-b6f8-4f54a5fd9454 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:00.352616 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 362/706] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Jul 24 00:59:00 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:00.353406 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74708bad-bd32-4b94-b6f8-4f54a5fd9454 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:00.376511 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:00.388367 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17f0a8-688d-429e-8699-c016ac55dc39 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:00.427130 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6803e1-f055-4ea6-a323-7b9d2619dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:00.427845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6803e1-f055-4ea6-a323-7b9d2619dfaa None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:00.428124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6803e1-f055-4ea6-a323-7b9d2619dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:00.428398 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6803e1-f055-4ea6-a323-7b9d2619dfaa None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:00.429274 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6803e1-f055-4ea6-a323-7b9d2619dfaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:00.429586 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6803e1-f055-4ea6-a323-7b9d2619dfaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:00.431172 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6803e1-f055-4ea6-a323-7b9d2619dfaa None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:00.449938 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 345/707] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:00.451455 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799794d-63ed-41d8-9fb1-243a1afa1b55 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:00.451751 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799794d-63ed-41d8-9fb1-243a1afa1b55 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:00.452031 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d799794d-63ed-41d8-9fb1-243a1afa1b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:00.474490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d799794d-63ed-41d8-9fb1-243a1afa1b55 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:00.476127 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d799794d-63ed-41d8-9fb1-243a1afa1b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:00.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74708bad-bd32-4b94-b6f8-4f54a5fd9454 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:00.493340 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:00.532141 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc323798-c876-4812-9f1c-7e5ab1628b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:00.532522 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc323798-c876-4812-9f1c-7e5ab1628b73 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:00.532756 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc323798-c876-4812-9f1c-7e5ab1628b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:00.533103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc323798-c876-4812-9f1c-7e5ab1628b73 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:00.533907 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc323798-c876-4812-9f1c-7e5ab1628b73 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:00.534266 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc323798-c876-4812-9f1c-7e5ab1628b73 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:00.535770 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc323798-c876-4812-9f1c-7e5ab1628b73 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:00.555332 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 363/708] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:00.555332 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc323798-c876-4812-9f1c-7e5ab1628b73 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:00.570237 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 346/709] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:59:00.571548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799794d-63ed-41d8-9fb1-243a1afa1b55 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:00.649914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:00.676098 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc323798-c876-4812-9f1c-7e5ab1628b73 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:00.694483 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d799794d-63ed-41d8-9fb1-243a1afa1b55 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:00.717811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b012387-31f1-4f67-8c33-58208d149143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:00.719073 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b012387-31f1-4f67-8c33-58208d149143 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:00.719446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b012387-31f1-4f67-8c33-58208d149143 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:00.720035 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b012387-31f1-4f67-8c33-58208d149143 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:00.720971 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b012387-31f1-4f67-8c33-58208d149143 None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=6c32c443ee1a421e98e7656e8e86e27a) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:00.721573 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b012387-31f1-4f67-8c33-58208d149143 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:00.723784 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b012387-31f1-4f67-8c33-58208d149143 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:00.732161 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 364/710] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:59:00 2022] GET /identity/v3/role_assignments?user.id=6c32c443ee1a421e98e7656e8e86e27a&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:00.732973 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b012387-31f1-4f67-8c33-58208d149143 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:00.740693 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fdd3a-7b52-4ceb-9130-2494b13aed78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:00.741561 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fdd3a-7b52-4ceb-9130-2494b13aed78 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:00.741937 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fdd3a-7b52-4ceb-9130-2494b13aed78 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:00.742359 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fdd3a-7b52-4ceb-9130-2494b13aed78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:00.743468 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fdd3a-7b52-4ceb-9130-2494b13aed78 None admin] RBAC: Adding query filter params (role.id=566ec5e1e87245cea292823f58d150fd, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=dea37db9b0f3432093e8fe89d5fcc687) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:00.743884 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fdd3a-7b52-4ceb-9130-2494b13aed78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:00.745434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fdd3a-7b52-4ceb-9130-2494b13aed78 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:00.761401 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 347/711] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:59:00 2022] GET /identity/v3/role_assignments?user.id=dea37db9b0f3432093e8fe89d5fcc687&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=566ec5e1e87245cea292823f58d150fd => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:00.861693 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b012387-31f1-4f67-8c33-58208d149143 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:00.901309 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca55800-c188-47ca-bae9-259c4ead175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:00.902061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55800-c188-47ca-bae9-259c4ead175a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:00.902341 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55800-c188-47ca-bae9-259c4ead175a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:00.902613 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca55800-c188-47ca-bae9-259c4ead175a None admin] PATH_INFO: `/v3/services/network` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:00.903314 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca55800-c188-47ca-bae9-259c4ead175a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:00.904776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca55800-c188-47ca-bae9-259c4ead175a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:00.907035 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-cca55800-c188-47ca-bae9-259c4ead175a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:00.918721 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:00.921300 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:00.923375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:00.923375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:00.923375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:00.923375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:00.923375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:00.923375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:00.923375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:00.923375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:00.923375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:00.923375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:00.923375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:00.923375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:00.923375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:59:00.923375 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:00.923375 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 365/712] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:00 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:00.927047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fdd3a-7b52-4ceb-9130-2494b13aed78 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:00.953788 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:01.053170 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fdd3a-7b52-4ceb-9130-2494b13aed78 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:01.073081 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb16fe-1891-4e3f-a05a-6f63f9bd1d67 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:01.073704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb16fe-1891-4e3f-a05a-6f63f9bd1d67 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:01.074173 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eb16fe-1891-4e3f-a05a-6f63f9bd1d67 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:01.075802 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 366/713] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:59:01.081125 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e0cfb-6c07-43ea-8bb4-1b304b32b406 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:01.081416 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e0cfb-6c07-43ea-8bb4-1b304b32b406 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:01.081698 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e0cfb-6c07-43ea-8bb4-1b304b32b406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:01.100850 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-227e0cfb-6c07-43ea-8bb4-1b304b32b406 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:01.102135 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-227e0cfb-6c07-43ea-8bb4-1b304b32b406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:01.102563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bf0ed-48c0-4224-80ec-a8b377b334d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:01.103549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bf0ed-48c0-4224-80ec-a8b377b334d4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:01.104023 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bf0ed-48c0-4224-80ec-a8b377b334d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:01.104594 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bf0ed-48c0-4224-80ec-a8b377b334d4 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:01.106318 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bf0ed-48c0-4224-80ec-a8b377b334d4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:01.106799 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bf0ed-48c0-4224-80ec-a8b377b334d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:01.108356 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286bf0ed-48c0-4224-80ec-a8b377b334d4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:01.117660 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 348/714] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Jul 24 00:59:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:01.123049 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bf0ed-48c0-4224-80ec-a8b377b334d4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:01.203386 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 367/715] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:59:01.231286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e0cfb-6c07-43ea-8bb4-1b304b32b406 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:01.240781 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:01.276474 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bf0ed-48c0-4224-80ec-a8b377b334d4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:01.339953 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6bb83-0e63-45e7-a4f1-6557c21da1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:01.340628 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6bb83-0e63-45e7-a4f1-6557c21da1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:01.340905 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6bb83-0e63-45e7-a4f1-6557c21da1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:01.341174 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca6bb83-0e63-45e7-a4f1-6557c21da1c0 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:01.341886 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6bb83-0e63-45e7-a4f1-6557c21da1c0 None admin] RBAC: Adding query filter params (type=network) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:01.342189 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6bb83-0e63-45e7-a4f1-6557c21da1c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:01.343613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca6bb83-0e63-45e7-a4f1-6557c21da1c0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:01.355116 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 349/716] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Jul 24 00:59:01 2022] GET /identity/v3/services?type=network => generated 124 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:01.390997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e0cfb-6c07-43ea-8bb4-1b304b32b406 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:01.425235 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:01.446224 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8ef35-604d-4fec-ad02-44c2299b920c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:01.447119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8ef35-604d-4fec-ad02-44c2299b920c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:01.447468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8ef35-604d-4fec-ad02-44c2299b920c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:01.447754 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8ef35-604d-4fec-ad02-44c2299b920c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:01.463891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8ef35-604d-4fec-ad02-44c2299b920c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:01.465324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8ef35-604d-4fec-ad02-44c2299b920c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:01.490452 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-58b8ef35-604d-4fec-ad02-44c2299b920c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:01.490452 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:01.490452 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:01.490452 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:01.490452 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:01.490452 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:01.490452 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:01.490452 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:01.490452 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:01.490452 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:01.490452 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:01.490452 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:01.490452 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:01.490452 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:01.490452 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:01.491518 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:01.492815 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:01.492815 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:01.492815 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:01.492815 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:01.492815 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 368/717] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:01.499277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6bb83-0e63-45e7-a4f1-6557c21da1c0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:01.617782 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca6bb83-0e63-45e7-a4f1-6557c21da1c0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:01.656713 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfbf54e-0a1a-4b2c-ba14-923f3b6f8eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:01.657442 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbf54e-0a1a-4b2c-ba14-923f3b6f8eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:01.657724 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbf54e-0a1a-4b2c-ba14-923f3b6f8eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:01.658038 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfbf54e-0a1a-4b2c-ba14-923f3b6f8eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:01.658773 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbf54e-0a1a-4b2c-ba14-923f3b6f8eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:01.659076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbf54e-0a1a-4b2c-ba14-923f3b6f8eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:01.660495 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfbf54e-0a1a-4b2c-ba14-923f3b6f8eb5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:01.670013 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:01.674150 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 350/718] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:01.679880 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8ef35-604d-4fec-ad02-44c2299b920c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:01.785224 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8ef35-604d-4fec-ad02-44c2299b920c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:01.838608 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0befe-d70c-47ce-a2e3-a3a7788e2512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:01.839602 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0befe-d70c-47ce-a2e3-a3a7788e2512 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:01.840056 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0befe-d70c-47ce-a2e3-a3a7788e2512 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:01.840557 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0befe-d70c-47ce-a2e3-a3a7788e2512 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:01.841486 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0befe-d70c-47ce-a2e3-a3a7788e2512 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:01.843108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0befe-d70c-47ce-a2e3-a3a7788e2512 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:01.887126 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 369/719] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 00:59:01 2022] POST /identity/v3/users => generated 254 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:59:02.633402 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2c6a1-8a10-4ee1-a53b-00f1f4079efd None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:02.633928 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2c6a1-8a10-4ee1-a53b-00f1f4079efd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:02.633928 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d2c6a1-8a10-4ee1-a53b-00f1f4079efd None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:02.635610 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 351/720] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:02.640709 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22eef3-869a-424d-b8c9-4ab716423843 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:02.641002 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22eef3-869a-424d-b8c9-4ab716423843 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:02.641279 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f22eef3-869a-424d-b8c9-4ab716423843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:02.658301 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2f22eef3-869a-424d-b8c9-4ab716423843 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:02.659521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2f22eef3-869a-424d-b8c9-4ab716423843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:02.689441 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:02.734729 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 370/721] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:59:02.756915 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2c6a1-8a10-4ee1-a53b-00f1f4079efd None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:02.869322 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d2c6a1-8a10-4ee1-a53b-00f1f4079efd None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:02.920939 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c153c-dea5-41c1-b670-191765ddd15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:02.921959 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c153c-dea5-41c1-b670-191765ddd15c None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:02.922436 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c153c-dea5-41c1-b670-191765ddd15c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:02.922933 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c153c-dea5-41c1-b670-191765ddd15c None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:02.923901 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c153c-dea5-41c1-b670-191765ddd15c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:02.925487 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c153c-dea5-41c1-b670-191765ddd15c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:02.955213 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 352/722] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Jul 24 00:59:02 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:59:03.360456 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44526e9-2ac0-4a97-a541-854f791695ea None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:03.360989 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44526e9-2ac0-4a97-a541-854f791695ea None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:03.361095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44526e9-2ac0-4a97-a541-854f791695ea None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:03.362745 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 371/723] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:03.368057 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de367-f649-4f18-b841-947976c7cd1a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:03.368574 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de367-f649-4f18-b841-947976c7cd1a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:03.369044 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de367-f649-4f18-b841-947976c7cd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:03.373304 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997e0de-7ef0-4f0e-8bab-aaaa9e48f4e0 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:03.373885 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997e0de-7ef0-4f0e-8bab-aaaa9e48f4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:03.374360 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997e0de-7ef0-4f0e-8bab-aaaa9e48f4e0 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:03.376225 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 372/724] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:03.381484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcc954-69bb-4965-90fb-becc280b3e35 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:03.382019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcc954-69bb-4965-90fb-becc280b3e35 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:03.382511 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bcc954-69bb-4965-90fb-becc280b3e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:03.397493 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c33de367-f649-4f18-b841-947976c7cd1a None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:03.399689 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c33de367-f649-4f18-b841-947976c7cd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:03.412380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-50bcc954-69bb-4965-90fb-becc280b3e35 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:03.413932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-50bcc954-69bb-4965-90fb-becc280b3e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:03.514911 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:03.551216 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 353/725] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:59:03.554504 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 373/726] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 24 00:59:03.596065 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33de367-f649-4f18-b841-947976c7cd1a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:03.606127 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcc954-69bb-4965-90fb-becc280b3e35 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:03.742994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:03.752109 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33de367-f649-4f18-b841-947976c7cd1a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:03.753556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bcc954-69bb-4965-90fb-becc280b3e35 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:03.790917 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3c9f8d-00a1-44df-af6a-acd11cb52d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:03.791878 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c9f8d-00a1-44df-af6a-acd11cb52d7d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:03.792144 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c9f8d-00a1-44df-af6a-acd11cb52d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:03.792422 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3c9f8d-00a1-44df-af6a-acd11cb52d7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:03.793823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ea049-49e9-48a3-b0ff-cbdbac84e910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:03.795037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ea049-49e9-48a3-b0ff-cbdbac84e910 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:03.795507 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ea049-49e9-48a3-b0ff-cbdbac84e910 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:03.795937 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1ea049-49e9-48a3-b0ff-cbdbac84e910 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:03.806659 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3c9f8d-00a1-44df-af6a-acd11cb52d7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-ab3c9f8d-00a1-44df-af6a-acd11cb52d7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:03.814647 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:03.815642 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:03.817068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:03.817068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:03.817068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:03.817068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:03.817068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:03.817068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:03.817068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:03.817068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:03.817068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:03.817068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:03.817068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:03.817068 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:03.817068 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 374/727] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:59:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:03.818149 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895e134-3a73-4bcf-ad19-a3cfa6aeaad9 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:03.818228 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895e134-3a73-4bcf-ad19-a3cfa6aeaad9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:03.818517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d895e134-3a73-4bcf-ad19-a3cfa6aeaad9 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:03.819172 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1ea049-49e9-48a3-b0ff-cbdbac84e910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:03.824193 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 375/728] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:03.825320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadeca7d-e9ff-4a11-8cb5-7a6f627a6082 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:03.825608 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadeca7d-e9ff-4a11-8cb5-7a6f627a6082 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:03.825891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadeca7d-e9ff-4a11-8cb5-7a6f627a6082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-4c1ea049-49e9-48a3-b0ff-cbdbac84e910 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:03.828192 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:03.829365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:03.830292 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:03.830292 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:03.830292 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:03.830292 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:03.830292 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:03.830292 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:03.830292 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:03.830292 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:03.830292 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:03.830292 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:03.830292 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:03.830292 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:03.830292 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 354/729] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:59:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:03.831016 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ea049-49e9-48a3-b0ff-cbdbac84e910 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:03.850913 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-dadeca7d-e9ff-4a11-8cb5-7a6f627a6082 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:03.852203 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-dadeca7d-e9ff-4a11-8cb5-7a6f627a6082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:03.879277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:03.946166 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1ea049-49e9-48a3-b0ff-cbdbac84e910 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:03.986042 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fa9e0-e45a-4736-baa5-79d042dd0486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:03.986920 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fa9e0-e45a-4736-baa5-79d042dd0486 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:03.987311 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fa9e0-e45a-4736-baa5-79d042dd0486 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:03.987725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087fa9e0-e45a-4736-baa5-79d042dd0486 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:03.988602 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fa9e0-e45a-4736-baa5-79d042dd0486 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:03.989005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fa9e0-e45a-4736-baa5-79d042dd0486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:03.990536 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087fa9e0-e45a-4736-baa5-79d042dd0486 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:04.000749 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 355/730] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:59:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:04.001749 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fa9e0-e45a-4736-baa5-79d042dd0486 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:04.045052 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 376/731] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 24 00:59:04.046038 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadeca7d-e9ff-4a11-8cb5-7a6f627a6082 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:04.105332 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087fa9e0-e45a-4736-baa5-79d042dd0486 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:04.114688 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:04.132454 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:04.142751 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb870bc-253e-4f4c-a508-1adc40318a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:04.144026 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb870bc-253e-4f4c-a508-1adc40318a93 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:04.144419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb870bc-253e-4f4c-a508-1adc40318a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:04.144705 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb870bc-253e-4f4c-a508-1adc40318a93 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:04.145687 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb870bc-253e-4f4c-a508-1adc40318a93 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:04.145995 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb870bc-253e-4f4c-a508-1adc40318a93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:04.148171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb870bc-253e-4f4c-a508-1adc40318a93 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:04.152563 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadeca7d-e9ff-4a11-8cb5-7a6f627a6082 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:04.158559 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 356/732] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:59:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:04.159346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb870bc-253e-4f4c-a508-1adc40318a93 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:04.188594 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c37976-f867-45e9-897f-580725d3ce1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:04.189630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c37976-f867-45e9-897f-580725d3ce1d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:04.190068 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c37976-f867-45e9-897f-580725d3ce1d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:04.190495 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c37976-f867-45e9-897f-580725d3ce1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:04.202106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c37976-f867-45e9-897f-580725d3ce1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:04.203720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c37976-f867-45e9-897f-580725d3ce1d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:04.222387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-53c37976-f867-45e9-897f-580725d3ce1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:04.222387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:04.222387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:04.222387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:04.222387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:04.222387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:04.222387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:04.222387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:04.222387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:04.222387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:04.222387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:04.222387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:04.222387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:04.222387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:04.222387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:04.224107 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:04.226137 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:04.226137 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:04.226137 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:04.226137 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:04.226137 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 377/733] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:04.226957 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c37976-f867-45e9-897f-580725d3ce1d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:04.270778 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb870bc-253e-4f4c-a508-1adc40318a93 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:04.305106 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c62389-7225-45d1-826f-4a82594541a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:04.305843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c62389-7225-45d1-826f-4a82594541a6 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:04.306128 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c62389-7225-45d1-826f-4a82594541a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:04.306410 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c62389-7225-45d1-826f-4a82594541a6 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:04.307170 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c62389-7225-45d1-826f-4a82594541a6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:04.308760 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c62389-7225-45d1-826f-4a82594541a6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:04.324567 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 357/734] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Jul 24 00:59:04 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:59:04.325507 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c62389-7225-45d1-826f-4a82594541a6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:04.358047 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c37976-f867-45e9-897f-580725d3ce1d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:04.385117 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:04.436110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:04.445661 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9ec2a-b08d-42e3-9ebb-5b960a0696f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:04.446542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9ec2a-b08d-42e3-9ebb-5b960a0696f5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:04.446829 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9ec2a-b08d-42e3-9ebb-5b960a0696f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:04.447113 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9ec2a-b08d-42e3-9ebb-5b960a0696f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:04.467739 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9ec2a-b08d-42e3-9ebb-5b960a0696f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:04.470190 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9ec2a-b08d-42e3-9ebb-5b960a0696f5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:04.496619 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-0ae9ec2a-b08d-42e3-9ebb-5b960a0696f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:04.496619 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:04.496619 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:04.496619 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:04.496619 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:04.496619 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:04.496619 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:04.496619 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:04.496619 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:04.496619 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:04.496619 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:04.496619 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:04.496619 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:04.496619 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:04.496619 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:04.497640 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:04.498588 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:04.498588 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:04.498588 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:04.498588 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:04.498588 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 378/735] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:04.503529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9ec2a-b08d-42e3-9ebb-5b960a0696f5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:04.523481 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c62389-7225-45d1-826f-4a82594541a6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:04.568249 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307b8f4-1038-4fb4-ba3b-ab1de4ff732b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:04.568931 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307b8f4-1038-4fb4-ba3b-ab1de4ff732b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:04.569213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307b8f4-1038-4fb4-ba3b-ab1de4ff732b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:04.569491 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307b8f4-1038-4fb4-ba3b-ab1de4ff732b None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:04.570217 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307b8f4-1038-4fb4-ba3b-ab1de4ff732b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:04.570575 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307b8f4-1038-4fb4-ba3b-ab1de4ff732b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:04.572008 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307b8f4-1038-4fb4-ba3b-ab1de4ff732b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:04.584464 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 358/736] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:04.592279 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307b8f4-1038-4fb4-ba3b-ab1de4ff732b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:04.638019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9ec2a-b08d-42e3-9ebb-5b960a0696f5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:04.675283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212d015-4ae6-4195-8898-09221589a94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:04.676373 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212d015-4ae6-4195-8898-09221589a94f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:04.676879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212d015-4ae6-4195-8898-09221589a94f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:04.677457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212d015-4ae6-4195-8898-09221589a94f None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:04.678385 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212d015-4ae6-4195-8898-09221589a94f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:04.678892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212d015-4ae6-4195-8898-09221589a94f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:04.680667 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e212d015-4ae6-4195-8898-09221589a94f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:04.695355 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:04.697284 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 379/737] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:04.704031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212d015-4ae6-4195-8898-09221589a94f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:04.705552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307b8f4-1038-4fb4-ba3b-ab1de4ff732b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:04.757071 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344823f-2da5-49ce-93da-fa6d1f741cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:04.758778 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344823f-2da5-49ce-93da-fa6d1f741cbe None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:04.759266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344823f-2da5-49ce-93da-fa6d1f741cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:04.759778 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b344823f-2da5-49ce-93da-fa6d1f741cbe None admin] PATH_INFO: `/v3/users/swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:04.771726 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:04.772492 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344823f-2da5-49ce-93da-fa6d1f741cbe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:04.776585 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b344823f-2da5-49ce-93da-fa6d1f741cbe None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-b344823f-2da5-49ce-93da-fa6d1f741cbe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:59:04.801075 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:04.802076 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:04.803067 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:04.803067 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:04.803067 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:59:04.803067 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:59:04.803067 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:59:04.803067 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:59:04.803067 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:59:04.803067 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:59:04.803067 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:59:04.803067 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:04.811008 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 359/738] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:59:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:04.812712 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344823f-2da5-49ce-93da-fa6d1f741cbe None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:04.902184 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212d015-4ae6-4195-8898-09221589a94f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:04.943361 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d83d02-cb74-44e8-8ee8-aef5a943b63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:04.944537 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d83d02-cb74-44e8-8ee8-aef5a943b63d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:04.945021 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d83d02-cb74-44e8-8ee8-aef5a943b63d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:04.945649 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d83d02-cb74-44e8-8ee8-aef5a943b63d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:04.954066 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d83d02-cb74-44e8-8ee8-aef5a943b63d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:04.955882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d83d02-cb74-44e8-8ee8-aef5a943b63d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-a5d83d02-cb74-44e8-8ee8-aef5a943b63d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:59:04.971468 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:04.972495 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:04.973445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:04.973445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:04.973445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:59:04.973445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:59:04.973445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:59:04.973445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:59:04.973445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:59:04.973445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:59:04.973445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:59:04.973445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:04.980640 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 380/739] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Jul 24 00:59:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:04.982408 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d83d02-cb74-44e8-8ee8-aef5a943b63d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:04.996165 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b344823f-2da5-49ce-93da-fa6d1f741cbe None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:05.047229 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7cd1bc-d537-400c-85b3-15165abdc456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:05.047874 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cd1bc-d537-400c-85b3-15165abdc456 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:05.048160 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cd1bc-d537-400c-85b3-15165abdc456 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:05.048437 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7cd1bc-d537-400c-85b3-15165abdc456 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:05.049559 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cd1bc-d537-400c-85b3-15165abdc456 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:05.049877 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cd1bc-d537-400c-85b3-15165abdc456 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:05.052042 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7cd1bc-d537-400c-85b3-15165abdc456 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:05.079700 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 360/740] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Jul 24 00:59:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:05.079700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf2d19-d6ad-48bd-ac9c-69d4d396fc22 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:05.079700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf2d19-d6ad-48bd-ac9c-69d4d396fc22 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:05.079700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf2d19-d6ad-48bd-ac9c-69d4d396fc22 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:05.083387 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 361/741] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:05.086035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf2d19-d6ad-48bd-ac9c-69d4d396fc22 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:05.100264 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:05.111653 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d83d02-cb74-44e8-8ee8-aef5a943b63d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:05.113891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:05.154837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171ade0-4149-46ec-be44-fd5fd852c758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:05.155832 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171ade0-4149-46ec-be44-fd5fd852c758 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:05.156186 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171ade0-4149-46ec-be44-fd5fd852c758 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:05.156535 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171ade0-4149-46ec-be44-fd5fd852c758 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:05.157738 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171ade0-4149-46ec-be44-fd5fd852c758 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:05.158119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171ade0-4149-46ec-be44-fd5fd852c758 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:05.162187 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b171ade0-4149-46ec-be44-fd5fd852c758 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:05.189372 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 381/742] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Jul 24 00:59:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:05.190898 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f002f53-4635-4113-8233-5f37480a7322 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:05.191263 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f002f53-4635-4113-8233-5f37480a7322 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:05.192375 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f002f53-4635-4113-8233-5f37480a7322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:05.213141 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7f002f53-4635-4113-8233-5f37480a7322 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:05.214630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7f002f53-4635-4113-8233-5f37480a7322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:05.221162 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf2d19-d6ad-48bd-ac9c-69d4d396fc22 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:05.265171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72537d0b-09e0-43b4-90c7-7f26c8728144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:05.265836 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72537d0b-09e0-43b4-90c7-7f26c8728144 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:05.266120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72537d0b-09e0-43b4-90c7-7f26c8728144 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:05.266400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72537d0b-09e0-43b4-90c7-7f26c8728144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:05.311407 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 382/743] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:05.311407 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f002f53-4635-4113-8233-5f37480a7322 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:05.355700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72537d0b-09e0-43b4-90c7-7f26c8728144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:05.357182 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72537d0b-09e0-43b4-90c7-7f26c8728144 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:05.367775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:05.445558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:05.457144 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f002f53-4635-4113-8233-5f37480a7322 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:05.467425 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 362/744] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:59:05 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:59:05.468189 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72537d0b-09e0-43b4-90c7-7f26c8728144 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:05.496785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cb4da8-2109-49a5-9512-7cbea3b7c177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:05.497624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb4da8-2109-49a5-9512-7cbea3b7c177 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:05.497858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb4da8-2109-49a5-9512-7cbea3b7c177 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:05.498123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cb4da8-2109-49a5-9512-7cbea3b7c177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:05.507935 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb4da8-2109-49a5-9512-7cbea3b7c177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:05.509462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cb4da8-2109-49a5-9512-7cbea3b7c177 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:05.528397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-87cb4da8-2109-49a5-9512-7cbea3b7c177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:05.528397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:05.528397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:05.528397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:05.528397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:05.528397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:05.528397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:05.528397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:05.528397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:05.528397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:05.528397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:05.528397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:05.528397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:05.528397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:05.528397 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:05.529503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:05.530426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:05.530426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:05.530426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:05.530426 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:05.530426 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 383/745] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:05.530828 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5e903-2853-4e87-ad5a-a4af8dce0f57 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:05.531109 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5e903-2853-4e87-ad5a-a4af8dce0f57 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:05.531403 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5e903-2853-4e87-ad5a-a4af8dce0f57 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:05.535413 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 384/746] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:05.535413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5e903-2853-4e87-ad5a-a4af8dce0f57 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:05.577336 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72537d0b-09e0-43b4-90c7-7f26c8728144 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:05.587170 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:05.614685 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1d929-1161-46b5-a671-728ec94fee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:05.615541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1d929-1161-46b5-a671-728ec94fee9d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:05.615824 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1d929-1161-46b5-a671-728ec94fee9d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:05.616213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1d929-1161-46b5-a671-728ec94fee9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:05.627686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd1d929-1161-46b5-a671-728ec94fee9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-fbd1d929-1161-46b5-a671-728ec94fee9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:05.635572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:05.636539 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:05.637401 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:05.637401 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:05.637401 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:05.637401 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:05.637401 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:05.637401 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:05.637401 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:05.637401 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:05.637401 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:05.637401 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:05.637401 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:59:05.637401 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:05.637401 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 363/747] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:59:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:05.638689 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1d929-1161-46b5-a671-728ec94fee9d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:05.643374 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5e903-2853-4e87-ad5a-a4af8dce0f57 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:05.684166 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121cd634-a41e-4146-964d-fc7942f937ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:05.685172 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cd634-a41e-4146-964d-fc7942f937ba None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:05.685456 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cd634-a41e-4146-964d-fc7942f937ba None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:05.685732 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121cd634-a41e-4146-964d-fc7942f937ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:05.696837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cd634-a41e-4146-964d-fc7942f937ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:05.698318 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121cd634-a41e-4146-964d-fc7942f937ba None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:05.700256 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:05.719150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-121cd634-a41e-4146-964d-fc7942f937ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:05.719150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:05.719150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:05.719150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:05.719150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:05.719150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:05.719150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:05.719150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:05.719150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:05.719150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:05.719150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:05.719150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:05.719150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:05.719150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:05.719150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:05.720123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:05.726324 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:05.726324 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:05.726324 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:05.726324 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:05.726324 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 385/748] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:05.726324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22202d2-d67a-4046-8414-c34629400fe2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:05.726324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22202d2-d67a-4046-8414-c34629400fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:05.726324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22202d2-d67a-4046-8414-c34629400fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:05.746720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e22202d2-d67a-4046-8414-c34629400fe2 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:05.748208 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e22202d2-d67a-4046-8414-c34629400fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:05.751248 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1d929-1161-46b5-a671-728ec94fee9d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:05.787411 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd654d5-70dc-4c03-aca8-24b0bd88aa6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:05.788135 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd654d5-70dc-4c03-aca8-24b0bd88aa6b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:05.788368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd654d5-70dc-4c03-aca8-24b0bd88aa6b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:05.788643 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd654d5-70dc-4c03-aca8-24b0bd88aa6b None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:05.789458 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd654d5-70dc-4c03-aca8-24b0bd88aa6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:05.789768 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd654d5-70dc-4c03-aca8-24b0bd88aa6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:05.791587 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd654d5-70dc-4c03-aca8-24b0bd88aa6b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:05.811225 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 364/749] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:05.811225 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd654d5-70dc-4c03-aca8-24b0bd88aa6b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:05.831382 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 386/750] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:05.831382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22202d2-d67a-4046-8414-c34629400fe2 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:05.850961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:05.925042 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd654d5-70dc-4c03-aca8-24b0bd88aa6b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:05.925644 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22202d2-d67a-4046-8414-c34629400fe2 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:05.949804 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:05.961419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e7d23-0714-403b-abbe-5bb6525d37cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:05.962019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09234e31-d833-4f56-b71c-eb7cf046832d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:05.962148 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e7d23-0714-403b-abbe-5bb6525d37cc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:05.962364 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e7d23-0714-403b-abbe-5bb6525d37cc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:05.962637 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e7d23-0714-403b-abbe-5bb6525d37cc None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:05.963268 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09234e31-d833-4f56-b71c-eb7cf046832d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:05.963478 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e7d23-0714-403b-abbe-5bb6525d37cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:05.963726 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e7d23-0714-403b-abbe-5bb6525d37cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:05.964033 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09234e31-d833-4f56-b71c-eb7cf046832d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:05.964455 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09234e31-d833-4f56-b71c-eb7cf046832d None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:05.965121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e7d23-0714-403b-abbe-5bb6525d37cc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:05.965451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09234e31-d833-4f56-b71c-eb7cf046832d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:05.965890 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09234e31-d833-4f56-b71c-eb7cf046832d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:05.967408 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09234e31-d833-4f56-b71c-eb7cf046832d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:05.973318 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 365/751] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:59:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:05.974242 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e7d23-0714-403b-abbe-5bb6525d37cc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:05.984538 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 387/752] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:05.985391 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09234e31-d833-4f56-b71c-eb7cf046832d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:06.068435 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:06.079860 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e7d23-0714-403b-abbe-5bb6525d37cc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:06.086043 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09234e31-d833-4f56-b71c-eb7cf046832d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:06.118569 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffc206-7eb2-4e02-b378-481ed635dfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:06.119543 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffc206-7eb2-4e02-b378-481ed635dfdd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.119828 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffc206-7eb2-4e02-b378-481ed635dfdd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.120153 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ffc206-7eb2-4e02-b378-481ed635dfdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.120408 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c87a5-921b-4e83-84ba-11073dfa8c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:06.121252 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c87a5-921b-4e83-84ba-11073dfa8c18 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.121540 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c87a5-921b-4e83-84ba-11073dfa8c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.121806 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8c87a5-921b-4e83-84ba-11073dfa8c18 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.122451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c87a5-921b-4e83-84ba-11073dfa8c18 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:06.123860 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8c87a5-921b-4e83-84ba-11073dfa8c18 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:06.127540 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffc206-7eb2-4e02-b378-481ed635dfdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:06.128998 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ffc206-7eb2-4e02-b378-481ed635dfdd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-7c8c87a5-921b-4e83-84ba-11073dfa8c18 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:06.136091 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:06.137031 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:06.143066 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 388/753] 10.222.0.42 () {56 vars in 1129 bytes} [Sun Jul 24 00:59:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:06.143971 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c87a5-921b-4e83-84ba-11073dfa8c18 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:06.144045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-79ffc206-7eb2-4e02-b378-481ed635dfdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:06.144045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:06.144045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:06.144045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:06.144045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:06.144045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:06.144045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:06.144045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:06.144045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:06.144045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:06.144045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:06.144045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:06.144045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:06.144045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:06.144045 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:06.144850 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:06.145747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:06.145747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:06.145747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:06.145747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:06.145747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:06.145747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:06.145747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:06.145747 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:06.145747 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 366/754] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:06.147314 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffc206-7eb2-4e02-b378-481ed635dfdd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:06.198728 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:06.252216 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ffc206-7eb2-4e02-b378-481ed635dfdd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:06.253763 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8c87a5-921b-4e83-84ba-11073dfa8c18 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:06.286376 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194a2d6-0cf4-444c-bddf-d7e051390216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:06.287253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194a2d6-0cf4-444c-bddf-d7e051390216 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.287601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194a2d6-0cf4-444c-bddf-d7e051390216 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.287882 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194a2d6-0cf4-444c-bddf-d7e051390216 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.289804 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf91934-c57f-456e-9cfe-3d119f2d21a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:06.290709 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf91934-c57f-456e-9cfe-3d119f2d21a0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.290902 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf91934-c57f-456e-9cfe-3d119f2d21a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.291149 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf91934-c57f-456e-9cfe-3d119f2d21a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.295101 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194a2d6-0cf4-444c-bddf-d7e051390216 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:06.296602 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194a2d6-0cf4-444c-bddf-d7e051390216 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:06.301774 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf91934-c57f-456e-9cfe-3d119f2d21a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:06.303206 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf91934-c57f-456e-9cfe-3d119f2d21a0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:06.310360 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-e194a2d6-0cf4-444c-bddf-d7e051390216 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:06.310360 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:06.310360 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:06.310360 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:06.310360 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:06.310360 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:06.310360 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:06.310360 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:06.310360 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:06.310360 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:06.310360 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:06.310360 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:06.310360 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:06.310360 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:06.310360 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:06.311240 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:06.312185 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:06.312185 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:06.312185 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:06.312185 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:06.312185 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:06.312185 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:06.312185 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:06.312185 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:06.312185 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 367/755] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:06.312758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194a2d6-0cf4-444c-bddf-d7e051390216 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:06.325457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:06.327049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-fbf91934-c57f-456e-9cfe-3d119f2d21a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:06.327049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:06.327049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:06.327049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:06.327049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:06.327049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:06.327049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:06.327049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:06.327049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:06.327049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:06.327049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:06.327049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:06.327049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:06.327049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:06.327049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:06.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:06.329848 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:06.329848 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:06.329848 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:06.329848 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:06.329848 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 389/756] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:06.329848 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf91934-c57f-456e-9cfe-3d119f2d21a0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:06.419373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194a2d6-0cf4-444c-bddf-d7e051390216 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:06.429133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:06.432668 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf91934-c57f-456e-9cfe-3d119f2d21a0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:06.454298 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709cedd-85c7-4cd9-b1db-5101fd102b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:06.455221 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709cedd-85c7-4cd9-b1db-5101fd102b14 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.455539 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709cedd-85c7-4cd9-b1db-5101fd102b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.455969 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2709cedd-85c7-4cd9-b1db-5101fd102b14 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.456630 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709cedd-85c7-4cd9-b1db-5101fd102b14 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:06.456945 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709cedd-85c7-4cd9-b1db-5101fd102b14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:06.458336 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2709cedd-85c7-4cd9-b1db-5101fd102b14 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:06.467488 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655be92-41ab-4d51-a071-ea6cacfa90ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:06.467971 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 368/757] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Jul 24 00:59:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:06.468583 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709cedd-85c7-4cd9-b1db-5101fd102b14 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:06.469033 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655be92-41ab-4d51-a071-ea6cacfa90ae None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.469589 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655be92-41ab-4d51-a071-ea6cacfa90ae None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.470052 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655be92-41ab-4d51-a071-ea6cacfa90ae None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.471023 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655be92-41ab-4d51-a071-ea6cacfa90ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:06.471360 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655be92-41ab-4d51-a071-ea6cacfa90ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:06.472800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655be92-41ab-4d51-a071-ea6cacfa90ae None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:06.489863 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 390/758] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:06.489863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655be92-41ab-4d51-a071-ea6cacfa90ae None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:06.551583 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:06.578064 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2709cedd-85c7-4cd9-b1db-5101fd102b14 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:06.589366 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655be92-41ab-4d51-a071-ea6cacfa90ae None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:06.610435 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264f9f7-f3b3-425f-a5ff-a483b9faf441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:06.611102 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264f9f7-f3b3-425f-a5ff-a483b9faf441 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.611424 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264f9f7-f3b3-425f-a5ff-a483b9faf441 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.611702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264f9f7-f3b3-425f-a5ff-a483b9faf441 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.612492 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264f9f7-f3b3-425f-a5ff-a483b9faf441 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:06.612800 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264f9f7-f3b3-425f-a5ff-a483b9faf441 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:06.614259 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264f9f7-f3b3-425f-a5ff-a483b9faf441 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:06.621086 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5aa26-58e8-43da-8832-f0c344d233bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:06.621744 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5aa26-58e8-43da-8832-f0c344d233bc None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.622026 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5aa26-58e8-43da-8832-f0c344d233bc None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.622301 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf5aa26-58e8-43da-8832-f0c344d233bc None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.623018 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5aa26-58e8-43da-8832-f0c344d233bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:06.623344 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5aa26-58e8-43da-8832-f0c344d233bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:06.624691 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf5aa26-58e8-43da-8832-f0c344d233bc None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:06.626091 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 369/759] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:06.626672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264f9f7-f3b3-425f-a5ff-a483b9faf441 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:06.641845 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 391/760] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:06.641845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5aa26-58e8-43da-8832-f0c344d233bc None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:06.659469 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:06.733197 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264f9f7-f3b3-425f-a5ff-a483b9faf441 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:06.739187 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf5aa26-58e8-43da-8832-f0c344d233bc None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:06.768716 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe0b0db-2125-4213-ace3-a104fbada83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:06.769376 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0b0db-2125-4213-ace3-a104fbada83f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.769664 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0b0db-2125-4213-ace3-a104fbada83f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.769937 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe0b0db-2125-4213-ace3-a104fbada83f None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.770640 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0b0db-2125-4213-ace3-a104fbada83f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:06.770942 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0b0db-2125-4213-ace3-a104fbada83f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:06.772337 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989dfcb-4f2b-4868-a06f-c5d92d9fa350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:06.772445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe0b0db-2125-4213-ace3-a104fbada83f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:06.773242 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989dfcb-4f2b-4868-a06f-c5d92d9fa350 None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.773623 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989dfcb-4f2b-4868-a06f-c5d92d9fa350 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.773810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:06.773902 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989dfcb-4f2b-4868-a06f-c5d92d9fa350 None admin] PATH_INFO: `/v3/projects/604801625292482a9fb4b70c416dc438/users/6c32c443ee1a421e98e7656e8e86e27a/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.775892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989dfcb-4f2b-4868-a06f-c5d92d9fa350 None admin] RBAC: Authorizing `identity:create_grant(project_id=604801625292482a9fb4b70c416dc438, user_id=6c32c443ee1a421e98e7656e8e86e27a, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:06.777330 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989dfcb-4f2b-4868-a06f-c5d92d9fa350 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:06.779651 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 370/761] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Jul 24 00:59:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:06.781350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6d67c-4e70-400e-b819-8f961665e2a5 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.781636 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6d67c-4e70-400e-b819-8f961665e2a5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.781953 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e6d67c-4e70-400e-b819-8f961665e2a5 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.783524 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 371/762] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:06.784114 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6d67c-4e70-400e-b819-8f961665e2a5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:06.795344 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 392/763] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:59:06 2022] PUT /identity/v3/projects/604801625292482a9fb4b70c416dc438/users/6c32c443ee1a421e98e7656e8e86e27a/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:59:06.796178 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989dfcb-4f2b-4868-a06f-c5d92d9fa350 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:06.890950 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:06.908043 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e6d67c-4e70-400e-b819-8f961665e2a5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:06.914601 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989dfcb-4f2b-4868-a06f-c5d92d9fa350 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:06.945212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462a2e0-019c-43f3-b86d-c8951f3f3ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:06.945953 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462a2e0-019c-43f3-b86d-c8951f3f3ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.946235 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462a2e0-019c-43f3-b86d-c8951f3f3ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.946511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a462a2e0-019c-43f3-b86d-c8951f3f3ae7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.948248 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462a2e0-019c-43f3-b86d-c8951f3f3ae7 None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=dea37db9b0f3432093e8fe89d5fcc687) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:06.948248 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462a2e0-019c-43f3-b86d-c8951f3f3ae7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:06.950182 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a462a2e0-019c-43f3-b86d-c8951f3f3ae7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:06.957689 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 372/764] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:59:06 2022] GET /identity/v3/role_assignments?user.id=dea37db9b0f3432093e8fe89d5fcc687&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:06.958070 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36434f71-b433-44d2-82c6-5faa1f24b780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:06.958509 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462a2e0-019c-43f3-b86d-c8951f3f3ae7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:06.959051 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36434f71-b433-44d2-82c6-5faa1f24b780 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.959467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36434f71-b433-44d2-82c6-5faa1f24b780 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.959799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36434f71-b433-44d2-82c6-5faa1f24b780 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:06.970671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36434f71-b433-44d2-82c6-5faa1f24b780 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:06.972987 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36434f71-b433-44d2-82c6-5faa1f24b780 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-36434f71-b433-44d2-82c6-5faa1f24b780 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:59:06.990140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:06.991150 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:06.992185 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:06.992185 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:06.992185 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:59:06.992185 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:59:06.992185 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:59:06.992185 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:59:06.992185 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:59:06.992185 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:59:06.992185 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:59:06.992185 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:06.992185 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 393/765] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Jul 24 00:59:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:06.993339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55fc04-648e-4142-9a6f-f43c1fff1135 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:06.993339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55fc04-648e-4142-9a6f-f43c1fff1135 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:06.993576 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55fc04-648e-4142-9a6f-f43c1fff1135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:07.019331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3d55fc04-648e-4142-9a6f-f43c1fff1135 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:07.019331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3d55fc04-648e-4142-9a6f-f43c1fff1135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:07.067113 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:07.114585 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 394/766] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:07.115586 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55fc04-648e-4142-9a6f-f43c1fff1135 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:07.116850 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a462a2e0-019c-43f3-b86d-c8951f3f3ae7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:07.164860 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4114d-c1d4-46c2-9c51-57795586cb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:07.165544 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4114d-c1d4-46c2-9c51-57795586cb9b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:07.165831 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4114d-c1d4-46c2-9c51-57795586cb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:07.166109 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4114d-c1d4-46c2-9c51-57795586cb9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:07.166919 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4114d-c1d4-46c2-9c51-57795586cb9b None admin] RBAC: Adding query filter params (interface=public, service_id=be70afc9772b4ba4a006cfa22772929b, region_id=RegionOne) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:07.170333 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4114d-c1d4-46c2-9c51-57795586cb9b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:07.172551 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4114d-c1d4-46c2-9c51-57795586cb9b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:07.184239 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 373/767] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Jul 24 00:59:06 2022] GET /identity/v3/endpoints?service_id=be70afc9772b4ba4a006cfa22772929b&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:07.185425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4114d-c1d4-46c2-9c51-57795586cb9b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:07.206071 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:07.239015 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55fc04-648e-4142-9a6f-f43c1fff1135 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:07.273334 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b2298-c4f3-422f-a080-910e92f96c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:07.274398 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b2298-c4f3-422f-a080-910e92f96c42 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:07.274876 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b2298-c4f3-422f-a080-910e92f96c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:07.275388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b2298-c4f3-422f-a080-910e92f96c42 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:07.276465 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b2298-c4f3-422f-a080-910e92f96c42 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:07.277032 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b2298-c4f3-422f-a080-910e92f96c42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:07.278655 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b2298-c4f3-422f-a080-910e92f96c42 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:07.301486 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4114d-c1d4-46c2-9c51-57795586cb9b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:07.301835 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 395/768] 10.222.0.42 () {56 vars in 1149 bytes} [Sun Jul 24 00:59:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:07.303036 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b2298-c4f3-422f-a080-910e92f96c42 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:07.326321 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:07.337325 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018f68f-3e7b-4fe7-bdbd-2ff0216514d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:07.338542 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018f68f-3e7b-4fe7-bdbd-2ff0216514d7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:07.339683 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018f68f-3e7b-4fe7-bdbd-2ff0216514d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:07.342601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b018f68f-3e7b-4fe7-bdbd-2ff0216514d7 None admin] PATH_INFO: `/v3/services/network` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:07.343411 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018f68f-3e7b-4fe7-bdbd-2ff0216514d7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:07.344961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b018f68f-3e7b-4fe7-bdbd-2ff0216514d7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-b018f68f-3e7b-4fe7-bdbd-2ff0216514d7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:07.359977 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:07.361251 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:07.362296 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:07.362296 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:07.362296 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:07.362296 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:07.362296 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:07.362296 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:07.362296 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:07.362296 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:07.362296 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:07.362296 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:07.362296 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:07.362296 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:07.362296 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:59:07.362296 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:07.364205 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 374/769] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:07 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:07.365089 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018f68f-3e7b-4fe7-bdbd-2ff0216514d7 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:07.411119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b2298-c4f3-422f-a080-910e92f96c42 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:07.438699 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:07.448377 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ecd9e-cc9e-4dec-a3d8-5a6668cfd4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:07.449362 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ecd9e-cc9e-4dec-a3d8-5a6668cfd4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:07.449808 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ecd9e-cc9e-4dec-a3d8-5a6668cfd4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:07.450232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ecd9e-cc9e-4dec-a3d8-5a6668cfd4e4 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:07.451070 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ecd9e-cc9e-4dec-a3d8-5a6668cfd4e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:07.452754 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ecd9e-cc9e-4dec-a3d8-5a6668cfd4e4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:07.463628 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 396/770] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Jul 24 00:59:07 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:07.464849 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ecd9e-cc9e-4dec-a3d8-5a6668cfd4e4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:07.475860 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b018f68f-3e7b-4fe7-bdbd-2ff0216514d7 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:07.542799 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5a546-bfc5-4dc2-8a8c-158c751dfeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:07.543563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a546-bfc5-4dc2-8a8c-158c751dfeb6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:07.543994 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a546-bfc5-4dc2-8a8c-158c751dfeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:07.544362 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce5a546-bfc5-4dc2-8a8c-158c751dfeb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:07.659204 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ecd9e-cc9e-4dec-a3d8-5a6668cfd4e4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:07.664736 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:07.680297 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5a546-bfc5-4dc2-8a8c-158c751dfeb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:07.682113 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce5a546-bfc5-4dc2-8a8c-158c751dfeb6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:07.707186 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25790347-675d-49e7-a5f3-49f38dc50b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:07.708129 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25790347-675d-49e7-a5f3-49f38dc50b25 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:07.708692 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25790347-675d-49e7-a5f3-49f38dc50b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:07.709241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25790347-675d-49e7-a5f3-49f38dc50b25 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:07.710353 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25790347-675d-49e7-a5f3-49f38dc50b25 None admin] RBAC: Adding query filter params (name=network) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:07.710837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25790347-675d-49e7-a5f3-49f38dc50b25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:07.713225 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25790347-675d-49e7-a5f3-49f38dc50b25 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:07.720416 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 397/771] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Jul 24 00:59:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:07.725548 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25790347-675d-49e7-a5f3-49f38dc50b25 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:07.802305 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 375/772] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:59:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:59:07.807358 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5a546-bfc5-4dc2-8a8c-158c751dfeb6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:07.810435 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:07.911415 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:07.917703 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25790347-675d-49e7-a5f3-49f38dc50b25 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:07.922904 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce5a546-bfc5-4dc2-8a8c-158c751dfeb6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:07.959353 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6caaaf-aa28-4227-ac1d-606442ff1f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:07.961017 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6caaaf-aa28-4227-ac1d-606442ff1f8f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:07.961580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6caaaf-aa28-4227-ac1d-606442ff1f8f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:07.962000 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6caaaf-aa28-4227-ac1d-606442ff1f8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:07.973266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6caaaf-aa28-4227-ac1d-606442ff1f8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:07.974976 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6caaaf-aa28-4227-ac1d-606442ff1f8f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:07.994412 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9e6caaaf-aa28-4227-ac1d-606442ff1f8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:07.994412 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:07.994412 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:07.994412 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:07.994412 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:07.994412 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:07.994412 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:07.994412 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:07.994412 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:07.994412 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:07.994412 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:07.994412 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:07.994412 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:07.994412 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:07.994412 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:07.995489 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:07.996420 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:07.996420 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:07.996420 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:07.996420 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:07.998559 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 376/773] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:07.999692 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a02be7-3605-43b9-a41c-be835e1e1be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:08.000567 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a02be7-3605-43b9-a41c-be835e1e1be2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:08.001042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a02be7-3605-43b9-a41c-be835e1e1be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:08.001491 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a02be7-3605-43b9-a41c-be835e1e1be2 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:08.002383 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a02be7-3605-43b9-a41c-be835e1e1be2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:08.002879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a02be7-3605-43b9-a41c-be835e1e1be2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:08.004683 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6caaaf-aa28-4227-ac1d-606442ff1f8f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:08.005906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a02be7-3605-43b9-a41c-be835e1e1be2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:08.022065 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 398/774] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Jul 24 00:59:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:08.027740 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a02be7-3605-43b9-a41c-be835e1e1be2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:08.132691 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6caaaf-aa28-4227-ac1d-606442ff1f8f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:08.179101 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4121e7-7b40-48da-aeba-371c4a58cc0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:08.180296 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4121e7-7b40-48da-aeba-371c4a58cc0d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:08.180810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4121e7-7b40-48da-aeba-371c4a58cc0d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:08.181287 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4121e7-7b40-48da-aeba-371c4a58cc0d None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:08.182238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4121e7-7b40-48da-aeba-371c4a58cc0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:08.182745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4121e7-7b40-48da-aeba-371c4a58cc0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:08.184401 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4121e7-7b40-48da-aeba-371c4a58cc0d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:08.211424 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 377/775] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:08.216704 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4121e7-7b40-48da-aeba-371c4a58cc0d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:08.222596 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:08.233688 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a02be7-3605-43b9-a41c-be835e1e1be2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:08.274323 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:08.323994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424716a7-df89-4e55-8c30-beabc1bf44d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:08.324656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424716a7-df89-4e55-8c30-beabc1bf44d3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:08.324945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424716a7-df89-4e55-8c30-beabc1bf44d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:08.325227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424716a7-df89-4e55-8c30-beabc1bf44d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:08.326330 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424716a7-df89-4e55-8c30-beabc1bf44d3 None admin] RBAC: Adding query filter params (interface=public, service_id=96556bd87e314323871bd697c2290250, region_id=RegionOne) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:08.326330 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424716a7-df89-4e55-8c30-beabc1bf44d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:08.327741 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424716a7-df89-4e55-8c30-beabc1bf44d3 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:08.353274 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 399/776] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Jul 24 00:59:08 2022] GET /identity/v3/endpoints?service_id=96556bd87e314323871bd697c2290250&interface=public®ion_id=RegionOne => generated 194 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:08.358086 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4121e7-7b40-48da-aeba-371c4a58cc0d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:08.364274 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424716a7-df89-4e55-8c30-beabc1bf44d3 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:08.395510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f18c24-5736-4936-a5e2-eb88f5c55df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:08.397118 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f18c24-5736-4936-a5e2-eb88f5c55df8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:08.397626 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f18c24-5736-4936-a5e2-eb88f5c55df8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:08.398148 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f18c24-5736-4936-a5e2-eb88f5c55df8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:08.405677 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f18c24-5736-4936-a5e2-eb88f5c55df8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:08.407386 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f18c24-5736-4936-a5e2-eb88f5c55df8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:08.424405 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-83f18c24-5736-4936-a5e2-eb88f5c55df8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:08.424405 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:08.424405 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:08.424405 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:08.424405 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:08.424405 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:08.424405 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:08.424405 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:08.424405 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:08.424405 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:08.424405 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:08.424405 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:08.424405 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:08.424405 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:08.424405 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:08.425330 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:08.426245 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:08.426245 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:08.426245 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:08.426245 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:08.426245 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:08.426245 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:08.426245 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:08.426245 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:08.428872 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 378/777] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:08.435597 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f18c24-5736-4936-a5e2-eb88f5c55df8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:08.520183 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:08.577278 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f18c24-5736-4936-a5e2-eb88f5c55df8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:08.615506 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc9e3c-2ccf-4c50-8a45-095ba5c962c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:08.616554 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc9e3c-2ccf-4c50-8a45-095ba5c962c3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:08.617081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc9e3c-2ccf-4c50-8a45-095ba5c962c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:08.617613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc9e3c-2ccf-4c50-8a45-095ba5c962c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:08.618606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc9e3c-2ccf-4c50-8a45-095ba5c962c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:08.619120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc9e3c-2ccf-4c50-8a45-095ba5c962c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:08.620820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cc9e3c-2ccf-4c50-8a45-095ba5c962c3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:08.635371 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 379/778] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:08.642006 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc9e3c-2ccf-4c50-8a45-095ba5c962c3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:08.761271 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424716a7-df89-4e55-8c30-beabc1bf44d3 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:08.773613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc9e3c-2ccf-4c50-8a45-095ba5c962c3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:08.802336 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:08.824099 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5ef16-5b91-4bda-859c-b3d35597b041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:08.825147 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5ef16-5b91-4bda-859c-b3d35597b041 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:08.825684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5ef16-5b91-4bda-859c-b3d35597b041 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:08.826163 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5ef16-5b91-4bda-859c-b3d35597b041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:08.827199 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5ef16-5b91-4bda-859c-b3d35597b041 None admin] RBAC: Adding query filter params (role.id=566ec5e1e87245cea292823f58d150fd, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=87ce4ba479574d89990e23c157b2801b) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:08.827770 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5ef16-5b91-4bda-859c-b3d35597b041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:08.830219 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5ef16-5b91-4bda-859c-b3d35597b041 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:08.846024 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 380/779] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:59:08 2022] GET /identity/v3/role_assignments?user.id=87ce4ba479574d89990e23c157b2801b&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=566ec5e1e87245cea292823f58d150fd => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:08.869049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39ddba-04ce-41d7-ada2-b5f5391304e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:08.870239 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39ddba-04ce-41d7-ada2-b5f5391304e3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:08.871949 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39ddba-04ce-41d7-ada2-b5f5391304e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:08.872497 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39ddba-04ce-41d7-ada2-b5f5391304e3 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:08.873577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39ddba-04ce-41d7-ada2-b5f5391304e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:08.875312 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39ddba-04ce-41d7-ada2-b5f5391304e3 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:08.892139 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 400/780] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Jul 24 00:59:08 2022] GET /identity/v3/services => generated 772 bytes in 528 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:09.272250 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de4edf-84c7-4151-9c5a-0943d86c25c2 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:09.272800 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de4edf-84c7-4151-9c5a-0943d86c25c2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:09.272800 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23de4edf-84c7-4151-9c5a-0943d86c25c2 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:09.274451 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 381/781] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:09.279742 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0661448-c9be-4abc-877c-93888d8d11bb None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:09.280034 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0661448-c9be-4abc-877c-93888d8d11bb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:09.280313 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0661448-c9be-4abc-877c-93888d8d11bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:09.298887 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e0661448-c9be-4abc-877c-93888d8d11bb None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:09.300113 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e0661448-c9be-4abc-877c-93888d8d11bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:09.325076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1fd55-9458-410b-8ebd-8dd8e3bd384c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:09.325378 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1fd55-9458-410b-8ebd-8dd8e3bd384c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:09.325628 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f1fd55-9458-410b-8ebd-8dd8e3bd384c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:09.327126 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 382/782] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:09.332225 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10c5e0-ca2a-407c-a982-2d9485a14357 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:09.332710 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10c5e0-ca2a-407c-a982-2d9485a14357 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:09.333189 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa10c5e0-ca2a-407c-a982-2d9485a14357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:09.350442 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:09.353058 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-fa10c5e0-ca2a-407c-a982-2d9485a14357 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:09.354508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fa10c5e0-ca2a-407c-a982-2d9485a14357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:09.377901 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 401/783] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:09.412180 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0661448-c9be-4abc-877c-93888d8d11bb None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:09.429331 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 383/784] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:09.481667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10c5e0-ca2a-407c-a982-2d9485a14357 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:09.536984 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0661448-c9be-4abc-877c-93888d8d11bb None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:09.620022 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffb03d-1e01-4997-9f75-936e21af63bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:09.620860 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffb03d-1e01-4997-9f75-936e21af63bd None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:09.621157 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffb03d-1e01-4997-9f75-936e21af63bd None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:09.621438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffb03d-1e01-4997-9f75-936e21af63bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:09.632292 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa10c5e0-ca2a-407c-a982-2d9485a14357 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:09.650565 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffb03d-1e01-4997-9f75-936e21af63bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:09.651125 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-8bffb03d-1e01-4997-9f75-936e21af63bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:09.658611 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:09.659656 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:09.660533 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:09.660533 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:09.660533 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:09.660533 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:09.660533 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:09.660533 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:09.660533 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:09.660533 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:09.660533 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:09.660533 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:09.660533 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:09.660533 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:09.664463 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 402/785] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:59:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:09.672283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffb03d-1e01-4997-9f75-936e21af63bd None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:09.674104 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4df0ee-7928-4c0b-8a8a-d44df74716fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:09.675187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4df0ee-7928-4c0b-8a8a-d44df74716fa None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:09.675859 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4df0ee-7928-4c0b-8a8a-d44df74716fa None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:09.676619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4df0ee-7928-4c0b-8a8a-d44df74716fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:09.691566 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4df0ee-7928-4c0b-8a8a-d44df74716fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-8f4df0ee-7928-4c0b-8a8a-d44df74716fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:09.702134 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:09.703124 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:09.704084 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:09.704084 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:09.704084 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:09.704084 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:09.704084 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:09.704084 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:09.704084 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:09.704084 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:09.704084 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:09.704084 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:09.704084 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:09.704084 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:09.706900 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 384/786] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:59:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:09.713030 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4df0ee-7928-4c0b-8a8a-d44df74716fa None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:09.759798 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:09.842015 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4df0ee-7928-4c0b-8a8a-d44df74716fa None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:09.875095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffb03d-1e01-4997-9f75-936e21af63bd None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:09.901763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd0970-10d1-44f7-b299-cbd1b1f45dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:09.902501 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd0970-10d1-44f7-b299-cbd1b1f45dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:09.902791 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd0970-10d1-44f7-b299-cbd1b1f45dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:09.903069 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd0970-10d1-44f7-b299-cbd1b1f45dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:09.903849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd0970-10d1-44f7-b299-cbd1b1f45dc4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:09.904164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd0970-10d1-44f7-b299-cbd1b1f45dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:09.905574 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd0970-10d1-44f7-b299-cbd1b1f45dc4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:09.918666 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 385/787] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:59:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:09.924433 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd0970-10d1-44f7-b299-cbd1b1f45dc4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:09.938528 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d609f5-b319-4c71-ac63-f2b82c7b4ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:09.939268 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d609f5-b319-4c71-ac63-f2b82c7b4ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:09.939578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d609f5-b319-4c71-ac63-f2b82c7b4ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:09.939858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d609f5-b319-4c71-ac63-f2b82c7b4ca5 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:09.940624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d609f5-b319-4c71-ac63-f2b82c7b4ca5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:09.940939 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d609f5-b319-4c71-ac63-f2b82c7b4ca5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:09.942328 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d609f5-b319-4c71-ac63-f2b82c7b4ca5 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:09.956986 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 403/788] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:59:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:09.962870 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d609f5-b319-4c71-ac63-f2b82c7b4ca5 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:10.007661 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:10.119793 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d609f5-b319-4c71-ac63-f2b82c7b4ca5 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:10.121948 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:10.131103 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd0970-10d1-44f7-b299-cbd1b1f45dc4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:10.156484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7b681e-53c2-473a-8337-067a11bead5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:10.157467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b681e-53c2-473a-8337-067a11bead5f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:10.157843 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b681e-53c2-473a-8337-067a11bead5f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:10.158257 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b681e-53c2-473a-8337-067a11bead5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:10.168734 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c00607f-1e47-4561-b8ff-b52460f755bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:10.169004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b681e-53c2-473a-8337-067a11bead5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:10.169939 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00607f-1e47-4561-b8ff-b52460f755bb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:10.170372 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00607f-1e47-4561-b8ff-b52460f755bb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:10.170772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7b681e-53c2-473a-8337-067a11bead5f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:10.170968 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c00607f-1e47-4561-b8ff-b52460f755bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:10.182562 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00607f-1e47-4561-b8ff-b52460f755bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:10.184285 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c00607f-1e47-4561-b8ff-b52460f755bb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:10.189400 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-bb7b681e-53c2-473a-8337-067a11bead5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:10.189400 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:10.189400 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:10.189400 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:10.189400 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:10.189400 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:10.189400 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:10.189400 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:10.189400 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:10.189400 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:10.189400 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:10.189400 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:10.189400 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:10.189400 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:10.189400 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:10.190481 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:10.191429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:10.191429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:10.191429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:10.191429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:10.191939 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 404/789] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:10.193332 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bd0c1-c7f0-4fe8-8698-9c6ac0d65dc7 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:10.193615 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bd0c1-c7f0-4fe8-8698-9c6ac0d65dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:10.193886 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3bd0c1-c7f0-4fe8-8698-9c6ac0d65dc7 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:10.199602 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 405/790] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:10.200359 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bd0c1-c7f0-4fe8-8698-9c6ac0d65dc7 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:10.206637 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6c00607f-1e47-4561-b8ff-b52460f755bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:10.206637 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:10.206637 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:10.206637 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:10.206637 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:10.206637 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:10.206637 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:10.206637 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:10.206637 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:10.206637 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:10.206637 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:10.206637 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:10.206637 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:10.206637 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:10.206637 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:10.207586 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:10.208477 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:10.208477 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:10.208477 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:10.208477 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:10.210726 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 386/791] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:10.212443 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aa32d-4d43-46a7-bacf-fa88cd919931 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:10.212951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aa32d-4d43-46a7-bacf-fa88cd919931 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:10.213428 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962aa32d-4d43-46a7-bacf-fa88cd919931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:10.231542 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-962aa32d-4d43-46a7-bacf-fa88cd919931 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:10.233030 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-962aa32d-4d43-46a7-bacf-fa88cd919931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:10.300471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3bd0c1-c7f0-4fe8-8698-9c6ac0d65dc7 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:10.305803 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 387/792] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:10.307209 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aa32d-4d43-46a7-bacf-fa88cd919931 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:10.335683 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:10.357585 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24cde4-0220-4bf4-9caf-f638566ce72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:10.358266 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24cde4-0220-4bf4-9caf-f638566ce72e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:10.358545 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24cde4-0220-4bf4-9caf-f638566ce72e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:10.358818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b24cde4-0220-4bf4-9caf-f638566ce72e None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:10.359612 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24cde4-0220-4bf4-9caf-f638566ce72e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:10.359920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24cde4-0220-4bf4-9caf-f638566ce72e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:10.361303 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b24cde4-0220-4bf4-9caf-f638566ce72e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:10.373093 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 406/793] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:10.373842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24cde4-0220-4bf4-9caf-f638566ce72e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:10.388421 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:10.416739 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962aa32d-4d43-46a7-bacf-fa88cd919931 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:10.453117 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3877bf0-1d35-4023-8d1c-e93816ef3c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:10.454310 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3877bf0-1d35-4023-8d1c-e93816ef3c86 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:10.455168 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3877bf0-1d35-4023-8d1c-e93816ef3c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:10.455823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3877bf0-1d35-4023-8d1c-e93816ef3c86 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:10.456893 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3877bf0-1d35-4023-8d1c-e93816ef3c86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:10.457549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3877bf0-1d35-4023-8d1c-e93816ef3c86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:10.459501 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3877bf0-1d35-4023-8d1c-e93816ef3c86 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:10.474097 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b24cde4-0220-4bf4-9caf-f638566ce72e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:10.478014 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 388/794] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:10.479212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3877bf0-1d35-4023-8d1c-e93816ef3c86 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:10.512233 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17d88a-1970-46d5-ac4e-895c7de4d536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:10.513106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17d88a-1970-46d5-ac4e-895c7de4d536 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:10.513386 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17d88a-1970-46d5-ac4e-895c7de4d536 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:10.513702 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17d88a-1970-46d5-ac4e-895c7de4d536 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:10.514509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17d88a-1970-46d5-ac4e-895c7de4d536 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:10.515892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17d88a-1970-46d5-ac4e-895c7de4d536 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-bb17d88a-1970-46d5-ac4e-895c7de4d536 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:10.530264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:10.531263 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:10.532159 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:10.532159 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:10.532159 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:10.532159 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:10.532159 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:10.532159 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:10.532159 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:10.532159 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:10.532159 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:10.532159 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:10.532159 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:10.532159 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:10.532159 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:10.532159 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 24 00:59:10.532159 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:10.536276 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 407/795] 10.222.0.42 () {56 vars in 1129 bytes} [Sun Jul 24 00:59:10 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:10.537137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17d88a-1970-46d5-ac4e-895c7de4d536 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:10.603678 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:10.607858 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3877bf0-1d35-4023-8d1c-e93816ef3c86 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:10.614910 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:10.641053 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17d88a-1970-46d5-ac4e-895c7de4d536 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:10.654853 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5eeb93-ad46-476f-aa76-d8b063e774a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:10.656565 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eeb93-ad46-476f-aa76-d8b063e774a4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:10.657177 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eeb93-ad46-476f-aa76-d8b063e774a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:10.657658 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5eeb93-ad46-476f-aa76-d8b063e774a4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:10.668863 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5eeb93-ad46-476f-aa76-d8b063e774a4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:10.671126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5eeb93-ad46-476f-aa76-d8b063e774a4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:10.680653 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409e7ea-4b2e-4651-881c-6beb974fac2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:10.681507 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409e7ea-4b2e-4651-881c-6beb974fac2d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:10.681795 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409e7ea-4b2e-4651-881c-6beb974fac2d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:10.682074 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409e7ea-4b2e-4651-881c-6beb974fac2d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-df5eeb93-ad46-476f-aa76-d8b063e774a4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:59:10.688187 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:10.689141 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:10.690129 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:10.690129 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:10.690129 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:59:10.690129 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:59:10.690129 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:59:10.690129 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:59:10.690129 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:59:10.690129 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:59:10.690129 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:59:10.690129 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:10.692357 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409e7ea-4b2e-4651-881c-6beb974fac2d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:10.693117 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 389/796] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:59:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:10.694099 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5eeb93-ad46-476f-aa76-d8b063e774a4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:10.694458 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c409e7ea-4b2e-4651-881c-6beb974fac2d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-c409e7ea-4b2e-4651-881c-6beb974fac2d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:59:10.712746 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:10.713874 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:10.714821 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:10.714821 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:10.714821 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:59:10.714821 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:59:10.714821 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:59:10.714821 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:59:10.714821 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:59:10.714821 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:59:10.714821 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:59:10.714821 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:10.714821 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 408/797] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Jul 24 00:59:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:10.716078 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409e7ea-4b2e-4651-881c-6beb974fac2d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:10.827780 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5eeb93-ad46-476f-aa76-d8b063e774a4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:10.844058 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409e7ea-4b2e-4651-881c-6beb974fac2d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:10.872552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40fb1b-50d3-4930-87f8-eb8a44795884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:10.874262 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40fb1b-50d3-4930-87f8-eb8a44795884 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:10.874753 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40fb1b-50d3-4930-87f8-eb8a44795884 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:10.875499 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba40fb1b-50d3-4930-87f8-eb8a44795884 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:10.877024 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40fb1b-50d3-4930-87f8-eb8a44795884 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:10.877619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40fb1b-50d3-4930-87f8-eb8a44795884 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:10.879902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba40fb1b-50d3-4930-87f8-eb8a44795884 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:10.884972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e264f-3b49-43aa-9bc8-c68eb5eb8364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:10.885856 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e264f-3b49-43aa-9bc8-c68eb5eb8364 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:10.886234 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e264f-3b49-43aa-9bc8-c68eb5eb8364 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:10.886438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e264f-3b49-43aa-9bc8-c68eb5eb8364 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:10.886628 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 390/798] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Jul 24 00:59:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:10.887466 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e264f-3b49-43aa-9bc8-c68eb5eb8364 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:10.887819 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40fb1b-50d3-4930-87f8-eb8a44795884 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:10.887923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e264f-3b49-43aa-9bc8-c68eb5eb8364 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:10.889467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e264f-3b49-43aa-9bc8-c68eb5eb8364 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:10.892023 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:10.894512 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:10.913839 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 409/799] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Jul 24 00:59:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:10.915145 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e264f-3b49-43aa-9bc8-c68eb5eb8364 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:10.991505 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba40fb1b-50d3-4930-87f8-eb8a44795884 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:11.023173 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e264f-3b49-43aa-9bc8-c68eb5eb8364 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:11.025620 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce748432-97e6-41f6-a337-a694e97f1745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:11.026912 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce748432-97e6-41f6-a337-a694e97f1745 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:11.026912 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce748432-97e6-41f6-a337-a694e97f1745 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:11.026912 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce748432-97e6-41f6-a337-a694e97f1745 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:11.027831 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce748432-97e6-41f6-a337-a694e97f1745 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:11.028140 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce748432-97e6-41f6-a337-a694e97f1745 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:11.029609 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce748432-97e6-41f6-a337-a694e97f1745 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:11.048080 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 391/800] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Jul 24 00:59:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:11.048746 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce748432-97e6-41f6-a337-a694e97f1745 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:11.062727 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a27bf9-eedf-415a-b0d6-0c23a2a8da4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:11.063892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a27bf9-eedf-415a-b0d6-0c23a2a8da4a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:11.064380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a27bf9-eedf-415a-b0d6-0c23a2a8da4a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:11.064902 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a27bf9-eedf-415a-b0d6-0c23a2a8da4a None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:11.065828 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a27bf9-eedf-415a-b0d6-0c23a2a8da4a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:11.066356 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a27bf9-eedf-415a-b0d6-0c23a2a8da4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:11.068585 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a27bf9-eedf-415a-b0d6-0c23a2a8da4a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:11.074539 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 410/801] 10.222.0.42 () {56 vars in 1124 bytes} [Sun Jul 24 00:59:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:11.075737 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a27bf9-eedf-415a-b0d6-0c23a2a8da4a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:11.116473 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:11.135965 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:11.160033 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce748432-97e6-41f6-a337-a694e97f1745 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:11.179680 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a27bf9-eedf-415a-b0d6-0c23a2a8da4a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:11.196772 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a9d017-25fc-4371-b234-0adb3b4bc6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:11.197588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9d017-25fc-4371-b234-0adb3b4bc6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:11.197877 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9d017-25fc-4371-b234-0adb3b4bc6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:11.198157 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a9d017-25fc-4371-b234-0adb3b4bc6d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:11.211149 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9d017-25fc-4371-b234-0adb3b4bc6d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:11.212663 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a9d017-25fc-4371-b234-0adb3b4bc6d3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:11.217190 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b099ede-9d10-41f0-ae24-6e70b0cd68e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:11.217852 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b099ede-9d10-41f0-ae24-6e70b0cd68e8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:11.218140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b099ede-9d10-41f0-ae24-6e70b0cd68e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:11.218414 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b099ede-9d10-41f0-ae24-6e70b0cd68e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:11.232522 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-43a9d017-25fc-4371-b234-0adb3b4bc6d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:11.232522 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:11.232522 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:11.232522 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:11.232522 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:11.232522 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:11.232522 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:11.232522 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:11.232522 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:11.232522 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:11.232522 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:11.232522 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:11.232522 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:11.232522 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:11.232522 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:11.233516 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:11.234433 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:11.234433 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:11.234433 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:11.234433 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:11.234433 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 392/802] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:11.235239 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21e730-5e95-42ac-9ccc-c402ee072e8a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:11.235239 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21e730-5e95-42ac-9ccc-c402ee072e8a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:11.235504 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b21e730-5e95-42ac-9ccc-c402ee072e8a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:11.239419 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 393/803] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:11.239419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21e730-5e95-42ac-9ccc-c402ee072e8a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:11.293052 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b099ede-9d10-41f0-ae24-6e70b0cd68e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:11.294520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b099ede-9d10-41f0-ae24-6e70b0cd68e8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:11.346756 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b21e730-5e95-42ac-9ccc-c402ee072e8a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:11.354371 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:11.361602 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:11.383415 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fc64cb-3abb-40c4-a6be-52165205cf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:11.384082 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc64cb-3abb-40c4-a6be-52165205cf83 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:11.384366 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc64cb-3abb-40c4-a6be-52165205cf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:11.384643 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc64cb-3abb-40c4-a6be-52165205cf83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:11.385408 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc64cb-3abb-40c4-a6be-52165205cf83 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:11.386783 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fc64cb-3abb-40c4-a6be-52165205cf83 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:11.402927 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 411/804] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:59:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:59:11.403823 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b099ede-9d10-41f0-ae24-6e70b0cd68e8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:11.414572 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 394/805] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Jul 24 00:59:11 2022] POST /identity/v3/endpoints => generated 346 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:59:11.416090 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc87974-467d-4f47-8f3d-7c8a0b4cdb81 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:11.416385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc87974-467d-4f47-8f3d-7c8a0b4cdb81 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:11.416669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc87974-467d-4f47-8f3d-7c8a0b4cdb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:11.434450 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0dc87974-467d-4f47-8f3d-7c8a0b4cdb81 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:11.435698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0dc87974-467d-4f47-8f3d-7c8a0b4cdb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:11.520647 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 395/806] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:11.521884 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc87974-467d-4f47-8f3d-7c8a0b4cdb81 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:11.547696 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b099ede-9d10-41f0-ae24-6e70b0cd68e8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:11.590960 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477ec1d-afb3-4e2c-b4fa-f498c5e0c582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:11.591980 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ec1d-afb3-4e2c-b4fa-f498c5e0c582 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:11.591980 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ec1d-afb3-4e2c-b4fa-f498c5e0c582 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:11.592285 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ec1d-afb3-4e2c-b4fa-f498c5e0c582 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:11.593267 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477ec1d-afb3-4e2c-b4fa-f498c5e0c582 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:11.593267 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477ec1d-afb3-4e2c-b4fa-f498c5e0c582 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:11.594629 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477ec1d-afb3-4e2c-b4fa-f498c5e0c582 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:11.607184 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 412/807] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:11.608088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da74b20-7a31-4585-8b30-8081b696e08b None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:11.608356 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da74b20-7a31-4585-8b30-8081b696e08b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:11.608637 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da74b20-7a31-4585-8b30-8081b696e08b None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:11.609864 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 413/808] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:11.610550 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da74b20-7a31-4585-8b30-8081b696e08b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:11.630920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:11.646256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:11.654444 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc87974-467d-4f47-8f3d-7c8a0b4cdb81 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:11.691407 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b8ef1-023e-4738-9058-4b1f157cbe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:11.692313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b8ef1-023e-4738-9058-4b1f157cbe0a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:11.693095 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b8ef1-023e-4738-9058-4b1f157cbe0a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:11.693362 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b8ef1-023e-4738-9058-4b1f157cbe0a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:11.703694 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b8ef1-023e-4738-9058-4b1f157cbe0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:11.705160 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b8ef1-023e-4738-9058-4b1f157cbe0a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:11.715225 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da74b20-7a31-4585-8b30-8081b696e08b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:11.722746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1f0b8ef1-023e-4738-9058-4b1f157cbe0a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:11.722746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:11.722746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:11.722746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:11.722746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:11.722746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:11.722746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:11.722746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:11.722746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:11.722746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:11.722746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:11.722746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:11.722746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:11.722746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:11.722746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:11.723892 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:11.729919 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:11.729919 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:11.729919 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:11.729919 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:11.729919 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 396/809] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:11.729919 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b8ef1-023e-4738-9058-4b1f157cbe0a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:11.756624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9fde5-3616-4713-b1ef-011fc77cdef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:11.757441 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9fde5-3616-4713-b1ef-011fc77cdef4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:11.757835 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9fde5-3616-4713-b1ef-011fc77cdef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:11.758130 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9fde5-3616-4713-b1ef-011fc77cdef4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:11.768375 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9fde5-3616-4713-b1ef-011fc77cdef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-f5e9fde5-3616-4713-b1ef-011fc77cdef4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:11.776215 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:11.777382 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:11.778412 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:11.778412 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:11.778412 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:11.778412 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:11.778412 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:11.778412 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:11.778412 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:11.778412 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:11.778412 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:11.778412 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:11.778412 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:59:11.778412 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:11.782359 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 414/810] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:59:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:11.783670 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f176ea-880c-4aec-9ab5-f157ff6cf1e8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:11.783968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f176ea-880c-4aec-9ab5-f157ff6cf1e8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:11.784254 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f176ea-880c-4aec-9ab5-f157ff6cf1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:11.804828 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d8f176ea-880c-4aec-9ab5-f157ff6cf1e8 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:11.806055 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d8f176ea-880c-4aec-9ab5-f157ff6cf1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:11.834638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b8ef1-023e-4738-9058-4b1f157cbe0a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:11.871344 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47583283-3470-4392-8d32-7550909b3aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:11.872241 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47583283-3470-4392-8d32-7550909b3aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:11.872637 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47583283-3470-4392-8d32-7550909b3aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:11.872916 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47583283-3470-4392-8d32-7550909b3aa2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:11.879799 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 415/811] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:11.880768 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47583283-3470-4392-8d32-7550909b3aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:11.882442 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47583283-3470-4392-8d32-7550909b3aa2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:11.884219 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f176ea-880c-4aec-9ab5-f157ff6cf1e8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:11.896650 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:11.903632 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-47583283-3470-4392-8d32-7550909b3aa2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:11.903632 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:11.903632 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:11.903632 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:11.903632 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:11.903632 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:11.903632 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:11.903632 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:11.903632 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:11.903632 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:11.903632 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:11.903632 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:11.903632 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:11.903632 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:11.903632 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:11.904605 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:11.905556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:11.905556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:11.905556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:11.905556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:11.905556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:11.905556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:11.905556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:11.905556 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:11.905556 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 397/812] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:11.906056 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47583283-3470-4392-8d32-7550909b3aa2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:11.919745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:11.990398 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f176ea-880c-4aec-9ab5-f157ff6cf1e8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:12.014698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47583283-3470-4392-8d32-7550909b3aa2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:12.023654 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905d4ba-c73e-4389-8f96-a1e7d5bcb5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:12.024325 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905d4ba-c73e-4389-8f96-a1e7d5bcb5cf None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.024611 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905d4ba-c73e-4389-8f96-a1e7d5bcb5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.024883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905d4ba-c73e-4389-8f96-a1e7d5bcb5cf None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.025607 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905d4ba-c73e-4389-8f96-a1e7d5bcb5cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:12.025916 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905d4ba-c73e-4389-8f96-a1e7d5bcb5cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:12.027325 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5905d4ba-c73e-4389-8f96-a1e7d5bcb5cf None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:12.038455 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 416/813] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:12.039110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905d4ba-c73e-4389-8f96-a1e7d5bcb5cf None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:12.055007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1e3ff-6d43-463d-ba42-24a62161ab7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:12.055731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1e3ff-6d43-463d-ba42-24a62161ab7a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.056025 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1e3ff-6d43-463d-ba42-24a62161ab7a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.056321 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab1e3ff-6d43-463d-ba42-24a62161ab7a None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.057065 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1e3ff-6d43-463d-ba42-24a62161ab7a None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:12.057403 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1e3ff-6d43-463d-ba42-24a62161ab7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:12.058792 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab1e3ff-6d43-463d-ba42-24a62161ab7a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:12.068019 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 398/814] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:59:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:12.068826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1e3ff-6d43-463d-ba42-24a62161ab7a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:12.113246 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:12.142593 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:12.150193 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905d4ba-c73e-4389-8f96-a1e7d5bcb5cf None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:12.176854 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab1e3ff-6d43-463d-ba42-24a62161ab7a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:12.185104 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e3803-f4fa-47ff-8e85-d7ff06415cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:12.185923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e3803-f4fa-47ff-8e85-d7ff06415cb4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.186205 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e3803-f4fa-47ff-8e85-d7ff06415cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.186479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009e3803-f4fa-47ff-8e85-d7ff06415cb4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.187131 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e3803-f4fa-47ff-8e85-d7ff06415cb4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:12.188542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009e3803-f4fa-47ff-8e85-d7ff06415cb4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-009e3803-f4fa-47ff-8e85-d7ff06415cb4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:12.201025 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:12.202049 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:12.202917 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:12.202917 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:12.202917 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:12.202917 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:12.202917 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:12.202917 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:12.202917 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:12.202917 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:12.202917 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:12.202917 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:12.202917 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:12.202917 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:12.202917 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 24 00:59:12.202917 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:12.202917 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 417/815] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:12 2022] GET /identity/v3/services/network => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:12.203793 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e3803-f4fa-47ff-8e85-d7ff06415cb4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:12.218928 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7ee73-4578-4fcb-b6bd-8f2cc58d68b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:12.219939 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7ee73-4578-4fcb-b6bd-8f2cc58d68b6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.220288 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7ee73-4578-4fcb-b6bd-8f2cc58d68b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.220565 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f7ee73-4578-4fcb-b6bd-8f2cc58d68b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.221356 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7ee73-4578-4fcb-b6bd-8f2cc58d68b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:12.221666 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7ee73-4578-4fcb-b6bd-8f2cc58d68b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:12.223236 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f7ee73-4578-4fcb-b6bd-8f2cc58d68b6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:12.236073 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 399/816] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:12.236855 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7ee73-4578-4fcb-b6bd-8f2cc58d68b6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:12.308529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009e3803-f4fa-47ff-8e85-d7ff06415cb4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:12.338810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f7ee73-4578-4fcb-b6bd-8f2cc58d68b6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:12.342343 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:12.350749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b59df-0aba-42af-8927-afc9258fa7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:12.352060 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b59df-0aba-42af-8927-afc9258fa7ab None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.352912 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b59df-0aba-42af-8927-afc9258fa7ab None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.353698 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b59df-0aba-42af-8927-afc9258fa7ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.362711 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b59df-0aba-42af-8927-afc9258fa7ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:12.364898 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91b59df-0aba-42af-8927-afc9258fa7ab None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:12.366613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:12.373322 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159488ab-58e3-4318-b455-d0c7c59e237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:12.374132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159488ab-58e3-4318-b455-d0c7c59e237c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.374414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159488ab-58e3-4318-b455-d0c7c59e237c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.374693 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159488ab-58e3-4318-b455-d0c7c59e237c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.381886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-f91b59df-0aba-42af-8927-afc9258fa7ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:12.381886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:12.381886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:12.381886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:12.381886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:12.381886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:12.381886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:12.381886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:12.381886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:12.381886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:12.381886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:12.381886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:12.381886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:12.381886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:12.381886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:12.382886 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:12.383850 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:12.383850 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:12.383850 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:12.383850 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:12.383850 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:12.383850 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:12.383850 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:12.383850 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:12.386711 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 418/817] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:12.387581 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b59df-0aba-42af-8927-afc9258fa7ab None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:12.389190 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159488ab-58e3-4318-b455-d0c7c59e237c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:12.390890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159488ab-58e3-4318-b455-d0c7c59e237c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:12.409011 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-159488ab-58e3-4318-b455-d0c7c59e237c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:12.409011 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:12.409011 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:12.409011 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:12.409011 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:12.409011 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:12.409011 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:12.409011 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:12.409011 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:12.409011 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:12.409011 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:12.409011 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:12.409011 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:12.409011 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:12.409011 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:12.409979 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:12.410929 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:12.410929 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:12.410929 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:12.410929 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:12.416674 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 400/818] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:12.416674 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159488ab-58e3-4318-b455-d0c7c59e237c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:12.504721 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b59df-0aba-42af-8927-afc9258fa7ab None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:12.514717 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159488ab-58e3-4318-b455-d0c7c59e237c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:12.546445 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26c536-a758-490b-9556-a739d6b3f3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:12.547125 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26c536-a758-490b-9556-a739d6b3f3c9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.547468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26c536-a758-490b-9556-a739d6b3f3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.547741 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c26c536-a758-490b-9556-a739d6b3f3c9 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.548491 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26c536-a758-490b-9556-a739d6b3f3c9 None admin] RBAC: Adding query filter params (name=network) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:12.548791 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26c536-a758-490b-9556-a739d6b3f3c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:12.550208 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c26c536-a758-490b-9556-a739d6b3f3c9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:12.552005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091e8ef-fe24-42ca-8177-8cd92adee39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:12.552947 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091e8ef-fe24-42ca-8177-8cd92adee39f None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.553227 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091e8ef-fe24-42ca-8177-8cd92adee39f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.553501 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f091e8ef-fe24-42ca-8177-8cd92adee39f None admin] PATH_INFO: `/v3/projects/604801625292482a9fb4b70c416dc438/users/dea37db9b0f3432093e8fe89d5fcc687/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.555842 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 419/819] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Jul 24 00:59:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:12.555953 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091e8ef-fe24-42ca-8177-8cd92adee39f None admin] RBAC: Authorizing `identity:create_grant(project_id=604801625292482a9fb4b70c416dc438, user_id=dea37db9b0f3432093e8fe89d5fcc687, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:12.557176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f091e8ef-fe24-42ca-8177-8cd92adee39f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:12.561067 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26c536-a758-490b-9556-a739d6b3f3c9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:12.583347 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 401/820] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:59:12 2022] PUT /identity/v3/projects/604801625292482a9fb4b70c416dc438/users/dea37db9b0f3432093e8fe89d5fcc687/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:59:12.583347 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091e8ef-fe24-42ca-8177-8cd92adee39f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:12.631839 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:12.643489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:12.705592 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c26c536-a758-490b-9556-a739d6b3f3c9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:12.706293 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f091e8ef-fe24-42ca-8177-8cd92adee39f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:12.743620 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5261d3c-a964-456b-8882-45c670b7647b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:12.744406 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5261d3c-a964-456b-8882-45c670b7647b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.744763 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5261d3c-a964-456b-8882-45c670b7647b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.745170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5261d3c-a964-456b-8882-45c670b7647b None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.747368 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5261d3c-a964-456b-8882-45c670b7647b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:12.747368 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5261d3c-a964-456b-8882-45c670b7647b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:12.747983 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5261d3c-a964-456b-8882-45c670b7647b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:12.751839 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c3612-3e55-46dc-acb5-33ed19da903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:12.752902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c3612-3e55-46dc-acb5-33ed19da903d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.753182 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c3612-3e55-46dc-acb5-33ed19da903d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.753457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c3612-3e55-46dc-acb5-33ed19da903d None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.754184 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c3612-3e55-46dc-acb5-33ed19da903d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:12.754527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c3612-3e55-46dc-acb5-33ed19da903d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:12.756072 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436c3612-3e55-46dc-acb5-33ed19da903d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:12.762201 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 420/821] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:12.762880 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5261d3c-a964-456b-8882-45c670b7647b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:12.770549 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 402/822] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:12.771273 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c3612-3e55-46dc-acb5-33ed19da903d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:12.886999 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c3612-3e55-46dc-acb5-33ed19da903d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:12.889558 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:12.891063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5261d3c-a964-456b-8882-45c670b7647b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:12.910378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:12.930069 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d29fe0-244f-4598-97f2-912c19513bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:12.930797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d29fe0-244f-4598-97f2-912c19513bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.931080 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d29fe0-244f-4598-97f2-912c19513bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.931438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d29fe0-244f-4598-97f2-912c19513bf3 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.932148 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d29fe0-244f-4598-97f2-912c19513bf3 None admin] RBAC: Adding query filter params (type=network) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:12.932546 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d29fe0-244f-4598-97f2-912c19513bf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:12.933995 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d29fe0-244f-4598-97f2-912c19513bf3 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:12.934452 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546fad9-926f-41ed-8cd6-21df29528c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:12.935552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546fad9-926f-41ed-8cd6-21df29528c85 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:12.936367 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546fad9-926f-41ed-8cd6-21df29528c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:12.936725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9546fad9-926f-41ed-8cd6-21df29528c85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:12.937927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546fad9-926f-41ed-8cd6-21df29528c85 None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=6c32c443ee1a421e98e7656e8e86e27a) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:12.938311 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546fad9-926f-41ed-8cd6-21df29528c85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:12.939517 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 421/823] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Jul 24 00:59:12 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:12.940337 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d29fe0-244f-4598-97f2-912c19513bf3 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:12.944063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9546fad9-926f-41ed-8cd6-21df29528c85 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:12.955873 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 403/824] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:59:12 2022] GET /identity/v3/role_assignments?user.id=6c32c443ee1a421e98e7656e8e86e27a&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:12.957413 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546fad9-926f-41ed-8cd6-21df29528c85 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:13.132934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d29fe0-244f-4598-97f2-912c19513bf3 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:13.155902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9546fad9-926f-41ed-8cd6-21df29528c85 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:13.170101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4c873-89fe-42db-8f91-1731b055cedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:13.171050 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4c873-89fe-42db-8f91-1731b055cedc None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:13.171431 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4c873-89fe-42db-8f91-1731b055cedc None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:13.171712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a4c873-89fe-42db-8f91-1731b055cedc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.180320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4c873-89fe-42db-8f91-1731b055cedc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:13.182382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a4c873-89fe-42db-8f91-1731b055cedc None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:13.194893 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6442f-b8bc-4c0c-a368-96c107cc7529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:13.195961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6442f-b8bc-4c0c-a368-96c107cc7529 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:13.196469 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6442f-b8bc-4c0c-a368-96c107cc7529 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:13.196942 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6442f-b8bc-4c0c-a368-96c107cc7529 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.197881 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6442f-b8bc-4c0c-a368-96c107cc7529 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:13.199627 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6442f-b8bc-4c0c-a368-96c107cc7529 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d6a4c873-89fe-42db-8f91-1731b055cedc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:59:13.201709 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:13.202662 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:13.204064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:13.204064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:13.204064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:59:13.204064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:59:13.204064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:59:13.204064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:59:13.204064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:59:13.204064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:59:13.204064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:59:13.204064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:13.206509 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 422/825] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Jul 24 00:59:12 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:13.209457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4c873-89fe-42db-8f91-1731b055cedc None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:13.234371 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 404/826] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Jul 24 00:59:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:59:13.258220 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:13.329256 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a4c873-89fe-42db-8f91-1731b055cedc None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:13.374119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e7e669-5c1d-4243-8539-e7a9e645020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:13.374816 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7e669-5c1d-4243-8539-e7a9e645020d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:13.375104 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7e669-5c1d-4243-8539-e7a9e645020d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:13.375500 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e7e669-5c1d-4243-8539-e7a9e645020d None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.376462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7e669-5c1d-4243-8539-e7a9e645020d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:13.376779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7e669-5c1d-4243-8539-e7a9e645020d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:13.378356 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e7e669-5c1d-4243-8539-e7a9e645020d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:13.403531 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 423/827] 10.222.0.42 () {56 vars in 1149 bytes} [Sun Jul 24 00:59:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:13.405373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6442f-b8bc-4c0c-a368-96c107cc7529 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:13.433381 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:13.515815 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6442f-b8bc-4c0c-a368-96c107cc7529 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:13.552875 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71498faf-f8e8-4f22-8be8-78d781b4071d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:13.553695 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71498faf-f8e8-4f22-8be8-78d781b4071d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:13.553976 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71498faf-f8e8-4f22-8be8-78d781b4071d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:13.554251 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71498faf-f8e8-4f22-8be8-78d781b4071d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.569193 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71498faf-f8e8-4f22-8be8-78d781b4071d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:13.569193 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71498faf-f8e8-4f22-8be8-78d781b4071d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:13.575819 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b926b1-6b51-47e6-a75b-44d94c29db9b None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:13.576175 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b926b1-6b51-47e6-a75b-44d94c29db9b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:13.576462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b926b1-6b51-47e6-a75b-44d94c29db9b None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.578751 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 424/828] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:13.583722 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d8811-e50b-4f6e-a00f-6799d0c49b4f None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:13.584019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d8811-e50b-4f6e-a00f-6799d0c49b4f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:13.584308 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909d8811-e50b-4f6e-a00f-6799d0c49b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.588723 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-71498faf-f8e8-4f22-8be8-78d781b4071d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:13.588723 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:13.588723 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:13.588723 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:13.588723 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:13.588723 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:13.588723 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:13.588723 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:13.588723 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:13.588723 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:13.588723 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:13.588723 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:13.588723 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:13.588723 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:13.588723 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:13.589823 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:13.590967 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:13.590967 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:13.590967 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:13.590967 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:13.596555 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 405/829] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:13.604408 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71498faf-f8e8-4f22-8be8-78d781b4071d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:13.619437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-909d8811-e50b-4f6e-a00f-6799d0c49b4f None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:13.620751 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-909d8811-e50b-4f6e-a00f-6799d0c49b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:13.696484 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:13.700123 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 425/830] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:13.723794 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d8811-e50b-4f6e-a00f-6799d0c49b4f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:13.730316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71498faf-f8e8-4f22-8be8-78d781b4071d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:13.752001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:13.777794 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a914a7-5d29-449f-b56f-1d9efd0a3efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:13.779118 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a914a7-5d29-449f-b56f-1d9efd0a3efb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:13.779638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a914a7-5d29-449f-b56f-1d9efd0a3efb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:13.780584 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a914a7-5d29-449f-b56f-1d9efd0a3efb None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.781827 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a914a7-5d29-449f-b56f-1d9efd0a3efb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:13.782596 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a914a7-5d29-449f-b56f-1d9efd0a3efb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:13.784642 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a914a7-5d29-449f-b56f-1d9efd0a3efb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:13.806875 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 406/831] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:13.815876 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a914a7-5d29-449f-b56f-1d9efd0a3efb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:13.847949 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909d8811-e50b-4f6e-a00f-6799d0c49b4f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:13.889764 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135c736-3cc5-4ada-98df-2b74a7600c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:13.890833 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135c736-3cc5-4ada-98df-2b74a7600c68 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:13.891116 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135c736-3cc5-4ada-98df-2b74a7600c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:13.891428 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135c736-3cc5-4ada-98df-2b74a7600c68 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.892328 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135c736-3cc5-4ada-98df-2b74a7600c68 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:13.894364 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6135c736-3cc5-4ada-98df-2b74a7600c68 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-6135c736-3cc5-4ada-98df-2b74a7600c68 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:13.909869 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:13.911651 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:13.912747 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:13.912747 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:13.912747 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:13.912747 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:13.912747 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:13.912747 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:13.912747 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:13.912747 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:13.912747 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:13.912747 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:13.912747 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:13.912747 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:13.912747 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:59:13.912747 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:13.912747 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 426/832] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:59:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:13.920197 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135c736-3cc5-4ada-98df-2b74a7600c68 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:13.948772 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a914a7-5d29-449f-b56f-1d9efd0a3efb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:13.992143 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcda5c-93aa-4553-a8fd-95fdc5b06c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:13.993238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcda5c-93aa-4553-a8fd-95fdc5b06c90 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:13.993526 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcda5c-93aa-4553-a8fd-95fdc5b06c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:13.993803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcda5c-93aa-4553-a8fd-95fdc5b06c90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:13.996499 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:14.004710 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcda5c-93aa-4553-a8fd-95fdc5b06c90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:14.006533 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcda5c-93aa-4553-a8fd-95fdc5b06c90 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:14.026356 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-5efcda5c-93aa-4553-a8fd-95fdc5b06c90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:14.026356 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:14.026356 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:14.026356 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:14.026356 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:14.026356 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:14.026356 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:14.026356 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:14.026356 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:14.026356 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:14.026356 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:14.026356 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:14.026356 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:14.026356 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:14.026356 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:14.027549 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:14.028693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:14.028693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:14.028693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:14.028693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:14.028693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:14.028693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:14.028693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:14.028693 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:14.034403 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 407/833] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:14.035715 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcda5c-93aa-4553-a8fd-95fdc5b06c90 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:14.039718 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:14.057245 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135c736-3cc5-4ada-98df-2b74a7600c68 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:14.103496 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac141656-95f0-4243-bd2c-5afbaf0d9011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:14.104419 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac141656-95f0-4243-bd2c-5afbaf0d9011 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:14.104882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac141656-95f0-4243-bd2c-5afbaf0d9011 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:14.105560 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac141656-95f0-4243-bd2c-5afbaf0d9011 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:14.106990 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac141656-95f0-4243-bd2c-5afbaf0d9011 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:14.107482 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac141656-95f0-4243-bd2c-5afbaf0d9011 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:14.109283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac141656-95f0-4243-bd2c-5afbaf0d9011 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:14.120074 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 427/834] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:59:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:14.120903 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac141656-95f0-4243-bd2c-5afbaf0d9011 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:14.147550 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcda5c-93aa-4553-a8fd-95fdc5b06c90 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:14.182372 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba052c4-8062-457c-9323-a13ac01f1651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:14.183045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba052c4-8062-457c-9323-a13ac01f1651 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:14.183350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba052c4-8062-457c-9323-a13ac01f1651 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:14.183633 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba052c4-8062-457c-9323-a13ac01f1651 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:14.184420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba052c4-8062-457c-9323-a13ac01f1651 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:14.184733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba052c4-8062-457c-9323-a13ac01f1651 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:14.186198 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba052c4-8062-457c-9323-a13ac01f1651 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:14.204546 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 408/835] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:14.205766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba052c4-8062-457c-9323-a13ac01f1651 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:14.246570 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac141656-95f0-4243-bd2c-5afbaf0d9011 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:14.277343 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:14.281260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e8e0a6-83e3-4ccf-8185-42049f58752c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:14.282118 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8e0a6-83e3-4ccf-8185-42049f58752c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:14.282509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8e0a6-83e3-4ccf-8185-42049f58752c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:14.282879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e8e0a6-83e3-4ccf-8185-42049f58752c None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:14.283746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8e0a6-83e3-4ccf-8185-42049f58752c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:14.284137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8e0a6-83e3-4ccf-8185-42049f58752c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:14.285615 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e8e0a6-83e3-4ccf-8185-42049f58752c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:14.291976 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 428/836] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:59:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:14.333883 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba052c4-8062-457c-9323-a13ac01f1651 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:14.373476 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f01b6a-5ed8-443c-a87b-06260bee1481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:14.374459 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f01b6a-5ed8-443c-a87b-06260bee1481 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:14.374743 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f01b6a-5ed8-443c-a87b-06260bee1481 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:14.375014 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f01b6a-5ed8-443c-a87b-06260bee1481 None admin] PATH_INFO: `/v3/projects/604801625292482a9fb4b70c416dc438/users/87ce4ba479574d89990e23c157b2801b/roles/566ec5e1e87245cea292823f58d150fd` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:14.392473 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f01b6a-5ed8-443c-a87b-06260bee1481 None admin] RBAC: Authorizing `identity:create_grant(project_id=604801625292482a9fb4b70c416dc438, user_id=87ce4ba479574d89990e23c157b2801b, role_id=566ec5e1e87245cea292823f58d150fd)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:14.394076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f01b6a-5ed8-443c-a87b-06260bee1481 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:14.416636 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 409/837] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:59:14 2022] PUT /identity/v3/projects/604801625292482a9fb4b70c416dc438/users/87ce4ba479574d89990e23c157b2801b/roles/566ec5e1e87245cea292823f58d150fd => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:59:14.739783 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059a240-3e8e-4ef1-b069-11d9b89d9c55 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:14.740134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059a240-3e8e-4ef1-b069-11d9b89d9c55 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:14.740347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059a240-3e8e-4ef1-b069-11d9b89d9c55 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:14.742011 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 429/838] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:14.747332 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a08e8a-622c-4f9f-86c6-600d2c740286 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:14.747632 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a08e8a-622c-4f9f-86c6-600d2c740286 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:14.747913 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a08e8a-622c-4f9f-86c6-600d2c740286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:14.768932 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-42a08e8a-622c-4f9f-86c6-600d2c740286 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:14.770455 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-42a08e8a-622c-4f9f-86c6-600d2c740286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:14.843760 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 410/839] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:14 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:14.866082 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059a240-3e8e-4ef1-b069-11d9b89d9c55 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:14.886050 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:14.973982 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059a240-3e8e-4ef1-b069-11d9b89d9c55 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:15.009772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209efb73-859d-4183-ab85-f9c90b119de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:15.010838 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209efb73-859d-4183-ab85-f9c90b119de8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.011317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209efb73-859d-4183-ab85-f9c90b119de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.011740 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209efb73-859d-4183-ab85-f9c90b119de8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.023776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209efb73-859d-4183-ab85-f9c90b119de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-209efb73-859d-4183-ab85-f9c90b119de8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:15.031826 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:15.032989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:15.034039 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:15.034039 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:15.034039 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:15.034039 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:15.034039 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:15.034039 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:15.034039 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:15.034039 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:15.034039 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:15.034039 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:15.034039 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:15.034039 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:15.036521 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 430/840] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:59:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:15.043321 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a08e8a-622c-4f9f-86c6-600d2c740286 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:15.075779 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:15.148703 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a08e8a-622c-4f9f-86c6-600d2c740286 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:15.185671 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dffc0f-5fc9-49e6-b9b8-a40afbbdef9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:15.186419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dffc0f-5fc9-49e6-b9b8-a40afbbdef9a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.186708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dffc0f-5fc9-49e6-b9b8-a40afbbdef9a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.186990 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dffc0f-5fc9-49e6-b9b8-a40afbbdef9a None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.187824 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dffc0f-5fc9-49e6-b9b8-a40afbbdef9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:15.188142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dffc0f-5fc9-49e6-b9b8-a40afbbdef9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:15.189552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dffc0f-5fc9-49e6-b9b8-a40afbbdef9a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:15.198854 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 411/841] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:59:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:15.204139 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209efb73-859d-4183-ab85-f9c90b119de8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:15.285825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:15.309163 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209efb73-859d-4183-ab85-f9c90b119de8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:15.342982 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3375f795-84c1-4043-aaac-6dca8507b42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:15.343825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375f795-84c1-4043-aaac-6dca8507b42d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.344399 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375f795-84c1-4043-aaac-6dca8507b42d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.344677 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3375f795-84c1-4043-aaac-6dca8507b42d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.355638 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375f795-84c1-4043-aaac-6dca8507b42d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:15.357230 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3375f795-84c1-4043-aaac-6dca8507b42d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:15.374683 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-3375f795-84c1-4043-aaac-6dca8507b42d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:15.374683 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:15.374683 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:15.374683 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:15.374683 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:15.374683 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:15.374683 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:15.374683 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:15.374683 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:15.374683 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:15.374683 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:15.374683 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:15.374683 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:15.374683 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:15.374683 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:15.375644 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:15.376558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:15.376558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:15.376558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:15.376558 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:15.376558 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 431/842] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:15.381641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dffc0f-5fc9-49e6-b9b8-a40afbbdef9a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:15.394900 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd1f67-eb39-4e11-a742-7261d30e3e46 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.395186 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd1f67-eb39-4e11-a742-7261d30e3e46 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.395500 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebd1f67-eb39-4e11-a742-7261d30e3e46 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.397011 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 432/843] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:59:15.401911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e02da-b139-4906-bbe4-f9e3dd00dcea None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.402200 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e02da-b139-4906-bbe4-f9e3dd00dcea None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.402478 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5e02da-b139-4906-bbe4-f9e3dd00dcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.424189 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9d5e02da-b139-4906-bbe4-f9e3dd00dcea None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:15.425822 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9d5e02da-b139-4906-bbe4-f9e3dd00dcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:15.484317 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:15.490753 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dffc0f-5fc9-49e6-b9b8-a40afbbdef9a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:15.499690 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 433/844] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:15.521899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e02da-b139-4906-bbe4-f9e3dd00dcea None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:15.533271 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc1d9e-8eb7-478a-af86-9bc3435f8c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:15.534341 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc1d9e-8eb7-478a-af86-9bc3435f8c3a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.534690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc1d9e-8eb7-478a-af86-9bc3435f8c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.535053 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fc1d9e-8eb7-478a-af86-9bc3435f8c3a None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.535992 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc1d9e-8eb7-478a-af86-9bc3435f8c3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:15.536306 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc1d9e-8eb7-478a-af86-9bc3435f8c3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:15.537890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fc1d9e-8eb7-478a-af86-9bc3435f8c3a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:15.551167 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 412/845] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:15.556924 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc1d9e-8eb7-478a-af86-9bc3435f8c3a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:15.589048 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:15.633108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5e02da-b139-4906-bbe4-f9e3dd00dcea None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:15.668034 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fc1d9e-8eb7-478a-af86-9bc3435f8c3a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:15.671268 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad6c64-cba1-448f-8b70-545e5c99315d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:15.672226 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad6c64-cba1-448f-8b70-545e5c99315d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.672578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad6c64-cba1-448f-8b70-545e5c99315d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.672927 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad6c64-cba1-448f-8b70-545e5c99315d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.673663 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad6c64-cba1-448f-8b70-545e5c99315d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:15.675158 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad6c64-cba1-448f-8b70-545e5c99315d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-66ad6c64-cba1-448f-8b70-545e5c99315d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:15.688722 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:15.689681 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:15.690543 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 434/846] 10.222.0.42 () {56 vars in 1132 bytes} [Sun Jul 24 00:59:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:15.696191 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad6c64-cba1-448f-8b70-545e5c99315d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:15.708115 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf91f7f-2c57-498f-97d6-3689e1f88e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:15.708930 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf91f7f-2c57-498f-97d6-3689e1f88e48 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.709232 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf91f7f-2c57-498f-97d6-3689e1f88e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.709585 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf91f7f-2c57-498f-97d6-3689e1f88e48 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.717565 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf91f7f-2c57-498f-97d6-3689e1f88e48 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:15.719036 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf91f7f-2c57-498f-97d6-3689e1f88e48 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-cdf91f7f-2c57-498f-97d6-3689e1f88e48 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:59:15.735517 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:15.737378 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:15.738542 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:15.738542 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:15.738542 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:59:15.738542 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:59:15.738542 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:59:15.738542 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:59:15.738542 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:59:15.738542 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:59:15.738542 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 24 00:59:15.738542 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:15.738542 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 413/847] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:59:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:15.744939 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf91f7f-2c57-498f-97d6-3689e1f88e48 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:15.762398 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:15.805469 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad6c64-cba1-448f-8b70-545e5c99315d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:15.834439 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:15.847063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c279372-fe46-4bea-bdb6-0c66c4571449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:15.847785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c279372-fe46-4bea-bdb6-0c66c4571449 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.848083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c279372-fe46-4bea-bdb6-0c66c4571449 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.848366 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c279372-fe46-4bea-bdb6-0c66c4571449 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.849082 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c279372-fe46-4bea-bdb6-0c66c4571449 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:15.849396 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c279372-fe46-4bea-bdb6-0c66c4571449 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:15.850796 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c279372-fe46-4bea-bdb6-0c66c4571449 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:15.855744 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 435/848] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Jul 24 00:59:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:15.870110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf91f7f-2c57-498f-97d6-3689e1f88e48 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:15.872216 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c279372-fe46-4bea-bdb6-0c66c4571449 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:15.905229 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce74be5-a63c-4702-a3fc-48ce65c65977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:15.905987 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce74be5-a63c-4702-a3fc-48ce65c65977 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:15.906377 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce74be5-a63c-4702-a3fc-48ce65c65977 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:15.906751 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce74be5-a63c-4702-a3fc-48ce65c65977 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:15.907680 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce74be5-a63c-4702-a3fc-48ce65c65977 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:15.908054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce74be5-a63c-4702-a3fc-48ce65c65977 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:15.909595 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce74be5-a63c-4702-a3fc-48ce65c65977 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:15.932590 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 414/849] 10.222.0.42 () {56 vars in 1135 bytes} [Sun Jul 24 00:59:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:15.933565 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce74be5-a63c-4702-a3fc-48ce65c65977 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:15.998636 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c279372-fe46-4bea-bdb6-0c66c4571449 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:16.018967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:16.039287 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572e666-8ff6-458f-8023-b16d429d3eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:16.040103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572e666-8ff6-458f-8023-b16d429d3eb3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:16.040452 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572e666-8ff6-458f-8023-b16d429d3eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:16.040797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c572e666-8ff6-458f-8023-b16d429d3eb3 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:16.046066 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572e666-8ff6-458f-8023-b16d429d3eb3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:16.046482 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572e666-8ff6-458f-8023-b16d429d3eb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:16.048140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c572e666-8ff6-458f-8023-b16d429d3eb3 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:16.051048 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce74be5-a63c-4702-a3fc-48ce65c65977 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:16.059999 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 436/850] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Jul 24 00:59:15 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:16.093181 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289517d-5dac-4497-be78-f4dd6d6ecd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:16.094196 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289517d-5dac-4497-be78-f4dd6d6ecd38 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:16.094662 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289517d-5dac-4497-be78-f4dd6d6ecd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:16.095373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289517d-5dac-4497-be78-f4dd6d6ecd38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:16.180382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289517d-5dac-4497-be78-f4dd6d6ecd38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:16.181882 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289517d-5dac-4497-be78-f4dd6d6ecd38 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:16.262132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:16.287526 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 415/851] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:59:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:59:16.293134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572e666-8ff6-458f-8023-b16d429d3eb3 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:16.345274 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:16.406311 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c572e666-8ff6-458f-8023-b16d429d3eb3 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:16.434215 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fa855-2554-4de8-9c69-928ef270d29f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:16.434538 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fa855-2554-4de8-9c69-928ef270d29f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:16.434770 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fa855-2554-4de8-9c69-928ef270d29f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:16.437459 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 416/852] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:16.441532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d043c-bddc-4cd3-a92a-93ed8e6d0a02 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:16.441819 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d043c-bddc-4cd3-a92a-93ed8e6d0a02 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:16.442096 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44d043c-bddc-4cd3-a92a-93ed8e6d0a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:16.446370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755fed7-855b-4960-bd59-8ee1ce89603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:16.447504 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755fed7-855b-4960-bd59-8ee1ce89603e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:16.447964 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755fed7-855b-4960-bd59-8ee1ce89603e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:16.448385 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3755fed7-855b-4960-bd59-8ee1ce89603e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:16.459570 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d44d043c-bddc-4cd3-a92a-93ed8e6d0a02 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:16.459860 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755fed7-855b-4960-bd59-8ee1ce89603e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:16.461063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d44d043c-bddc-4cd3-a92a-93ed8e6d0a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:16.461717 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3755fed7-855b-4960-bd59-8ee1ce89603e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:16.481101 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-3755fed7-855b-4960-bd59-8ee1ce89603e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:16.481101 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:16.481101 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:16.481101 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:16.481101 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:16.481101 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:16.481101 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:16.481101 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:16.481101 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:16.481101 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:16.481101 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:16.481101 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:16.481101 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:16.481101 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:16.481101 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:16.482301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:16.483470 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:16.483470 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:16.483470 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:16.483470 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:16.485405 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 437/853] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:16.491610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755fed7-855b-4960-bd59-8ee1ce89603e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:16.547565 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 417/854] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:16.573231 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d043c-bddc-4cd3-a92a-93ed8e6d0a02 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:16.614266 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3755fed7-855b-4960-bd59-8ee1ce89603e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:16.616618 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:16.654364 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae86f8-86b1-4da7-af64-25c2dc6e814e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:16.655051 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae86f8-86b1-4da7-af64-25c2dc6e814e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:16.655374 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae86f8-86b1-4da7-af64-25c2dc6e814e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:16.655660 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae86f8-86b1-4da7-af64-25c2dc6e814e None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:16.656515 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae86f8-86b1-4da7-af64-25c2dc6e814e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:16.656826 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae86f8-86b1-4da7-af64-25c2dc6e814e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:16.658233 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae86f8-86b1-4da7-af64-25c2dc6e814e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:16.675223 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 438/855] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:16.675223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177893-b9db-43e5-a8fa-ca98ab16e18f None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:16.675223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177893-b9db-43e5-a8fa-ca98ab16e18f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:16.675223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b177893-b9db-43e5-a8fa-ca98ab16e18f None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:16.675223 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 439/856] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:16.676777 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177893-b9db-43e5-a8fa-ca98ab16e18f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:16.688398 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44d043c-bddc-4cd3-a92a-93ed8e6d0a02 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:16.691746 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:16.727635 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20648862-33fe-4afe-89b8-0474250a1032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:16.728311 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20648862-33fe-4afe-89b8-0474250a1032 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:16.728600 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20648862-33fe-4afe-89b8-0474250a1032 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:16.728878 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20648862-33fe-4afe-89b8-0474250a1032 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:16.729622 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20648862-33fe-4afe-89b8-0474250a1032 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:16.731027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20648862-33fe-4afe-89b8-0474250a1032 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:16.745994 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 418/857] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Jul 24 00:59:16 2022] POST /identity/v3/services => generated 251 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:59:16.747447 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18332e3d-9ea8-48c5-b414-ed9c87f14f39 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:16.747762 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18332e3d-9ea8-48c5-b414-ed9c87f14f39 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:16.748045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18332e3d-9ea8-48c5-b414-ed9c87f14f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:16.805828 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b177893-b9db-43e5-a8fa-ca98ab16e18f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:16.849644 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c9ea1-c944-45d7-a1ba-e7ef9ab4cfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:16.850532 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c9ea1-c944-45d7-a1ba-e7ef9ab4cfa4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:16.850822 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c9ea1-c944-45d7-a1ba-e7ef9ab4cfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:16.851103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c9ea1-c944-45d7-a1ba-e7ef9ab4cfa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:16.859699 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c9ea1-c944-45d7-a1ba-e7ef9ab4cfa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:16.861226 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546c9ea1-c944-45d7-a1ba-e7ef9ab4cfa4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:16.876942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-546c9ea1-c944-45d7-a1ba-e7ef9ab4cfa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:16.876942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:16.876942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:16.876942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:16.876942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:16.876942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:16.876942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:16.876942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:16.876942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:16.876942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:16.876942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:16.876942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:16.876942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:16.876942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:16.876942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:16.877923 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:16.884566 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:16.884566 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:16.884566 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:16.884566 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:16.884566 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:16.884566 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:16.884566 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:16.884566 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:16.884566 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 440/858] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:16.885069 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c9ea1-c944-45d7-a1ba-e7ef9ab4cfa4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:16.906984 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:16.918703 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-18332e3d-9ea8-48c5-b414-ed9c87f14f39 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:16.920105 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-18332e3d-9ea8-48c5-b414-ed9c87f14f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:17.005568 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 419/859] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:16 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:17.006363 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546c9ea1-c944-45d7-a1ba-e7ef9ab4cfa4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:17.029132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18332e3d-9ea8-48c5-b414-ed9c87f14f39 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:17.049171 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfd26b-4065-4758-8c99-57e4b73b87c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:17.050113 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfd26b-4065-4758-8c99-57e4b73b87c8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:17.050408 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfd26b-4065-4758-8c99-57e4b73b87c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:17.050692 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfd26b-4065-4758-8c99-57e4b73b87c8 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:17.052147 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfd26b-4065-4758-8c99-57e4b73b87c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:17.052477 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfd26b-4065-4758-8c99-57e4b73b87c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:17.053937 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfd26b-4065-4758-8c99-57e4b73b87c8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:17.071155 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 441/860] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:17.079195 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfd26b-4065-4758-8c99-57e4b73b87c8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:17.143569 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:17.153040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18332e3d-9ea8-48c5-b414-ed9c87f14f39 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:17.178809 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:17.201124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10896cb-fb92-44f5-9468-15b3e6d10b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:17.202179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10896cb-fb92-44f5-9468-15b3e6d10b1f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:17.202841 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10896cb-fb92-44f5-9468-15b3e6d10b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:17.203119 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10896cb-fb92-44f5-9468-15b3e6d10b1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:17.205338 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfd26b-4065-4758-8c99-57e4b73b87c8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:17.218074 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10896cb-fb92-44f5-9468-15b3e6d10b1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a10896cb-fb92-44f5-9468-15b3e6d10b1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:17.227888 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:17.228883 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:17.229746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:17.229746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:17.229746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:17.229746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:17.229746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:17.229746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:17.229746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:17.229746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:17.229746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:17.229746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:17.229746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 00:59:17.229746 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:17.230395 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 420/861] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 00:59:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:17.236325 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10896cb-fb92-44f5-9468-15b3e6d10b1f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:17.247281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0128e13-f76c-4f4d-8a42-77303aa984dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:17.248004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0128e13-f76c-4f4d-8a42-77303aa984dc None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:17.248343 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0128e13-f76c-4f4d-8a42-77303aa984dc None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:17.248625 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0128e13-f76c-4f4d-8a42-77303aa984dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:17.249597 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0128e13-f76c-4f4d-8a42-77303aa984dc None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=dea37db9b0f3432093e8fe89d5fcc687) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:17.249913 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0128e13-f76c-4f4d-8a42-77303aa984dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:17.251466 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0128e13-f76c-4f4d-8a42-77303aa984dc None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:17.259806 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 442/862] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:59:17 2022] GET /identity/v3/role_assignments?user.id=dea37db9b0f3432093e8fe89d5fcc687&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:17.356316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10896cb-fb92-44f5-9468-15b3e6d10b1f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:17.397115 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d99b3-b02f-4808-9a7d-8b3f4b2cd8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:17.397726 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d99b3-b02f-4808-9a7d-8b3f4b2cd8d3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:17.398006 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d99b3-b02f-4808-9a7d-8b3f4b2cd8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:17.398367 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d99b3-b02f-4808-9a7d-8b3f4b2cd8d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:17.399136 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d99b3-b02f-4808-9a7d-8b3f4b2cd8d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:17.399485 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d99b3-b02f-4808-9a7d-8b3f4b2cd8d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:17.400910 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d99b3-b02f-4808-9a7d-8b3f4b2cd8d3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:17.410543 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 421/863] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 00:59:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:17.416250 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0128e13-f76c-4f4d-8a42-77303aa984dc None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:17.523479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0128e13-f76c-4f4d-8a42-77303aa984dc None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:17.559009 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e467baf-091e-4a83-aac0-f0b9b9b862e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:17.560191 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e467baf-091e-4a83-aac0-f0b9b9b862e9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:17.560679 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e467baf-091e-4a83-aac0-f0b9b9b862e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:17.561170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e467baf-091e-4a83-aac0-f0b9b9b862e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:17.572850 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e467baf-091e-4a83-aac0-f0b9b9b862e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:17.574601 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e467baf-091e-4a83-aac0-f0b9b9b862e9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:17.576684 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:17.593910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-0e467baf-091e-4a83-aac0-f0b9b9b862e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:17.593910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:17.593910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:17.593910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:17.593910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:17.593910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:17.593910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:17.593910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:17.593910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:17.593910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:17.593910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:17.593910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:17.593910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:17.593910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:17.593910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:17.594995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:17.595941 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:17.595941 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:17.595941 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:17.595941 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:17.602496 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 443/864] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:17.604068 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d99b3-b02f-4808-9a7d-8b3f4b2cd8d3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:17.623963 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:17.716628 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d99b3-b02f-4808-9a7d-8b3f4b2cd8d3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:17.750012 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b45e2-812e-4b92-b56a-14cfcac890f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:17.750682 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b45e2-812e-4b92-b56a-14cfcac890f2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:17.750988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b45e2-812e-4b92-b56a-14cfcac890f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:17.751241 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b45e2-812e-4b92-b56a-14cfcac890f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:17.751993 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b45e2-812e-4b92-b56a-14cfcac890f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:17.752299 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b45e2-812e-4b92-b56a-14cfcac890f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:17.753675 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b45e2-812e-4b92-b56a-14cfcac890f2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:17.765889 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 422/865] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:17.771454 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e467baf-091e-4a83-aac0-f0b9b9b862e9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:17.875546 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e467baf-091e-4a83-aac0-f0b9b9b862e9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:17.910012 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b8547-7b3d-4033-80ae-b5e92cb19e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:17.911088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b8547-7b3d-4033-80ae-b5e92cb19e85 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:17.911548 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b8547-7b3d-4033-80ae-b5e92cb19e85 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:17.911968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b8547-7b3d-4033-80ae-b5e92cb19e85 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:17.919879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b8547-7b3d-4033-80ae-b5e92cb19e85 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:17.921478 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b8547-7b3d-4033-80ae-b5e92cb19e85 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-595b8547-7b3d-4033-80ae-b5e92cb19e85 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:59:17.936471 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:17.937676 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:17.938873 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:17.938873 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:17.938873 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:59:17.938873 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:59:17.938873 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:59:17.938873 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:59:17.938873 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:59:17.938873 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:59:17.938873 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:59:17.938873 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:17.946222 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 444/866] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Jul 24 00:59:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:17.947788 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b45e2-812e-4b92-b56a-14cfcac890f2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:18.032306 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:18.059593 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b45e2-812e-4b92-b56a-14cfcac890f2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:18.094737 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c417549-5456-45a2-945f-dfff578305a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:18.095448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c417549-5456-45a2-945f-dfff578305a4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:18.095730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c417549-5456-45a2-945f-dfff578305a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:18.096003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c417549-5456-45a2-945f-dfff578305a4 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:18.096839 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c417549-5456-45a2-945f-dfff578305a4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:18.097143 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c417549-5456-45a2-945f-dfff578305a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:18.098589 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c417549-5456-45a2-945f-dfff578305a4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:18.120577 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 423/867] 10.222.0.42 () {56 vars in 1149 bytes} [Sun Jul 24 00:59:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:18.126448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b8547-7b3d-4033-80ae-b5e92cb19e85 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:18.187614 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:18.189686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dee09b-620e-4523-817b-110d45004ba3 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:18.189987 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dee09b-620e-4523-817b-110d45004ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:18.190270 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dee09b-620e-4523-817b-110d45004ba3 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:18.191975 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 424/868] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:18.197571 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d047ece-7303-4320-931d-322a7512c71b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:18.197859 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d047ece-7303-4320-931d-322a7512c71b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:18.198138 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d047ece-7303-4320-931d-322a7512c71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:18.221487 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7d047ece-7303-4320-931d-322a7512c71b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:18.223083 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7d047ece-7303-4320-931d-322a7512c71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:18.238779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b8547-7b3d-4033-80ae-b5e92cb19e85 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:18.275133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1fe29-0563-4dea-96e6-3c1dc872fe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:18.275864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1fe29-0563-4dea-96e6-3c1dc872fe5e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:18.276257 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1fe29-0563-4dea-96e6-3c1dc872fe5e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:18.276592 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf1fe29-0563-4dea-96e6-3c1dc872fe5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:18.290017 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 425/869] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:18.317765 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d047ece-7303-4320-931d-322a7512c71b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:18.356408 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1fe29-0563-4dea-96e6-3c1dc872fe5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:18.358308 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf1fe29-0563-4dea-96e6-3c1dc872fe5e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:18.378109 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:18.416322 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d047ece-7303-4320-931d-322a7512c71b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:18.418597 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:18.450946 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f383d-1158-42d2-b3ac-5b38f71db0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:18.451796 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f383d-1158-42d2-b3ac-5b38f71db0f5 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:18.452114 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f383d-1158-42d2-b3ac-5b38f71db0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:18.452391 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f383d-1158-42d2-b3ac-5b38f71db0f5 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:18.453116 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f383d-1158-42d2-b3ac-5b38f71db0f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:18.454606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f383d-1158-42d2-b3ac-5b38f71db0f5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:18.475758 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 445/870] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:59:18 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:59:18.481702 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1fe29-0563-4dea-96e6-3c1dc872fe5e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:18.486538 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 426/871] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Jul 24 00:59:18 2022] POST /identity/v3/services => generated 269 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:59:18.604468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf1fe29-0563-4dea-96e6-3c1dc872fe5e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:18.648652 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c834543-b426-4d11-abcb-020d928f079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:18.649527 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c834543-b426-4d11-abcb-020d928f079d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:18.649821 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c834543-b426-4d11-abcb-020d928f079d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:18.650107 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c834543-b426-4d11-abcb-020d928f079d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:18.661109 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c834543-b426-4d11-abcb-020d928f079d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:18.662585 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c834543-b426-4d11-abcb-020d928f079d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:18.680776 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-3c834543-b426-4d11-abcb-020d928f079d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:18.680776 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:18.680776 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:18.680776 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:18.680776 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:18.680776 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:18.680776 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:18.680776 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:18.680776 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:18.680776 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:18.680776 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:18.680776 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:18.680776 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:18.680776 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:18.680776 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:18.681732 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:18.682623 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:18.682623 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:18.682623 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:18.682623 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:18.682623 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 446/872] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:18.687752 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f383d-1158-42d2-b3ac-5b38f71db0f5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:18.800555 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f383d-1158-42d2-b3ac-5b38f71db0f5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:18.829572 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:18.841799 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e6b7b-11c9-48f5-bb31-666825906f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:18.842481 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e6b7b-11c9-48f5-bb31-666825906f56 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:18.842926 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e6b7b-11c9-48f5-bb31-666825906f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:18.843200 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e6b7b-11c9-48f5-bb31-666825906f56 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:18.843959 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e6b7b-11c9-48f5-bb31-666825906f56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:18.844262 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e6b7b-11c9-48f5-bb31-666825906f56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:18.845641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e6b7b-11c9-48f5-bb31-666825906f56 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:18.859229 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 427/873] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:18.864699 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c834543-b426-4d11-abcb-020d928f079d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:18.867912 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:18.973849 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c834543-b426-4d11-abcb-020d928f079d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:18.982986 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb96e7-cffc-4df3-a576-b30d1416e6df None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:18.983277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb96e7-cffc-4df3-a576-b30d1416e6df None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:18.983592 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb96e7-cffc-4df3-a576-b30d1416e6df None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:18.985224 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 428/874] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:18.990159 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d179d1-0e80-4d79-a476-08fb6a1edcba None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:18.990451 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d179d1-0e80-4d79-a476-08fb6a1edcba None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:18.990729 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d179d1-0e80-4d79-a476-08fb6a1edcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:19.008572 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e1d179d1-0e80-4d79-a476-08fb6a1edcba None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:19.008893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca3bff-5995-4d2d-ae1c-bcc839ef7abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:19.009712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca3bff-5995-4d2d-ae1c-bcc839ef7abd None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:19.009821 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e1d179d1-0e80-4d79-a476-08fb6a1edcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:19.010001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca3bff-5995-4d2d-ae1c-bcc839ef7abd None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:19.010260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ca3bff-5995-4d2d-ae1c-bcc839ef7abd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:19.017446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca3bff-5995-4d2d-ae1c-bcc839ef7abd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:19.018954 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ca3bff-5995-4d2d-ae1c-bcc839ef7abd None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:19.033561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d1ca3bff-5995-4d2d-ae1c-bcc839ef7abd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:19.033561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:19.033561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:19.033561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:19.033561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:19.033561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:19.033561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:19.033561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:19.033561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:19.033561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:19.033561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:19.033561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:19.033561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:19.033561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:19.033561 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:19.035363 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:19.036830 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:19.036830 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:19.036830 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:19.036830 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:19.036830 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:19.036830 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:19.036830 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:19.036830 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:19.036830 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 447/875] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:19.040923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca3bff-5995-4d2d-ae1c-bcc839ef7abd None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:19.090382 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 429/876] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:18 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:19.110688 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:19.113643 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d179d1-0e80-4d79-a476-08fb6a1edcba None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:19.155571 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ca3bff-5995-4d2d-ae1c-bcc839ef7abd None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:19.199362 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d1148-50e2-4aff-90ad-62862e77f7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:19.201988 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d1148-50e2-4aff-90ad-62862e77f7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:19.202517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d1148-50e2-4aff-90ad-62862e77f7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:19.203009 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d1148-50e2-4aff-90ad-62862e77f7c7 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:19.204125 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d1148-50e2-4aff-90ad-62862e77f7c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:19.204661 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d1148-50e2-4aff-90ad-62862e77f7c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:19.206364 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d1148-50e2-4aff-90ad-62862e77f7c7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:19.219471 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 448/877] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:19.225701 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d1148-50e2-4aff-90ad-62862e77f7c7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:19.233189 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d179d1-0e80-4d79-a476-08fb6a1edcba None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:19.247658 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:19.274788 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd1368-77f5-4d05-8d40-07935ce6d97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:19.275641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd1368-77f5-4d05-8d40-07935ce6d97c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:19.275930 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd1368-77f5-4d05-8d40-07935ce6d97c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:19.276223 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd1368-77f5-4d05-8d40-07935ce6d97c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:19.276874 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd1368-77f5-4d05-8d40-07935ce6d97c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:19.278254 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd1368-77f5-4d05-8d40-07935ce6d97c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-abbd1368-77f5-4d05-8d40-07935ce6d97c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:19.290286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:19.291339 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:19.292208 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:19.292208 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:19.292208 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:19.292208 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:19.292208 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:19.292208 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:19.292208 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:19.292208 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:19.292208 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:19.292208 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:19.292208 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:19.292208 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:19.292208 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:59:19.292208 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:19.296562 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 430/878] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:59:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:19.297460 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd1368-77f5-4d05-8d40-07935ce6d97c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:19.363761 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d1148-50e2-4aff-90ad-62862e77f7c7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:19.393866 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:19.403255 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd1368-77f5-4d05-8d40-07935ce6d97c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:19.409111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834c7ff-614f-4f20-b104-293a5505391a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:19.410510 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834c7ff-614f-4f20-b104-293a5505391a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:19.410994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834c7ff-614f-4f20-b104-293a5505391a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:19.411489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834c7ff-614f-4f20-b104-293a5505391a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:19.412991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834c7ff-614f-4f20-b104-293a5505391a None admin] RBAC: Adding query filter params (role.id=566ec5e1e87245cea292823f58d150fd, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=87ce4ba479574d89990e23c157b2801b) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:19.413555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834c7ff-614f-4f20-b104-293a5505391a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:19.415885 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2834c7ff-614f-4f20-b104-293a5505391a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:19.431751 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 449/879] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:59:19 2022] GET /identity/v3/role_assignments?user.id=87ce4ba479574d89990e23c157b2801b&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=566ec5e1e87245cea292823f58d150fd => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:19.446792 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ba73aa-87bd-4344-a6b1-6042954228d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:19.447581 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba73aa-87bd-4344-a6b1-6042954228d9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:19.447863 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba73aa-87bd-4344-a6b1-6042954228d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:19.448139 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ba73aa-87bd-4344-a6b1-6042954228d9 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:19.448865 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba73aa-87bd-4344-a6b1-6042954228d9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:19.449238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba73aa-87bd-4344-a6b1-6042954228d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:19.450674 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ba73aa-87bd-4344-a6b1-6042954228d9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:19.456689 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 431/880] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:59:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:19.462717 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834c7ff-614f-4f20-b104-293a5505391a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:19.478289 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a067035-c87b-4074-8ad1-c1497b959c42 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:19.478608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a067035-c87b-4074-8ad1-c1497b959c42 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:19.478849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a067035-c87b-4074-8ad1-c1497b959c42 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:19.481793 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 432/881] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:19.486355 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fd61f-f1fd-4650-94ca-f8a0a9cb3cce None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:19.486644 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fd61f-f1fd-4650-94ca-f8a0a9cb3cce None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:19.486927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1fd61f-f1fd-4650-94ca-f8a0a9cb3cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:19.505435 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8a1fd61f-f1fd-4650-94ca-f8a0a9cb3cce None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:19.506881 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8a1fd61f-f1fd-4650-94ca-f8a0a9cb3cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:19.550423 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:19.581095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2834c7ff-614f-4f20-b104-293a5505391a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:19.599341 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 433/882] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:19.618226 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fd61f-f1fd-4650-94ca-f8a0a9cb3cce None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:19.626067 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f5d2-df80-428a-a60d-662322df19d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:19.627165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f5d2-df80-428a-a60d-662322df19d9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:19.627534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f5d2-df80-428a-a60d-662322df19d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:19.627820 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6f5d2-df80-428a-a60d-662322df19d9 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:19.628886 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6f5d2-df80-428a-a60d-662322df19d9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:19.629201 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6f5d2-df80-428a-a60d-662322df19d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:19.630916 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6f5d2-df80-428a-a60d-662322df19d9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:19.637132 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 450/883] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:59:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:19.642876 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f5d2-df80-428a-a60d-662322df19d9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:19.703965 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:19.748012 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1fd61f-f1fd-4650-94ca-f8a0a9cb3cce None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:19.764338 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6f5d2-df80-428a-a60d-662322df19d9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:19.790192 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998b98d-d7c8-4f6d-8628-c05f5ad587c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:19.791446 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998b98d-d7c8-4f6d-8628-c05f5ad587c6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:19.791741 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998b98d-d7c8-4f6d-8628-c05f5ad587c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:19.792022 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998b98d-d7c8-4f6d-8628-c05f5ad587c6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:19.792956 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998b98d-d7c8-4f6d-8628-c05f5ad587c6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:19.797182 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998b98d-d7c8-4f6d-8628-c05f5ad587c6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:19.808286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50909f41-884c-4a06-8919-4245880d156b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-2998b98d-d7c8-4f6d-8628-c05f5ad587c6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:19.811982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:19.812966 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:19.813821 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:19.813821 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:19.813821 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:19.813821 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:19.813821 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:19.813821 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:19.813821 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:19.813821 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:19.813821 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:19.813821 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:19.813821 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:19.813821 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:19.813821 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:59:19.813821 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:19.813821 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 434/884] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Jul 24 00:59:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:19.814617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50909f41-884c-4a06-8919-4245880d156b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:19.814617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50909f41-884c-4a06-8919-4245880d156b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:19.814617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50909f41-884c-4a06-8919-4245880d156b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:19.814617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50909f41-884c-4a06-8919-4245880d156b None admin] RBAC: Adding query filter params (interface=public, service_id=d164f2879407499aa1e7267546249a9f, region_id=RegionOne) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:19.814617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50909f41-884c-4a06-8919-4245880d156b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:19.814913 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50909f41-884c-4a06-8919-4245880d156b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:19.820619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998b98d-d7c8-4f6d-8628-c05f5ad587c6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:19.821316 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 451/885] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Jul 24 00:59:19 2022] GET /identity/v3/endpoints?service_id=d164f2879407499aa1e7267546249a9f&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:19.826229 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50909f41-884c-4a06-8919-4245880d156b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:19.863592 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:19.931479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998b98d-d7c8-4f6d-8628-c05f5ad587c6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:19.959200 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50909f41-884c-4a06-8919-4245880d156b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:19.970266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e048e-9c40-48d6-9ec9-440bc34b4d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:19.971255 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e048e-9c40-48d6-9ec9-440bc34b4d71 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:19.971768 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e048e-9c40-48d6-9ec9-440bc34b4d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:19.972330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e048e-9c40-48d6-9ec9-440bc34b4d71 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:19.973112 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:19.974548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e048e-9c40-48d6-9ec9-440bc34b4d71 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:19.975065 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e048e-9c40-48d6-9ec9-440bc34b4d71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:19.976848 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e048e-9c40-48d6-9ec9-440bc34b4d71 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:19.987880 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 435/886] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Jul 24 00:59:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:19.989176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e048e-9c40-48d6-9ec9-440bc34b4d71 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:19.993939 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e809c1-9f4a-421e-98df-7a05aa0876f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:19.994611 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e809c1-9f4a-421e-98df-7a05aa0876f0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:19.994894 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e809c1-9f4a-421e-98df-7a05aa0876f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:19.995165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e809c1-9f4a-421e-98df-7a05aa0876f0 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:19.995898 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e809c1-9f4a-421e-98df-7a05aa0876f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:19.997264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e809c1-9f4a-421e-98df-7a05aa0876f0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:20.011324 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 452/887] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Jul 24 00:59:19 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 00:59:20.105716 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:20.109548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e048e-9c40-48d6-9ec9-440bc34b4d71 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:20.146177 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3167e-d757-40d8-be9b-e67623706c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:20.146872 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3167e-d757-40d8-be9b-e67623706c85 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:20.147159 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3167e-d757-40d8-be9b-e67623706c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:20.147476 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3167e-d757-40d8-be9b-e67623706c85 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:20.148280 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3167e-d757-40d8-be9b-e67623706c85 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:20.148594 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3167e-d757-40d8-be9b-e67623706c85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:20.150019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3167e-d757-40d8-be9b-e67623706c85 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:20.155780 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 436/888] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Jul 24 00:59:19 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:20.664739 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed81499-3f73-461a-b88d-fefc3c02f285 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:20.665272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed81499-3f73-461a-b88d-fefc3c02f285 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:20.665272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed81499-3f73-461a-b88d-fefc3c02f285 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:20.667104 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 453/889] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:20.672181 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab5652-097f-4ed0-bb34-cdb09622cc2a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:20.672709 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab5652-097f-4ed0-bb34-cdb09622cc2a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:20.673176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab5652-097f-4ed0-bb34-cdb09622cc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:20.690108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3fab5652-097f-4ed0-bb34-cdb09622cc2a None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:20.691649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3fab5652-097f-4ed0-bb34-cdb09622cc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:20.765600 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 437/890] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:20.787602 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed81499-3f73-461a-b88d-fefc3c02f285 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:20.903800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed81499-3f73-461a-b88d-fefc3c02f285 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:20.937655 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69681600-a154-4c77-85fc-d223fc1a94f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:20.938772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69681600-a154-4c77-85fc-d223fc1a94f8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:20.939247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69681600-a154-4c77-85fc-d223fc1a94f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:20.939737 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69681600-a154-4c77-85fc-d223fc1a94f8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:20.940630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69681600-a154-4c77-85fc-d223fc1a94f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:20.942615 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69681600-a154-4c77-85fc-d223fc1a94f8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-69681600-a154-4c77-85fc-d223fc1a94f8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:20.954995 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:20.955958 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:20.956816 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:20.956816 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:20.956816 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:20.956816 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:20.956816 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:20.956816 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:20.956816 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:20.956816 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:20.956816 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:20.956816 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:20.956816 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:20.956816 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:20.956816 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:20.956816 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:59:20.956816 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:20.959769 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 454/891] 10.222.0.42 () {56 vars in 1132 bytes} [Sun Jul 24 00:59:20 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:20.967386 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab5652-097f-4ed0-bb34-cdb09622cc2a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:21.060951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:21.067991 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab5652-097f-4ed0-bb34-cdb09622cc2a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:21.101994 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343703c-dd04-4b93-85c9-642e205dbc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:21.102708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343703c-dd04-4b93-85c9-642e205dbc25 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:21.102991 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343703c-dd04-4b93-85c9-642e205dbc25 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:21.103268 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343703c-dd04-4b93-85c9-642e205dbc25 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:21.104002 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343703c-dd04-4b93-85c9-642e205dbc25 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:21.104311 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343703c-dd04-4b93-85c9-642e205dbc25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:21.105704 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d343703c-dd04-4b93-85c9-642e205dbc25 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:21.110772 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 438/892] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Jul 24 00:59:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:21.116260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69681600-a154-4c77-85fc-d223fc1a94f8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:21.158588 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:21.221923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69681600-a154-4c77-85fc-d223fc1a94f8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:21.256008 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d93ab5-9311-43ae-8115-44a48eb97808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:21.257003 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d93ab5-9311-43ae-8115-44a48eb97808 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:21.257591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d93ab5-9311-43ae-8115-44a48eb97808 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:21.258007 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d93ab5-9311-43ae-8115-44a48eb97808 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:21.258945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d93ab5-9311-43ae-8115-44a48eb97808 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:21.259421 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d93ab5-9311-43ae-8115-44a48eb97808 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:21.261001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d93ab5-9311-43ae-8115-44a48eb97808 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:21.266607 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 455/893] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Jul 24 00:59:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:21.275325 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343703c-dd04-4b93-85c9-642e205dbc25 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:21.378259 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343703c-dd04-4b93-85c9-642e205dbc25 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:21.413191 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179016cd-7913-417a-99d9-87dbaee1a786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:21.414007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179016cd-7913-417a-99d9-87dbaee1a786 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:21.414291 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179016cd-7913-417a-99d9-87dbaee1a786 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:21.414566 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179016cd-7913-417a-99d9-87dbaee1a786 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:21.415383 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179016cd-7913-417a-99d9-87dbaee1a786 None admin] RBAC: Adding query filter params (interface=public, service_id=2fe874881d02496db181e7b2229068ae, region_id=RegionOne) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:21.415699 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179016cd-7913-417a-99d9-87dbaee1a786 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:21.417091 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179016cd-7913-417a-99d9-87dbaee1a786 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:21.422907 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 439/894] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Jul 24 00:59:21 2022] GET /identity/v3/endpoints?service_id=2fe874881d02496db181e7b2229068ae&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:21.428521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d93ab5-9311-43ae-8115-44a48eb97808 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:21.531841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d93ab5-9311-43ae-8115-44a48eb97808 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:21.538957 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:21.566632 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995c5ece-08f7-47b9-a794-b5150c6165b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:21.567738 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c5ece-08f7-47b9-a794-b5150c6165b8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:21.568022 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c5ece-08f7-47b9-a794-b5150c6165b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:21.568295 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995c5ece-08f7-47b9-a794-b5150c6165b8 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:21.568970 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c5ece-08f7-47b9-a794-b5150c6165b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:21.570388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995c5ece-08f7-47b9-a794-b5150c6165b8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:21.576415 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 456/895] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Jul 24 00:59:21 2022] GET /identity/v3/services => generated 1268 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 00:59:21.723567 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3d7ff-17cf-48b8-991a-276abd8a2484 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:21.723954 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3d7ff-17cf-48b8-991a-276abd8a2484 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:21.724309 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3d7ff-17cf-48b8-991a-276abd8a2484 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:21.725998 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 440/896] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:21.731623 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ef74f-d484-457a-b568-356c751db704 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:21.732081 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ef74f-d484-457a-b568-356c751db704 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:21.732173 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ef74f-d484-457a-b568-356c751db704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:21.749491 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c42ef74f-d484-457a-b568-356c751db704 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:21.751008 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c42ef74f-d484-457a-b568-356c751db704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:21.831032 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 457/897] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:21 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:21.853755 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3d7ff-17cf-48b8-991a-276abd8a2484 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:21.879345 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:21.958234 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3d7ff-17cf-48b8-991a-276abd8a2484 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:21.992769 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece2fc6a-2b4e-47f5-b927-1e302cdfa921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:21.993654 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2fc6a-2b4e-47f5-b927-1e302cdfa921 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:21.993936 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2fc6a-2b4e-47f5-b927-1e302cdfa921 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:21.994258 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece2fc6a-2b4e-47f5-b927-1e302cdfa921 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:22.004655 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece2fc6a-2b4e-47f5-b927-1e302cdfa921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ece2fc6a-2b4e-47f5-b927-1e302cdfa921 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:22.013088 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:22.014060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:22.014922 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:22.014922 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:22.014922 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:22.014922 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:22.014922 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:22.014922 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:22.014922 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:22.014922 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:22.014922 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:22.014922 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:22.014922 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:59:22.014922 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:22.014922 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 441/898] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Jul 24 00:59:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:22.020576 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ef74f-d484-457a-b568-356c751db704 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:22.124938 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:22.128520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ef74f-d484-457a-b568-356c751db704 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:22.134983 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65884fa8-5199-406f-8cf1-e470aede7490 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:22.135275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65884fa8-5199-406f-8cf1-e470aede7490 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:22.135783 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65884fa8-5199-406f-8cf1-e470aede7490 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:22.137808 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 442/899] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:59:22.143193 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2910b2-34a3-4078-80c0-e8452b374aed None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:22.143525 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2910b2-34a3-4078-80c0-e8452b374aed None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:22.143807 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2910b2-34a3-4078-80c0-e8452b374aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:22.161415 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-fb2910b2-34a3-4078-80c0-e8452b374aed None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:22.162558 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fb2910b2-34a3-4078-80c0-e8452b374aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:22.164647 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e927d58-68ea-46c8-ac99-731bcb7ac6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:22.165386 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e927d58-68ea-46c8-ac99-731bcb7ac6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:22.165677 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e927d58-68ea-46c8-ac99-731bcb7ac6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:22.165952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e927d58-68ea-46c8-ac99-731bcb7ac6a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:22.166714 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e927d58-68ea-46c8-ac99-731bcb7ac6a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:22.167073 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e927d58-68ea-46c8-ac99-731bcb7ac6a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:22.168546 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e927d58-68ea-46c8-ac99-731bcb7ac6a9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:22.177428 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 458/900] 10.222.0.42 () {56 vars in 1115 bytes} [Sun Jul 24 00:59:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:22.183222 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e927d58-68ea-46c8-ac99-731bcb7ac6a9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:22.247344 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 443/901] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:22.270310 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2910b2-34a3-4078-80c0-e8452b374aed None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:22.285817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:22.303815 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e927d58-68ea-46c8-ac99-731bcb7ac6a9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:22.339635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83439240-3fd0-45e5-b55d-92b43400abb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:22.340440 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83439240-3fd0-45e5-b55d-92b43400abb8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:22.340724 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83439240-3fd0-45e5-b55d-92b43400abb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:22.340994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83439240-3fd0-45e5-b55d-92b43400abb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:22.357394 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83439240-3fd0-45e5-b55d-92b43400abb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:22.358866 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83439240-3fd0-45e5-b55d-92b43400abb8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:22.378957 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-83439240-3fd0-45e5-b55d-92b43400abb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:22.378957 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:22.378957 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:22.378957 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:22.378957 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:22.378957 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:22.378957 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:22.378957 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:22.378957 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:22.378957 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:22.378957 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:22.378957 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:22.378957 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:22.378957 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:22.378957 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:22.379996 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:22.385950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:22.385950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:22.385950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:22.385950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:22.385950 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 459/902] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:22.385950 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bff4bd-7a72-4f32-9604-4ec851dc5355 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:22.385950 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bff4bd-7a72-4f32-9604-4ec851dc5355 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:22.385950 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bff4bd-7a72-4f32-9604-4ec851dc5355 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:22.385950 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 460/903] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:22.388533 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bff4bd-7a72-4f32-9604-4ec851dc5355 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:22.390234 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2910b2-34a3-4078-80c0-e8452b374aed None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:22.407641 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:22.429145 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f420c6-08ff-4dd5-abe9-bc90ad30608a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:22.430133 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f420c6-08ff-4dd5-abe9-bc90ad30608a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:22.430545 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f420c6-08ff-4dd5-abe9-bc90ad30608a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:22.430823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f420c6-08ff-4dd5-abe9-bc90ad30608a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:22.431510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f420c6-08ff-4dd5-abe9-bc90ad30608a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:22.432917 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f420c6-08ff-4dd5-abe9-bc90ad30608a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-46f420c6-08ff-4dd5-abe9-bc90ad30608a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:22.445172 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:22.446159 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:22.447008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:22.447008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:22.447008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:22.447008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:22.447008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:22.447008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:22.447008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:22.447008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:22.447008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:22.447008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:22.447008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:22.447008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:22.447008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 24 00:59:22.447008 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:22.451488 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 444/904] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:59:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:22.453233 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6d91e-59d3-4904-8d23-75dbf29cb960 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:22.453675 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6d91e-59d3-4904-8d23-75dbf29cb960 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:22.453962 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6d91e-59d3-4904-8d23-75dbf29cb960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:22.474503 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-37d6d91e-59d3-4904-8d23-75dbf29cb960 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:22.476037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-37d6d91e-59d3-4904-8d23-75dbf29cb960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:22.497584 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bff4bd-7a72-4f32-9604-4ec851dc5355 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:22.532807 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe46a27-60df-4db5-aeba-6dd32dfe26c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:22.533740 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe46a27-60df-4db5-aeba-6dd32dfe26c2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:22.534025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe46a27-60df-4db5-aeba-6dd32dfe26c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:22.534305 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe46a27-60df-4db5-aeba-6dd32dfe26c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:22.535032 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe46a27-60df-4db5-aeba-6dd32dfe26c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:22.535377 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe46a27-60df-4db5-aeba-6dd32dfe26c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:22.536759 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe46a27-60df-4db5-aeba-6dd32dfe26c2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:22.547987 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 461/905] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:22.548983 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe46a27-60df-4db5-aeba-6dd32dfe26c2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:22.559571 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 445/906] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:22 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:22.560456 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6d91e-59d3-4904-8d23-75dbf29cb960 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:22.570025 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:22.634889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:22.661049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe46a27-60df-4db5-aeba-6dd32dfe26c2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:22.662502 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6d91e-59d3-4904-8d23-75dbf29cb960 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:22.696926 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2715137-5bda-4034-a079-ba82ec17fc58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:22.697137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a986c-2658-4d46-9f11-bc46c47792aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:22.697661 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a986c-2658-4d46-9f11-bc46c47792aa None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:22.697763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715137-5bda-4034-a079-ba82ec17fc58 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:22.697951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a986c-2658-4d46-9f11-bc46c47792aa None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:22.698047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715137-5bda-4034-a079-ba82ec17fc58 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:22.698206 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a986c-2658-4d46-9f11-bc46c47792aa None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:22.698296 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2715137-5bda-4034-a079-ba82ec17fc58 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:22.698906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a986c-2658-4d46-9f11-bc46c47792aa None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:22.699215 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a986c-2658-4d46-9f11-bc46c47792aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:22.700621 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a986c-2658-4d46-9f11-bc46c47792aa None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:22.713145 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 462/907] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:59:22 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:22.713472 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2715137-5bda-4034-a079-ba82ec17fc58 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:22.713631 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a986c-2658-4d46-9f11-bc46c47792aa None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:22.713776 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2715137-5bda-4034-a079-ba82ec17fc58 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-b2715137-5bda-4034-a079-ba82ec17fc58 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:59:22.730182 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:22.731373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:22.732348 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:22.732348 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:22.732348 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:59:22.732348 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:59:22.732348 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:59:22.732348 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:59:22.732348 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:59:22.732348 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:59:22.732348 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:59:22.732348 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:22.732348 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 446/908] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Jul 24 00:59:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:22.732950 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2715137-5bda-4034-a079-ba82ec17fc58 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:22.818378 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:22.832141 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a986c-2658-4d46-9f11-bc46c47792aa None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:22.852959 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2715137-5bda-4034-a079-ba82ec17fc58 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:22.869993 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4265f-98a5-4a3d-aebb-bb93749e27e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:22.870936 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4265f-98a5-4a3d-aebb-bb93749e27e9 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:22.871413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4265f-98a5-4a3d-aebb-bb93749e27e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:22.871834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4265f-98a5-4a3d-aebb-bb93749e27e9 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:22.872827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4265f-98a5-4a3d-aebb-bb93749e27e9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:22.874353 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4265f-98a5-4a3d-aebb-bb93749e27e9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:22.885471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:22.886993 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e21ec-b74c-428f-b61d-b60411533483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:22.887959 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e21ec-b74c-428f-b61d-b60411533483 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:22.888067 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e21ec-b74c-428f-b61d-b60411533483 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:22.888353 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e21ec-b74c-428f-b61d-b60411533483 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:22.889155 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e21ec-b74c-428f-b61d-b60411533483 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:22.889372 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e21ec-b74c-428f-b61d-b60411533483 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:22.890811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862e21ec-b74c-428f-b61d-b60411533483 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:22.899349 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 447/909] 10.222.0.42 () {56 vars in 1114 bytes} [Sun Jul 24 00:59:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:22.899349 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e21ec-b74c-428f-b61d-b60411533483 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:22.901109 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 463/910] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Jul 24 00:59:22 2022] POST /identity/v3/services => generated 241 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:59:22.902095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4265f-98a5-4a3d-aebb-bb93749e27e9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:23.027826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e21ec-b74c-428f-b61d-b60411533483 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:23.041119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4265f-98a5-4a3d-aebb-bb93749e27e9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:23.065359 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:23.084089 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845777b-178f-4a37-b42a-cae16e1dff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:23.084788 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845777b-178f-4a37-b42a-cae16e1dff3b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:23.085097 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845777b-178f-4a37-b42a-cae16e1dff3b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:23.085347 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9845777b-178f-4a37-b42a-cae16e1dff3b None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:23.086275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845777b-178f-4a37-b42a-cae16e1dff3b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:23.086572 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845777b-178f-4a37-b42a-cae16e1dff3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:23.088108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9845777b-178f-4a37-b42a-cae16e1dff3b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:23.101936 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741ef2e-acba-4b67-9cec-c7eaab8fe4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:23.103044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741ef2e-acba-4b67-9cec-c7eaab8fe4fc None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:23.103564 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741ef2e-acba-4b67-9cec-c7eaab8fe4fc None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:23.104043 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741ef2e-acba-4b67-9cec-c7eaab8fe4fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:23.105422 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741ef2e-acba-4b67-9cec-c7eaab8fe4fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:23.108040 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741ef2e-acba-4b67-9cec-c7eaab8fe4fc None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:23.111902 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 448/911] 10.222.0.42 () {56 vars in 1149 bytes} [Sun Jul 24 00:59:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:23.117914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845777b-178f-4a37-b42a-cae16e1dff3b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:23.140744 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 464/912] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Jul 24 00:59:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:59:23.253217 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9845777b-178f-4a37-b42a-cae16e1dff3b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:23.297480 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315239f2-4865-44cc-9df0-dbcb8aeeabb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:23.298160 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315239f2-4865-44cc-9df0-dbcb8aeeabb3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:23.298500 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315239f2-4865-44cc-9df0-dbcb8aeeabb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:23.298779 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315239f2-4865-44cc-9df0-dbcb8aeeabb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:23.356027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:23.373864 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315239f2-4865-44cc-9df0-dbcb8aeeabb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:23.375448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315239f2-4865-44cc-9df0-dbcb8aeeabb3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:23.478304 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 449/913] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:59:23 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:59:23.483826 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741ef2e-acba-4b67-9cec-c7eaab8fe4fc None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:23.536461 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:23.594537 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741ef2e-acba-4b67-9cec-c7eaab8fe4fc None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:23.628768 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4b4263-49ff-4ea2-9ada-1eb2866ae032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:23.629672 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b4263-49ff-4ea2-9ada-1eb2866ae032 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:23.630018 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b4263-49ff-4ea2-9ada-1eb2866ae032 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:23.630355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4b4263-49ff-4ea2-9ada-1eb2866ae032 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:23.641422 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b4263-49ff-4ea2-9ada-1eb2866ae032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:23.642969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4b4263-49ff-4ea2-9ada-1eb2866ae032 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:23.660517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-5d4b4263-49ff-4ea2-9ada-1eb2866ae032 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:23.660517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:23.660517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:23.660517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:23.660517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:23.660517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:23.660517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:23.660517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:23.660517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:23.660517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:23.660517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:23.660517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:23.660517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:23.660517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:23.660517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:23.661684 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:23.662805 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:23.662805 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:23.662805 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:23.662805 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:23.664121 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 465/914] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:23.672443 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315239f2-4865-44cc-9df0-dbcb8aeeabb3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:23.705208 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9b55c-4dcf-40d4-86d0-60e8e404578b None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:23.705615 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9b55c-4dcf-40d4-86d0-60e8e404578b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:23.705962 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9b55c-4dcf-40d4-86d0-60e8e404578b None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:23.707710 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 466/915] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:59:23.712772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692680ac-a9ba-4171-8e1b-d6bb1c8cfd72 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:23.713134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692680ac-a9ba-4171-8e1b-d6bb1c8cfd72 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:23.713519 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692680ac-a9ba-4171-8e1b-d6bb1c8cfd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:23.730588 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-692680ac-a9ba-4171-8e1b-d6bb1c8cfd72 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:23.731827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-692680ac-a9ba-4171-8e1b-d6bb1c8cfd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:23.768489 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:23.789443 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315239f2-4865-44cc-9df0-dbcb8aeeabb3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:23.807060 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 467/916] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:23.830261 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692680ac-a9ba-4171-8e1b-d6bb1c8cfd72 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:23.834501 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77538002-92c7-4e7e-864e-fcadf791b098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:23.835402 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538002-92c7-4e7e-864e-fcadf791b098 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:23.835925 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538002-92c7-4e7e-864e-fcadf791b098 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:23.836393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77538002-92c7-4e7e-864e-fcadf791b098 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:23.837395 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77538002-92c7-4e7e-864e-fcadf791b098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:23.837876 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77538002-92c7-4e7e-864e-fcadf791b098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:23.839474 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77538002-92c7-4e7e-864e-fcadf791b098 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:23.855327 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 450/917] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:23.859387 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77538002-92c7-4e7e-864e-fcadf791b098 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:23.872419 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:23.949246 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692680ac-a9ba-4171-8e1b-d6bb1c8cfd72 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:23.979203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77538002-92c7-4e7e-864e-fcadf791b098 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:23.984489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44f540-65bb-48e1-8512-b5ef5f46f4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:23.985260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44f540-65bb-48e1-8512-b5ef5f46f4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:23.985543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44f540-65bb-48e1-8512-b5ef5f46f4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:23.985819 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44f540-65bb-48e1-8512-b5ef5f46f4d0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:23.986574 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44f540-65bb-48e1-8512-b5ef5f46f4d0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:23.987985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44f540-65bb-48e1-8512-b5ef5f46f4d0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-9b44f540-65bb-48e1-8512-b5ef5f46f4d0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:24.001146 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:24.002078 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:24.002921 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 468/918] 10.222.0.42 () {56 vars in 1132 bytes} [Sun Jul 24 00:59:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:24.008335 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44f540-65bb-48e1-8512-b5ef5f46f4d0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:24.015621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a0cbf-fe72-44ad-90b9-55804fb62130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:24.018339 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a0cbf-fe72-44ad-90b9-55804fb62130 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:24.018627 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a0cbf-fe72-44ad-90b9-55804fb62130 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:24.018907 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a0cbf-fe72-44ad-90b9-55804fb62130 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:24.026533 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a0cbf-fe72-44ad-90b9-55804fb62130 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:24.028266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a0cbf-fe72-44ad-90b9-55804fb62130 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:24.043863 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a37a0cbf-fe72-44ad-90b9-55804fb62130 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:24.043863 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:24.043863 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:24.043863 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:24.043863 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:24.043863 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:24.043863 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:24.043863 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:24.043863 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:24.043863 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:24.043863 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:24.043863 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:24.043863 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:24.043863 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:24.043863 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:24.044768 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:24.045679 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:24.045679 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:24.045679 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:24.045679 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:24.045679 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:24.045679 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:24.045679 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:24.045679 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:24.045679 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 451/919] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:24.050679 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a0cbf-fe72-44ad-90b9-55804fb62130 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:24.056379 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:24.119887 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:24.126309 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44f540-65bb-48e1-8512-b5ef5f46f4d0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:24.164798 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef3201-8461-427a-b586-dbefe4d56189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:24.165485 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef3201-8461-427a-b586-dbefe4d56189 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:24.165769 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef3201-8461-427a-b586-dbefe4d56189 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:24.166042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef3201-8461-427a-b586-dbefe4d56189 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:24.166918 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef3201-8461-427a-b586-dbefe4d56189 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:24.167348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef3201-8461-427a-b586-dbefe4d56189 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:24.168731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef3201-8461-427a-b586-dbefe4d56189 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:24.174440 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 469/920] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Jul 24 00:59:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:24.176707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a0cbf-fe72-44ad-90b9-55804fb62130 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:24.180659 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef3201-8461-427a-b586-dbefe4d56189 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:24.218696 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c510d1-64a6-4d1c-8ab5-22517cc45912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:24.220024 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c510d1-64a6-4d1c-8ab5-22517cc45912 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:24.220325 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c510d1-64a6-4d1c-8ab5-22517cc45912 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:24.220607 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c510d1-64a6-4d1c-8ab5-22517cc45912 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:24.221403 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c510d1-64a6-4d1c-8ab5-22517cc45912 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:24.221719 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c510d1-64a6-4d1c-8ab5-22517cc45912 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:24.224235 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c510d1-64a6-4d1c-8ab5-22517cc45912 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:24.241157 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 452/921] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:24.248267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c510d1-64a6-4d1c-8ab5-22517cc45912 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:24.297554 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef3201-8461-427a-b586-dbefe4d56189 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:24.311791 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:24.336424 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8bab7-2b90-48d6-9688-0f90fb41c0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:24.337534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8bab7-2b90-48d6-9688-0f90fb41c0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:24.338044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8bab7-2b90-48d6-9688-0f90fb41c0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:24.338524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc8bab7-2b90-48d6-9688-0f90fb41c0a8 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:24.340231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8bab7-2b90-48d6-9688-0f90fb41c0a8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:24.341077 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8bab7-2b90-48d6-9688-0f90fb41c0a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:24.343545 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc8bab7-2b90-48d6-9688-0f90fb41c0a8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:24.351872 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 470/922] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Jul 24 00:59:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:24.352618 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c510d1-64a6-4d1c-8ab5-22517cc45912 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:24.356994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8bab7-2b90-48d6-9688-0f90fb41c0a8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:24.387586 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a4b77-a985-4ac4-8448-82eed1ac36e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:24.388286 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a4b77-a985-4ac4-8448-82eed1ac36e2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:24.388567 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a4b77-a985-4ac4-8448-82eed1ac36e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:24.388836 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a4b77-a985-4ac4-8448-82eed1ac36e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:24.389751 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a4b77-a985-4ac4-8448-82eed1ac36e2 None admin] RBAC: Adding query filter params (role.id=f979bbbf2c2245abab79b296097bda95, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=87ce4ba479574d89990e23c157b2801b) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:24.390012 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a4b77-a985-4ac4-8448-82eed1ac36e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:24.391505 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a4b77-a985-4ac4-8448-82eed1ac36e2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:24.402413 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 453/923] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:59:24 2022] GET /identity/v3/role_assignments?user.id=87ce4ba479574d89990e23c157b2801b&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=f979bbbf2c2245abab79b296097bda95 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:24.435772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:24.473707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc8bab7-2b90-48d6-9688-0f90fb41c0a8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:24.510653 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feff77d-267d-4c8e-b0bb-30956b5040b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:24.511254 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feff77d-267d-4c8e-b0bb-30956b5040b8 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:24.511578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feff77d-267d-4c8e-b0bb-30956b5040b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:24.511858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feff77d-267d-4c8e-b0bb-30956b5040b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:24.512628 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feff77d-267d-4c8e-b0bb-30956b5040b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:24.514040 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feff77d-267d-4c8e-b0bb-30956b5040b8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:24.541950 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 471/924] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Jul 24 00:59:24 2022] POST /identity/v3/endpoints => generated 347 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:59:25.094936 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08586d-c4a2-4398-a961-2659bc13964c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:25.095480 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08586d-c4a2-4398-a961-2659bc13964c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:25.095480 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af08586d-c4a2-4398-a961-2659bc13964c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:25.097112 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 454/925] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:25.102651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2457f-f3a1-42f4-a9ff-8f52c50496f4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:25.103048 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2457f-f3a1-42f4-a9ff-8f52c50496f4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:25.103231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2457f-f3a1-42f4-a9ff-8f52c50496f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:25.120350 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-cda2457f-f3a1-42f4-a9ff-8f52c50496f4 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:25.121545 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cda2457f-f3a1-42f4-a9ff-8f52c50496f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:25.199423 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 472/926] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:25.218192 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08586d-c4a2-4398-a961-2659bc13964c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:25.286549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd611-65bd-4c56-a009-8c4708f48d75 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:25.287207 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd611-65bd-4c56-a009-8c4708f48d75 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:25.287728 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebd611-65bd-4c56-a009-8c4708f48d75 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:25.289619 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 473/927] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:25.294739 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020af3ee-16fc-4768-914a-35acd2560cdc None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:25.295249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020af3ee-16fc-4768-914a-35acd2560cdc None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:25.295765 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020af3ee-16fc-4768-914a-35acd2560cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:25.307001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:25.315173 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-020af3ee-16fc-4768-914a-35acd2560cdc None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:25.316638 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-020af3ee-16fc-4768-914a-35acd2560cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:25.328382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af08586d-c4a2-4398-a961-2659bc13964c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:25.364264 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1f68f-cc26-4d5b-9fc0-81dba499b992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:25.365442 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1f68f-cc26-4d5b-9fc0-81dba499b992 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:25.365933 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1f68f-cc26-4d5b-9fc0-81dba499b992 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:25.366445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1f68f-cc26-4d5b-9fc0-81dba499b992 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:25.367485 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1f68f-cc26-4d5b-9fc0-81dba499b992 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:25.369167 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1f68f-cc26-4d5b-9fc0-81dba499b992 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-4ae1f68f-cc26-4d5b-9fc0-81dba499b992 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:25.382355 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:25.383414 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:25.384293 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:25.384293 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:25.384293 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:25.384293 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:25.384293 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:25.384293 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:25.384293 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:25.384293 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:25.384293 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:25.384293 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:25.384293 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:25.384293 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:25.384293 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:59:25.384293 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:25.387248 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 455/928] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Jul 24 00:59:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:25.387577 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:25.393432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1f68f-cc26-4d5b-9fc0-81dba499b992 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:25.407410 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 474/929] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:25.427961 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020af3ee-16fc-4768-914a-35acd2560cdc None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:25.515769 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1f68f-cc26-4d5b-9fc0-81dba499b992 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:25.541629 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020af3ee-16fc-4768-914a-35acd2560cdc None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:25.558441 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d5232-623b-4baa-8eee-06eeb29f4046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:25.559133 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d5232-623b-4baa-8eee-06eeb29f4046 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:25.559464 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d5232-623b-4baa-8eee-06eeb29f4046 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:25.559746 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d5232-623b-4baa-8eee-06eeb29f4046 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:25.560617 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d5232-623b-4baa-8eee-06eeb29f4046 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:25.560929 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d5232-623b-4baa-8eee-06eeb29f4046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:25.562621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d5232-623b-4baa-8eee-06eeb29f4046 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:25.569320 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 456/930] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Jul 24 00:59:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:25.574592 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d5232-623b-4baa-8eee-06eeb29f4046 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:25.585017 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45876701-ae4a-49d4-83ea-b9985c2d5509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:25.585787 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45876701-ae4a-49d4-83ea-b9985c2d5509 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:25.586070 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45876701-ae4a-49d4-83ea-b9985c2d5509 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:25.586711 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45876701-ae4a-49d4-83ea-b9985c2d5509 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:25.587202 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45876701-ae4a-49d4-83ea-b9985c2d5509 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:25.588719 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45876701-ae4a-49d4-83ea-b9985c2d5509 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:25.590251 dv-cinder-master-3-smb devstack@keystone.service[80519]: WARNING keystone.server.flask.common [None req-45876701-ae4a-49d4-83ea-b9985c2d5509 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 24 00:59:25.594709 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:25.610905 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.sql.core [None req-45876701-ae4a-49d4-83ea-b9985c2d5509 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 24 00:59:25.610905 dv-cinder-master-3-smb devstack@keystone.service[80519]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 24 00:59:25.610905 dv-cinder-master-3-smb devstack@keystone.service[80519]: [parameters: {'id': '18ea52c016504614ba8eebc25e56d353', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 24 00:59:25.610905 dv-cinder-master-3-smb devstack@keystone.service[80519]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80519) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 24 00:59:25.619843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-45876701-ae4a-49d4-83ea-b9985c2d5509 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 18ea52c016504614ba8eebc25e56d353.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 18ea52c016504614ba8eebc25e56d353. Jul 24 00:59:25.619843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:25.619843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:59:25.619843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:59:25.619843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:59:25.619843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:59:25.619843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:59:25.619843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:59:25.619843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:59:25.619843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:59:25.619843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:59:25.619843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:59:25.619843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application result.read() Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 24 00:59:25.620687 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application yield resource Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self.session.rollback() Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self.force_reraise() Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise self.value Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application session.commit() Jul 24 00:59:25.621631 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._prepare_impl() Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self.session.flush() Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._flush(objects) Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application compat.raise_( Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application flush_context.execute() Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 24 00:59:25.622553 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rec.execute(self) Jul 24 00:59:25.629205 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 24 00:59:25.629205 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 24 00:59:25.629205 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 24 00:59:25.629205 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 24 00:59:25.629205 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 24 00:59:25.629205 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 24 00:59:25.629205 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 24 00:59:25.629205 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 24 00:59:25.629205 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 24 00:59:25.629205 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 24 00:59:25.629205 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 24 00:59:25.629205 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 24 00:59:25.629205 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 24 00:59:25.629205 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 24 00:59:25.629205 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application result.read() Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:59:25.630020 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:59:25.630926 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:59:25.630926 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:59:25.630926 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:59:25.630926 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:59:25.630926 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:59:25.630926 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:59:25.630926 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 24 00:59:25.630926 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 24 00:59:25.630926 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [parameters: {'id': '18ea52c016504614ba8eebc25e56d353', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 24 00:59:25.630926 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 24 00:59:25.630926 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:25.630926 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:25.630926 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:25.630926 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:25.630926 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:25.632870 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:25.635100 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:25.635100 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 24 00:59:25.635100 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 24 00:59:25.635100 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:25.635100 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:25.635100 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 24 00:59:25.635100 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 24 00:59:25.635100 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 18ea52c016504614ba8eebc25e56d353. Jul 24 00:59:25.635100 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:25.635100 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 475/931] 10.222.0.42 () {60 vars in 1140 bytes} [Sun Jul 24 00:59:25 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:25.635100 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45876701-ae4a-49d4-83ea-b9985c2d5509 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:25.638614 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:25.694177 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d5232-623b-4baa-8eee-06eeb29f4046 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:25.733544 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfda07-27dc-4e97-acc3-6466bb475e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:25.734810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfda07-27dc-4e97-acc3-6466bb475e8e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:25.735550 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfda07-27dc-4e97-acc3-6466bb475e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:25.736044 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dfda07-27dc-4e97-acc3-6466bb475e8e None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:25.737521 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfda07-27dc-4e97-acc3-6466bb475e8e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:25.738004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfda07-27dc-4e97-acc3-6466bb475e8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:25.740494 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dfda07-27dc-4e97-acc3-6466bb475e8e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:25.742388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45876701-ae4a-49d4-83ea-b9985c2d5509 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:25.751888 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 457/932] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Jul 24 00:59:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:25.754719 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfda07-27dc-4e97-acc3-6466bb475e8e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:25.781716 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908ab98-8236-4924-b8fe-fa114a33aba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:25.782534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908ab98-8236-4924-b8fe-fa114a33aba1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:25.782816 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908ab98-8236-4924-b8fe-fa114a33aba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:25.783091 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f908ab98-8236-4924-b8fe-fa114a33aba1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:25.790517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908ab98-8236-4924-b8fe-fa114a33aba1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:25.792262 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f908ab98-8236-4924-b8fe-fa114a33aba1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:25.811336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-f908ab98-8236-4924-b8fe-fa114a33aba1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:25.811336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:25.811336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:25.811336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:25.811336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:25.811336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:25.811336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:25.811336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:25.811336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:25.811336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:25.811336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:25.811336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:25.811336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:25.811336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:25.811336 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:25.812283 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:25.813186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:25.813186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:25.813186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:25.813186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:25.813186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:25.813186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:25.813186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:25.813186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:25.819514 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 476/933] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:25.820768 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908ab98-8236-4924-b8fe-fa114a33aba1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:25.883381 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dfda07-27dc-4e97-acc3-6466bb475e8e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:25.891561 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:25.906663 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:25.922659 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3ca7e-d7ad-41f4-8494-36ff92febf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:25.923346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3ca7e-d7ad-41f4-8494-36ff92febf02 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:25.923633 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3ca7e-d7ad-41f4-8494-36ff92febf02 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:25.923909 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3ca7e-d7ad-41f4-8494-36ff92febf02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:25.924704 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3ca7e-d7ad-41f4-8494-36ff92febf02 None admin] RBAC: Adding query filter params (interface=public, service_id=a6bae55e30dd4010a698f86699dfc992, region_id=RegionOne) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:25.925015 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3ca7e-d7ad-41f4-8494-36ff92febf02 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:25.926514 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3ca7e-d7ad-41f4-8494-36ff92febf02 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:25.937039 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 458/934] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Jul 24 00:59:25 2022] GET /identity/v3/endpoints?service_id=a6bae55e30dd4010a698f86699dfc992&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:25.938027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3ca7e-d7ad-41f4-8494-36ff92febf02 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:25.966096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f908ab98-8236-4924-b8fe-fa114a33aba1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:26.000347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d89df-f60a-4193-8330-1066e5d167ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:26.001409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d89df-f60a-4193-8330-1066e5d167ff None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:26.001885 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d89df-f60a-4193-8330-1066e5d167ff None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:26.002347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d89df-f60a-4193-8330-1066e5d167ff None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:26.003288 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d89df-f60a-4193-8330-1066e5d167ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:26.003817 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d89df-f60a-4193-8330-1066e5d167ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:26.005463 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d89df-f60a-4193-8330-1066e5d167ff None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:26.031708 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 477/935] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Jul 24 00:59:25 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:26.046040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3ca7e-d7ad-41f4-8494-36ff92febf02 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:26.086208 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0780c73e-02fa-45e4-b5a6-2b69fe298c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:26.086914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780c73e-02fa-45e4-b5a6-2b69fe298c30 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:26.087197 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780c73e-02fa-45e4-b5a6-2b69fe298c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:26.087510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0780c73e-02fa-45e4-b5a6-2b69fe298c30 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:26.088212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780c73e-02fa-45e4-b5a6-2b69fe298c30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:26.089642 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0780c73e-02fa-45e4-b5a6-2b69fe298c30 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:26.097284 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 459/936] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Jul 24 00:59:25 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 00:59:26.427019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d224b-b9a4-4dfa-915a-08741b6cb212 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:26.427607 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d224b-b9a4-4dfa-915a-08741b6cb212 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:26.427607 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d224b-b9a4-4dfa-915a-08741b6cb212 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:26.429264 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 478/937] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:26.434475 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c5d52-978d-4871-bc8c-87ba56315910 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:26.434762 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c5d52-978d-4871-bc8c-87ba56315910 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:26.435040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c5d52-978d-4871-bc8c-87ba56315910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:26.452670 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ae8c5d52-978d-4871-bc8c-87ba56315910 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:26.453857 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ae8c5d52-978d-4871-bc8c-87ba56315910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:26.504951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:26.531107 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 460/938] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:26.553276 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d224b-b9a4-4dfa-915a-08741b6cb212 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:26.624900 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a721cb-b88a-4e16-91ea-eca9a3e0c778 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:26.624900 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a721cb-b88a-4e16-91ea-eca9a3e0c778 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:26.625282 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a721cb-b88a-4e16-91ea-eca9a3e0c778 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:26.627018 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 461/939] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:26.632205 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43640-e710-4b23-b3fe-7f478d48d943 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:26.632570 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43640-e710-4b23-b3fe-7f478d48d943 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:26.644445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a43640-e710-4b23-b3fe-7f478d48d943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:26.661847 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-24a43640-e710-4b23-b3fe-7f478d48d943 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:26.663085 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-24a43640-e710-4b23-b3fe-7f478d48d943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:26.666671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d224b-b9a4-4dfa-915a-08741b6cb212 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:26.681408 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:26.705636 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c8dc7-cdff-4317-a295-b1080977243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:26.706699 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8dc7-cdff-4317-a295-b1080977243f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:26.707130 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8dc7-cdff-4317-a295-b1080977243f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:26.707657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c8dc7-cdff-4317-a295-b1080977243f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:26.718664 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c8dc7-cdff-4317-a295-b1080977243f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-0a1c8dc7-cdff-4317-a295-b1080977243f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:26.727581 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:26.728768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:26.729879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:26.729879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:26.729879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:26.729879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:26.729879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:26.729879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:26.729879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:26.729879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:26.729879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:26.729879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:26.729879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:59:26.729879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:26.732520 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 479/940] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Jul 24 00:59:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:26.733109 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 462/941] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:26.740697 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c8dc7-cdff-4317-a295-b1080977243f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:26.755414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43640-e710-4b23-b3fe-7f478d48d943 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:26.859206 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c8dc7-cdff-4317-a295-b1080977243f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:26.889278 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a43640-e710-4b23-b3fe-7f478d48d943 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:26.897326 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ad01b-6c85-4efa-8f6f-efe573c28b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:26.898484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ad01b-6c85-4efa-8f6f-efe573c28b75 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:26.898769 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ad01b-6c85-4efa-8f6f-efe573c28b75 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:26.899047 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ad01b-6c85-4efa-8f6f-efe573c28b75 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:26.899341 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:26.899857 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ad01b-6c85-4efa-8f6f-efe573c28b75 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:26.900542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ad01b-6c85-4efa-8f6f-efe573c28b75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:26.902365 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ad01b-6c85-4efa-8f6f-efe573c28b75 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:26.916167 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 480/942] 10.222.0.42 () {56 vars in 1115 bytes} [Sun Jul 24 00:59:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:26.917195 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ad01b-6c85-4efa-8f6f-efe573c28b75 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:26.926942 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13c132-b3fb-4ab3-81d5-66cb6daafcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:26.927985 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13c132-b3fb-4ab3-81d5-66cb6daafcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:26.928403 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13c132-b3fb-4ab3-81d5-66cb6daafcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:26.928860 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13c132-b3fb-4ab3-81d5-66cb6daafcd4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:26.929803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13c132-b3fb-4ab3-81d5-66cb6daafcd4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:26.931554 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13c132-b3fb-4ab3-81d5-66cb6daafcd4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-db13c132-b3fb-4ab3-81d5-66cb6daafcd4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:26.947365 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:26.948439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:26.949318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:26.949318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:26.949318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:26.949318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:26.949318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:26.949318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:26.949318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:26.949318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:26.949318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:26.949318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:26.949318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:26.949318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:26.949318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:59:26.949318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:26.957053 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 463/943] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:26 2022] GET /identity/v3/services/compute => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:26.959276 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:26.960891 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13c132-b3fb-4ab3-81d5-66cb6daafcd4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:27.029283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ad01b-6c85-4efa-8f6f-efe573c28b75 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:27.063231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b25c76-dbb9-410a-a10e-69fdd0c21b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:27.064233 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b25c76-dbb9-410a-a10e-69fdd0c21b38 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:27.064355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b25c76-dbb9-410a-a10e-69fdd0c21b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:27.064617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b25c76-dbb9-410a-a10e-69fdd0c21b38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:27.075789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b25c76-dbb9-410a-a10e-69fdd0c21b38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:27.077250 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b25c76-dbb9-410a-a10e-69fdd0c21b38 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:27.086607 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13c132-b3fb-4ab3-81d5-66cb6daafcd4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:27.094838 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d0b25c76-dbb9-410a-a10e-69fdd0c21b38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:27.094838 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:27.094838 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:27.094838 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:27.094838 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:27.094838 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:27.094838 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:27.094838 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:27.094838 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:27.094838 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:27.094838 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:27.094838 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:27.094838 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:27.094838 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:27.094838 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:27.095887 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:27.096864 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:27.096864 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:27.096864 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:27.096864 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:27.101277 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 481/944] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:27.102125 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b25c76-dbb9-410a-a10e-69fdd0c21b38 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:27.130372 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dfc97-9a4d-4627-b470-ac2dd3c4ae0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:27.132395 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dfc97-9a4d-4627-b470-ac2dd3c4ae0b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:27.132887 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dfc97-9a4d-4627-b470-ac2dd3c4ae0b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:27.133499 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dfc97-9a4d-4627-b470-ac2dd3c4ae0b None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:27.134986 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dfc97-9a4d-4627-b470-ac2dd3c4ae0b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:27.135521 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dfc97-9a4d-4627-b470-ac2dd3c4ae0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:27.137249 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dfc97-9a4d-4627-b470-ac2dd3c4ae0b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:27.148834 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 464/945] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Jul 24 00:59:26 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:27.149337 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dfc97-9a4d-4627-b470-ac2dd3c4ae0b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:27.194934 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:27.209073 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:27.225700 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b25c76-dbb9-410a-a10e-69fdd0c21b38 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:27.264358 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c45257-f98d-4493-8d06-f12850b16133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:27.265451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c45257-f98d-4493-8d06-f12850b16133 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:27.265941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c45257-f98d-4493-8d06-f12850b16133 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:27.266518 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c45257-f98d-4493-8d06-f12850b16133 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:27.267471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c45257-f98d-4493-8d06-f12850b16133 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:27.267977 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c45257-f98d-4493-8d06-f12850b16133 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:27.269533 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dfc97-9a4d-4627-b470-ac2dd3c4ae0b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:27.269788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c45257-f98d-4493-8d06-f12850b16133 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:27.287721 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 482/946] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:27.289710 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c45257-f98d-4493-8d06-f12850b16133 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:27.308828 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a103e5-74e5-4b03-bf98-a26bc3d391e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:27.309509 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a103e5-74e5-4b03-bf98-a26bc3d391e4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:27.309854 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a103e5-74e5-4b03-bf98-a26bc3d391e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:27.310393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a103e5-74e5-4b03-bf98-a26bc3d391e4 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:27.311119 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a103e5-74e5-4b03-bf98-a26bc3d391e4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:27.311459 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a103e5-74e5-4b03-bf98-a26bc3d391e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:27.312962 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a103e5-74e5-4b03-bf98-a26bc3d391e4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:27.327582 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 465/947] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Jul 24 00:59:27 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:27.408386 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c45257-f98d-4493-8d06-f12850b16133 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:27.445510 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc20e7f-ac47-46dd-b9a3-00cfae3b6dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:27.446317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc20e7f-ac47-46dd-b9a3-00cfae3b6dad None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:27.446548 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc20e7f-ac47-46dd-b9a3-00cfae3b6dad None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:27.446826 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc20e7f-ac47-46dd-b9a3-00cfae3b6dad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:27.455349 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc20e7f-ac47-46dd-b9a3-00cfae3b6dad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:27.456900 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc20e7f-ac47-46dd-b9a3-00cfae3b6dad None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-bfc20e7f-ac47-46dd-b9a3-00cfae3b6dad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:59:27.472968 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:27.474047 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:27.475026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:27.475026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:27.475026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:59:27.475026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:59:27.475026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:59:27.475026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:59:27.475026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:59:27.475026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:59:27.475026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:59:27.475026 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:27.475026 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 483/948] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Jul 24 00:59:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:27.482462 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a103e5-74e5-4b03-bf98-a26bc3d391e4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:27.588578 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:27.591862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a103e5-74e5-4b03-bf98-a26bc3d391e4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:27.626269 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be01632-8586-4dcb-bb30-3b5e63dc20cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:27.626950 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be01632-8586-4dcb-bb30-3b5e63dc20cd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:27.627231 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be01632-8586-4dcb-bb30-3b5e63dc20cd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:27.627535 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be01632-8586-4dcb-bb30-3b5e63dc20cd None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:27.628420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be01632-8586-4dcb-bb30-3b5e63dc20cd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:27.628730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be01632-8586-4dcb-bb30-3b5e63dc20cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:27.630181 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be01632-8586-4dcb-bb30-3b5e63dc20cd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:27.648219 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 466/949] 10.222.0.42 () {56 vars in 1149 bytes} [Sun Jul 24 00:59:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:27.653831 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc20e7f-ac47-46dd-b9a3-00cfae3b6dad None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:27.663450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:27.755725 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc20e7f-ac47-46dd-b9a3-00cfae3b6dad None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:27.789261 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb67aca-9290-44f2-ad2a-6b593b8b5604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:27.790083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb67aca-9290-44f2-ad2a-6b593b8b5604 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:27.790361 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb67aca-9290-44f2-ad2a-6b593b8b5604 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:27.790624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb67aca-9290-44f2-ad2a-6b593b8b5604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:27.802082 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb67aca-9290-44f2-ad2a-6b593b8b5604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:27.803651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb67aca-9290-44f2-ad2a-6b593b8b5604 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:27.822340 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-9eb67aca-9290-44f2-ad2a-6b593b8b5604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:27.822340 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:27.822340 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:27.822340 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:27.822340 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:27.822340 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:27.822340 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:27.822340 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:27.822340 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:27.822340 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:27.822340 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:27.822340 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:27.822340 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:27.822340 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:27.822340 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:27.823261 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:27.824225 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:27.824225 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:27.824225 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:27.824225 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:27.824225 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 484/950] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:27.829675 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be01632-8586-4dcb-bb30-3b5e63dc20cd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:27.930212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be01632-8586-4dcb-bb30-3b5e63dc20cd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:27.964604 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41796f-b008-4f77-9acb-2b0572963b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:27.965273 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41796f-b008-4f77-9acb-2b0572963b92 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:27.965555 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41796f-b008-4f77-9acb-2b0572963b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:27.965832 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41796f-b008-4f77-9acb-2b0572963b92 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:27.966548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41796f-b008-4f77-9acb-2b0572963b92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:27.966904 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41796f-b008-4f77-9acb-2b0572963b92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:27.968366 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41796f-b008-4f77-9acb-2b0572963b92 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:27.980176 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 467/951] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:27.985812 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb67aca-9290-44f2-ad2a-6b593b8b5604 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:28.045186 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:28.087468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb67aca-9290-44f2-ad2a-6b593b8b5604 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:28.121621 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b1edd-e7cd-4d6a-8805-3c4def21e679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:28.122436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1edd-e7cd-4d6a-8805-3c4def21e679 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:28.122715 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1edd-e7cd-4d6a-8805-3c4def21e679 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:28.122985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b1edd-e7cd-4d6a-8805-3c4def21e679 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:28.130083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b1edd-e7cd-4d6a-8805-3c4def21e679 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:28.131626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0b1edd-e7cd-4d6a-8805-3c4def21e679 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:28.146296 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-3c0b1edd-e7cd-4d6a-8805-3c4def21e679 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:28.146296 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:28.146296 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:28.146296 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:28.146296 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:28.146296 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:28.146296 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:28.146296 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:28.146296 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:28.146296 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:28.146296 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:28.146296 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:28.146296 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:28.146296 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:28.146296 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:28.147264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:28.148295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:28.148295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:28.148295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:28.148295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:28.148295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:28.148295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:28.148295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:28.148295 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:28.148295 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 485/952] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:28.153793 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41796f-b008-4f77-9acb-2b0572963b92 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:28.170448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecdf21-6a6f-4085-8ca7-d70430442fe9 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:28.170769 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecdf21-6a6f-4085-8ca7-d70430442fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:28.171004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecdf21-6a6f-4085-8ca7-d70430442fe9 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:28.173217 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 486/953] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:59:28.178791 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf427e-5494-4dfc-a461-ed6bd09b9ecf None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:28.179106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf427e-5494-4dfc-a461-ed6bd09b9ecf None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:28.179424 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf427e-5494-4dfc-a461-ed6bd09b9ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:28.179626 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:28.200898 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-bbaf427e-5494-4dfc-a461-ed6bd09b9ecf None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:28.202807 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bbaf427e-5494-4dfc-a461-ed6bd09b9ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:28.263791 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41796f-b008-4f77-9acb-2b0572963b92 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:28.280771 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 487/954] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:28.282081 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436f579-5f63-486a-a2ef-03767a1443c3 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:28.282368 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436f579-5f63-486a-a2ef-03767a1443c3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:28.282638 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e436f579-5f63-486a-a2ef-03767a1443c3 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:28.284056 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 488/955] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:28.292751 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804214e-189b-46b1-b9b2-06e7de94c71a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:28.293180 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804214e-189b-46b1-b9b2-06e7de94c71a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:28.293424 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804214e-189b-46b1-b9b2-06e7de94c71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:28.307724 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b93b47-1720-4b4d-9aec-2d2b1d1da385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:28.308846 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b93b47-1720-4b4d-9aec-2d2b1d1da385 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:28.309412 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b93b47-1720-4b4d-9aec-2d2b1d1da385 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:28.309870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b93b47-1720-4b4d-9aec-2d2b1d1da385 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:28.310834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b93b47-1720-4b4d-9aec-2d2b1d1da385 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:28.311343 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b93b47-1720-4b4d-9aec-2d2b1d1da385 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:28.312771 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c804214e-189b-46b1-b9b2-06e7de94c71a None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:28.313185 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b93b47-1720-4b4d-9aec-2d2b1d1da385 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:28.313947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c804214e-189b-46b1-b9b2-06e7de94c71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:28.333362 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 468/956] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:28.333362 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b93b47-1720-4b4d-9aec-2d2b1d1da385 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:28.366844 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:28.392025 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 489/957] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:28.392985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804214e-189b-46b1-b9b2-06e7de94c71a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:28.414842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:28.444862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b93b47-1720-4b4d-9aec-2d2b1d1da385 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:28.483840 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32ad1d-f7da-45c6-80bb-e008162b9412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:28.484527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32ad1d-f7da-45c6-80bb-e008162b9412 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:28.484817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32ad1d-f7da-45c6-80bb-e008162b9412 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:28.485253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32ad1d-f7da-45c6-80bb-e008162b9412 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:28.485796 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32ad1d-f7da-45c6-80bb-e008162b9412 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:28.487249 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab32ad1d-f7da-45c6-80bb-e008162b9412 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:28.488674 dv-cinder-master-3-smb devstack@keystone.service[80520]: WARNING keystone.server.flask.common [None req-ab32ad1d-f7da-45c6-80bb-e008162b9412 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 24 00:59:28.494179 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804214e-189b-46b1-b9b2-06e7de94c71a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:28.502769 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.sql.core [None req-ab32ad1d-f7da-45c6-80bb-e008162b9412 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 24 00:59:28.502769 dv-cinder-master-3-smb devstack@keystone.service[80520]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 24 00:59:28.502769 dv-cinder-master-3-smb devstack@keystone.service[80520]: [parameters: {'user_id': 'ece7b9ab580d47739d86289018e5e62d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 24 00:59:28.502769 dv-cinder-master-3-smb devstack@keystone.service[80520]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80520) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 24 00:59:28.519880 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ab32ad1d-f7da-45c6-80bb-e008162b9412 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 24 00:59:28.519880 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:28.519880 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:59:28.519880 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:59:28.519880 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:59:28.519880 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:59:28.519880 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:59:28.519880 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:59:28.519880 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:59:28.519880 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:59:28.519880 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:59:28.519880 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:59:28.519880 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:59:28.519880 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application result.read() Jul 24 00:59:28.519880 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:59:28.520948 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application yield resource Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application next(self.gen) Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.session.rollback() Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.force_reraise() Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise self.value Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application session.commit() Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 24 00:59:28.522004 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._prepare_impl() Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.session.flush() Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._flush(objects) Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application compat.raise_( Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application flush_context.execute() Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rec.execute(self) Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 24 00:59:28.523756 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 24 00:59:28.524784 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application result = self._query(query) Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application conn.query(q) Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application result.read() Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 24 00:59:28.525674 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 24 00:59:28.527667 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 24 00:59:28.527667 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 24 00:59:28.527667 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 24 00:59:28.527667 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 24 00:59:28.527667 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 24 00:59:28.527667 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 24 00:59:28.527667 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ece7b9ab580d47739d86289018e5e62d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 24 00:59:28.527667 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 24 00:59:28.527667 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:28.527667 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:28.527667 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:28.527667 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:28.527667 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:28.527667 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:28.527667 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 24 00:59:28.529975 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 24 00:59:28.532201 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 24 00:59:28.532201 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 24 00:59:28.532201 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 24 00:59:28.532201 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 24 00:59:28.532201 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 24 00:59:28.532201 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:28.532201 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 469/958] 10.222.0.42 () {60 vars in 1131 bytes} [Sun Jul 24 00:59:28 2022] POST /identity/v3/users => generated 160 bytes in 192 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:28.532201 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32ad1d-f7da-45c6-80bb-e008162b9412 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:28.541749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3347d05-8d4d-41a3-93d8-512092f89b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:28.542769 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3347d05-8d4d-41a3-93d8-512092f89b20 None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:28.543108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3347d05-8d4d-41a3-93d8-512092f89b20 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:28.543486 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3347d05-8d4d-41a3-93d8-512092f89b20 None admin] PATH_INFO: `/v3/projects/604801625292482a9fb4b70c416dc438/users/87ce4ba479574d89990e23c157b2801b/roles/f979bbbf2c2245abab79b296097bda95` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:28.545740 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3347d05-8d4d-41a3-93d8-512092f89b20 None admin] RBAC: Authorizing `identity:create_grant(project_id=604801625292482a9fb4b70c416dc438, user_id=87ce4ba479574d89990e23c157b2801b, role_id=f979bbbf2c2245abab79b296097bda95)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:28.547195 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3347d05-8d4d-41a3-93d8-512092f89b20 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:28.561479 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 490/959] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:59:28 2022] PUT /identity/v3/projects/604801625292482a9fb4b70c416dc438/users/87ce4ba479574d89990e23c157b2801b/roles/f979bbbf2c2245abab79b296097bda95 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:59:28.561936 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3347d05-8d4d-41a3-93d8-512092f89b20 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:28.608186 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:28.653989 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab32ad1d-f7da-45c6-80bb-e008162b9412 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:28.677101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3347d05-8d4d-41a3-93d8-512092f89b20 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:28.692782 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cf7f9-ff1d-49e5-9b72-4a6ccf12f4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:28.694010 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cf7f9-ff1d-49e5-9b72-4a6ccf12f4bb None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:28.694499 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cf7f9-ff1d-49e5-9b72-4a6ccf12f4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:28.695056 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9cf7f9-ff1d-49e5-9b72-4a6ccf12f4bb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:28.696022 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cf7f9-ff1d-49e5-9b72-4a6ccf12f4bb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:28.697889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9cf7f9-ff1d-49e5-9b72-4a6ccf12f4bb None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-2a9cf7f9-ff1d-49e5-9b72-4a6ccf12f4bb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:28.711569 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:28.712760 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:28.713635 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:28.713635 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:28.713635 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:28.713635 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:28.713635 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:28.713635 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:28.713635 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:28.713635 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:28.713635 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:28.713635 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:28.713635 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:28.713635 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:28.713635 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:59:28.713635 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:28.721963 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 470/960] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Jul 24 00:59:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:28.722984 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43d368-f8ae-4e61-af90-16ffbf16413e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:28.723565 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43d368-f8ae-4e61-af90-16ffbf16413e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:28.723846 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43d368-f8ae-4e61-af90-16ffbf16413e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:28.724120 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43d368-f8ae-4e61-af90-16ffbf16413e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:28.725050 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cf7f9-ff1d-49e5-9b72-4a6ccf12f4bb None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:28.729458 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:28.735117 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43d368-f8ae-4e61-af90-16ffbf16413e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:28.736704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43d368-f8ae-4e61-af90-16ffbf16413e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-0a43d368-f8ae-4e61-af90-16ffbf16413e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:59:28.751988 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:28.753004 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:28.754301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:28.754301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:28.754301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:59:28.754301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:59:28.754301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:59:28.754301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:59:28.754301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:59:28.754301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:59:28.754301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 24 00:59:28.754301 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:28.754301 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 491/961] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:59:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:28.758989 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43d368-f8ae-4e61-af90-16ffbf16413e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:28.843504 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9cf7f9-ff1d-49e5-9b72-4a6ccf12f4bb None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:28.863713 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:28.869006 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43d368-f8ae-4e61-af90-16ffbf16413e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:28.880906 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d28d7f-6ccb-4449-8775-2b1e24866839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:28.881684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d28d7f-6ccb-4449-8775-2b1e24866839 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:28.881970 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d28d7f-6ccb-4449-8775-2b1e24866839 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:28.882311 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d28d7f-6ccb-4449-8775-2b1e24866839 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:28.884855 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d28d7f-6ccb-4449-8775-2b1e24866839 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:28.884855 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d28d7f-6ccb-4449-8775-2b1e24866839 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:28.884855 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d28d7f-6ccb-4449-8775-2b1e24866839 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:28.897885 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 471/962] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Jul 24 00:59:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:28.899260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d28d7f-6ccb-4449-8775-2b1e24866839 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:28.922753 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecefa74-a442-46e4-912d-c8e6baaea266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:28.924093 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecefa74-a442-46e4-912d-c8e6baaea266 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:28.924380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecefa74-a442-46e4-912d-c8e6baaea266 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:28.924380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecefa74-a442-46e4-912d-c8e6baaea266 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:28.925783 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecefa74-a442-46e4-912d-c8e6baaea266 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:28.925783 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecefa74-a442-46e4-912d-c8e6baaea266 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:28.927187 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecefa74-a442-46e4-912d-c8e6baaea266 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:28.967043 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 492/963] 10.222.0.42 () {56 vars in 1101 bytes} [Sun Jul 24 00:59:28 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:28.984198 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:29.026105 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d28d7f-6ccb-4449-8775-2b1e24866839 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:29.065874 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4dcc41-ad5f-4b4d-9641-bf6e4890216a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:29.067355 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dcc41-ad5f-4b4d-9641-bf6e4890216a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:29.067861 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dcc41-ad5f-4b4d-9641-bf6e4890216a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:29.068339 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4dcc41-ad5f-4b4d-9641-bf6e4890216a None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:29.069285 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4dcc41-ad5f-4b4d-9641-bf6e4890216a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:29.069857 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4dcc41-ad5f-4b4d-9641-bf6e4890216a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:29.071511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4dcc41-ad5f-4b4d-9641-bf6e4890216a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:29.078105 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 472/964] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Jul 24 00:59:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:29.084076 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecefa74-a442-46e4-912d-c8e6baaea266 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:29.198783 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecefa74-a442-46e4-912d-c8e6baaea266 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:29.245659 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec440ad-18a9-4092-bbb9-d133e4f2cb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:29.246725 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec440ad-18a9-4092-bbb9-d133e4f2cb8a None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:29.247169 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec440ad-18a9-4092-bbb9-d133e4f2cb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:29.247470 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec440ad-18a9-4092-bbb9-d133e4f2cb8a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:29.248239 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec440ad-18a9-4092-bbb9-d133e4f2cb8a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:29.249660 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec440ad-18a9-4092-bbb9-d133e4f2cb8a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:29.270592 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 493/965] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Jul 24 00:59:29 2022] POST /identity/v3/endpoints => generated 349 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:59:29.467986 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169bac6-a8a9-420e-acee-87aa399b9d28 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:29.468526 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169bac6-a8a9-420e-acee-87aa399b9d28 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:29.468526 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3169bac6-a8a9-420e-acee-87aa399b9d28 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:29.470090 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 473/966] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:29.475348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc169a-b1d6-42eb-a650-35accb4ff527 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:29.475630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc169a-b1d6-42eb-a650-35accb4ff527 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:29.475909 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc169a-b1d6-42eb-a650-35accb4ff527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:29.492912 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-66dc169a-b1d6-42eb-a650-35accb4ff527 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:29.494111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-66dc169a-b1d6-42eb-a650-35accb4ff527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:29.502320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:29.573985 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 494/967] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:29.596445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169bac6-a8a9-420e-acee-87aa399b9d28 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:29.701758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3169bac6-a8a9-420e-acee-87aa399b9d28 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:29.731819 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:29.738402 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe165bbe-e60b-4dec-9bd2-874ce391401b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:29.739086 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe165bbe-e60b-4dec-9bd2-874ce391401b None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:29.739400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe165bbe-e60b-4dec-9bd2-874ce391401b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:29.739683 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe165bbe-e60b-4dec-9bd2-874ce391401b None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:29.740445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe165bbe-e60b-4dec-9bd2-874ce391401b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:29.741879 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe165bbe-e60b-4dec-9bd2-874ce391401b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:29.760046 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 474/968] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Jul 24 00:59:29 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:59:30.671211 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c80829-83f2-4040-893d-a3823b4f957d None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:30.671778 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c80829-83f2-4040-893d-a3823b4f957d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:30.671778 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c80829-83f2-4040-893d-a3823b4f957d None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:30.673236 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 495/969] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:30.678620 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce567b-48de-4c52-ad39-06d95979a3b0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:30.679035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce567b-48de-4c52-ad39-06d95979a3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:30.679206 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce567b-48de-4c52-ad39-06d95979a3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:30.698144 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-76ce567b-48de-4c52-ad39-06d95979a3b0 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:30.699703 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-76ce567b-48de-4c52-ad39-06d95979a3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:30.777640 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 475/970] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:30 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:30.801074 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c80829-83f2-4040-893d-a3823b4f957d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:30.913945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c80829-83f2-4040-893d-a3823b4f957d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:30.949151 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb8dfc-3df7-4b4e-9851-d59085fdb1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:30.949967 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb8dfc-3df7-4b4e-9851-d59085fdb1ac None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:30.950253 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb8dfc-3df7-4b4e-9851-d59085fdb1ac None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:30.950523 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb8dfc-3df7-4b4e-9851-d59085fdb1ac None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:30.957351 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:30.961998 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeb8dfc-3df7-4b4e-9851-d59085fdb1ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-6aeb8dfc-3df7-4b4e-9851-d59085fdb1ac None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:30.970115 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:30.971087 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:30.971989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:30.971989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:30.971989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:30.971989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:30.971989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:30.971989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:30.971989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:30.971989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:30.971989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:30.971989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:30.971989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:59:30.971989 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:30.971989 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 496/971] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Jul 24 00:59:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:30.979319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce567b-48de-4c52-ad39-06d95979a3b0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:31.076877 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce567b-48de-4c52-ad39-06d95979a3b0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:31.094019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:31.111973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf23698-0387-4986-9b1a-60d2fb441ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:31.112607 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf23698-0387-4986-9b1a-60d2fb441ddf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.112894 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf23698-0387-4986-9b1a-60d2fb441ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.113173 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf23698-0387-4986-9b1a-60d2fb441ddf None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:31.113921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf23698-0387-4986-9b1a-60d2fb441ddf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:31.114230 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf23698-0387-4986-9b1a-60d2fb441ddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:31.115648 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf23698-0387-4986-9b1a-60d2fb441ddf None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:31.123891 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 476/972] 10.222.0.42 () {56 vars in 1115 bytes} [Sun Jul 24 00:59:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:31.129617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb8dfc-3df7-4b4e-9851-d59085fdb1ac None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:31.231514 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb8dfc-3df7-4b4e-9851-d59085fdb1ac None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:31.264734 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94766864-65e9-4f7a-b115-3b6afbd83c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:31.265568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94766864-65e9-4f7a-b115-3b6afbd83c01 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.265842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94766864-65e9-4f7a-b115-3b6afbd83c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.266116 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94766864-65e9-4f7a-b115-3b6afbd83c01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:31.276930 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94766864-65e9-4f7a-b115-3b6afbd83c01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:31.278395 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94766864-65e9-4f7a-b115-3b6afbd83c01 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:31.295593 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-94766864-65e9-4f7a-b115-3b6afbd83c01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:31.295593 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:31.295593 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:31.295593 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:31.295593 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:31.295593 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:31.295593 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:31.295593 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:31.295593 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:31.295593 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:31.295593 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:31.295593 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:31.295593 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:31.295593 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:31.295593 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:31.296573 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:31.302223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:31.302223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:31.302223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:31.302223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:31.302223 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 497/973] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:31.302530 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841f92d-6090-4d89-bb6b-d5cf4232b0ec None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.302530 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841f92d-6090-4d89-bb6b-d5cf4232b0ec None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.302530 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841f92d-6090-4d89-bb6b-d5cf4232b0ec None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:31.303262 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 477/974] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:31.304721 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94766864-65e9-4f7a-b115-3b6afbd83c01 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:31.307990 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498a19a-84b0-40e0-8704-14961bad9100 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.308284 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498a19a-84b0-40e0-8704-14961bad9100 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.308537 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7498a19a-84b0-40e0-8704-14961bad9100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:31.325268 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7498a19a-84b0-40e0-8704-14961bad9100 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:31.326442 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7498a19a-84b0-40e0-8704-14961bad9100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:31.360590 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:31.398795 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 478/975] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:31.421813 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498a19a-84b0-40e0-8704-14961bad9100 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:31.424192 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94766864-65e9-4f7a-b115-3b6afbd83c01 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:31.460516 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b506b1-1e11-467c-b312-30e4819d4e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:31.461216 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b506b1-1e11-467c-b312-30e4819d4e9d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.461612 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b506b1-1e11-467c-b312-30e4819d4e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.461895 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b506b1-1e11-467c-b312-30e4819d4e9d None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:31.462617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b506b1-1e11-467c-b312-30e4819d4e9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:31.462925 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b506b1-1e11-467c-b312-30e4819d4e9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:31.464348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b506b1-1e11-467c-b312-30e4819d4e9d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:31.481024 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 498/976] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:31.482620 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b506b1-1e11-467c-b312-30e4819d4e9d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:31.535557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7498a19a-84b0-40e0-8704-14961bad9100 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:31.547485 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:31.572702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a9675-1528-4ba5-9a97-a002ae0ae289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:31.573529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9675-1528-4ba5-9a97-a002ae0ae289 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.573816 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9675-1528-4ba5-9a97-a002ae0ae289 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.574091 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9675-1528-4ba5-9a97-a002ae0ae289 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:31.574756 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a9675-1528-4ba5-9a97-a002ae0ae289 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:31.576239 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a9675-1528-4ba5-9a97-a002ae0ae289 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:31.590210 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b506b1-1e11-467c-b312-30e4819d4e9d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-790a9675-1528-4ba5-9a97-a002ae0ae289 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:31.590796 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:31.592030 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:31.592914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:31.592914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:31.592914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:31.592914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:31.592914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:31.592914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:31.592914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:31.592914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:31.592914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:31.592914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:31.592914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:31.592914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:31.592914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:59:31.592914 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:31.592914 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 479/977] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Jul 24 00:59:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:31.598397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a9675-1528-4ba5-9a97-a002ae0ae289 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:31.603882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:31.630490 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44044a2-54f3-4f48-8fd9-29aad9f1f9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:31.631323 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44044a2-54f3-4f48-8fd9-29aad9f1f9ff None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.631648 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44044a2-54f3-4f48-8fd9-29aad9f1f9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.631897 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44044a2-54f3-4f48-8fd9-29aad9f1f9ff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:31.640055 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44044a2-54f3-4f48-8fd9-29aad9f1f9ff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:31.641535 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44044a2-54f3-4f48-8fd9-29aad9f1f9ff None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-b44044a2-54f3-4f48-8fd9-29aad9f1f9ff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:59:31.656716 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:31.657754 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:31.658718 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:31.658718 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:31.658718 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:59:31.658718 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:59:31.658718 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:59:31.658718 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:59:31.658718 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:59:31.658718 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:59:31.658718 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 24 00:59:31.658718 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:31.658718 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 499/978] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Jul 24 00:59:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:31.663693 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44044a2-54f3-4f48-8fd9-29aad9f1f9ff None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:31.718170 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a9675-1528-4ba5-9a97-a002ae0ae289 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:31.755918 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8287e-1881-4cc9-af21-9d8c9c521c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:31.756513 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8287e-1881-4cc9-af21-9d8c9c521c01 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.756798 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8287e-1881-4cc9-af21-9d8c9c521c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.757081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8287e-1881-4cc9-af21-9d8c9c521c01 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:31.757872 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8287e-1881-4cc9-af21-9d8c9c521c01 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:31.758179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8287e-1881-4cc9-af21-9d8c9c521c01 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:31.759601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8287e-1881-4cc9-af21-9d8c9c521c01 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:31.765290 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 480/979] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Jul 24 00:59:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:31.767927 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44044a2-54f3-4f48-8fd9-29aad9f1f9ff None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:31.771916 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8287e-1881-4cc9-af21-9d8c9c521c01 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:31.802666 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f23ae3e-d2a6-4057-8393-397081f5d50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:31.803417 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23ae3e-d2a6-4057-8393-397081f5d50f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.803700 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23ae3e-d2a6-4057-8393-397081f5d50f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.804002 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f23ae3e-d2a6-4057-8393-397081f5d50f None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:31.804843 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23ae3e-d2a6-4057-8393-397081f5d50f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:31.805149 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23ae3e-d2a6-4057-8393-397081f5d50f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:31.806574 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f23ae3e-d2a6-4057-8393-397081f5d50f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:31.813808 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:31.825343 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 500/980] 10.222.0.42 () {56 vars in 1149 bytes} [Sun Jul 24 00:59:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:31.826895 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0b0a1-745f-4340-9815-1a08e837005d None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.827246 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0b0a1-745f-4340-9815-1a08e837005d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.827558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0b0a1-745f-4340-9815-1a08e837005d None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:31.828918 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 501/981] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:31.830950 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0b0a1-745f-4340-9815-1a08e837005d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:31.858806 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:31.876754 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8287e-1881-4cc9-af21-9d8c9c521c01 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:31.910961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e7219-3019-47a3-b5cd-77b8eee76754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:31.911655 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e7219-3019-47a3-b5cd-77b8eee76754 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.911966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e7219-3019-47a3-b5cd-77b8eee76754 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.912261 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e7219-3019-47a3-b5cd-77b8eee76754 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:31.912965 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e7219-3019-47a3-b5cd-77b8eee76754 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:31.913276 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e7219-3019-47a3-b5cd-77b8eee76754 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:31.914738 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0e7219-3019-47a3-b5cd-77b8eee76754 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:31.919457 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 481/982] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Jul 24 00:59:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:31.920763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6c987-88de-4050-a33b-12ebd588d809 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.921051 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6c987-88de-4050-a33b-12ebd588d809 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.921326 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed6c987-88de-4050-a33b-12ebd588d809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:31.933513 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0b0a1-745f-4340-9815-1a08e837005d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:31.937804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9ed6c987-88de-4050-a33b-12ebd588d809 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:31.939810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9ed6c987-88de-4050-a33b-12ebd588d809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:31.969602 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cac33-5de5-4673-acd6-c17ac0ac38d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:31.970254 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cac33-5de5-4673-acd6-c17ac0ac38d0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:31.970533 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cac33-5de5-4673-acd6-c17ac0ac38d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:31.970808 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cac33-5de5-4673-acd6-c17ac0ac38d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:32.010391 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 482/983] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:31 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:32.011255 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6c987-88de-4050-a33b-12ebd588d809 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:32.042242 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cac33-5de5-4673-acd6-c17ac0ac38d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:32.043746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cac33-5de5-4673-acd6-c17ac0ac38d0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:32.046007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:32.069947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:32.113827 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed6c987-88de-4050-a33b-12ebd588d809 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:32.138947 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 502/984] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:59:31 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:59:32.140013 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cac33-5de5-4673-acd6-c17ac0ac38d0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:32.150744 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abee4dc-c78f-426a-8cc9-6766714741c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:32.151406 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abee4dc-c78f-426a-8cc9-6766714741c4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:32.151690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abee4dc-c78f-426a-8cc9-6766714741c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:32.151963 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abee4dc-c78f-426a-8cc9-6766714741c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:32.152773 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abee4dc-c78f-426a-8cc9-6766714741c4 None admin] RBAC: Adding query filter params (interface=admin, service_id=a6bae55e30dd4010a698f86699dfc992, region_id=RegionOne) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:32.153081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abee4dc-c78f-426a-8cc9-6766714741c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:32.154460 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abee4dc-c78f-426a-8cc9-6766714741c4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:32.159751 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 483/985] 10.222.0.42 () {56 vars in 1249 bytes} [Sun Jul 24 00:59:32 2022] GET /identity/v3/endpoints?service_id=a6bae55e30dd4010a698f86699dfc992&interface=admin®ion_id=RegionOne => generated 193 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:32.160354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abee4dc-c78f-426a-8cc9-6766714741c4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:32.241587 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cac33-5de5-4673-acd6-c17ac0ac38d0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:32.254372 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:32.260763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abee4dc-c78f-426a-8cc9-6766714741c4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:32.269320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:32.278997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f34177-f97d-4f53-94c6-b0e14d07a12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:32.280002 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f34177-f97d-4f53-94c6-b0e14d07a12c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:32.280390 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f34177-f97d-4f53-94c6-b0e14d07a12c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:32.280763 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f34177-f97d-4f53-94c6-b0e14d07a12c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:32.281733 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f34177-f97d-4f53-94c6-b0e14d07a12c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:32.283555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f34177-f97d-4f53-94c6-b0e14d07a12c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-23f34177-f97d-4f53-94c6-b0e14d07a12c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:32.296127 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:32.297155 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:32.298037 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:32.298037 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:32.298037 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:32.298037 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:32.298037 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:32.298037 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:32.298037 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:32.298037 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:32.298037 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:32.298037 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:32.298037 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:32.298037 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:32.298037 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:59:32.298037 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:32.298802 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf80208-8d7a-48ac-b785-189acbdc374b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:32.298892 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 503/986] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:32.298990 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf80208-8d7a-48ac-b785-189acbdc374b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:32.298990 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf80208-8d7a-48ac-b785-189acbdc374b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:32.299129 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f34177-f97d-4f53-94c6-b0e14d07a12c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:32.299200 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf80208-8d7a-48ac-b785-189acbdc374b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:32.313010 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf80208-8d7a-48ac-b785-189acbdc374b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:32.314502 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf80208-8d7a-48ac-b785-189acbdc374b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:32.332859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ddf80208-8d7a-48ac-b785-189acbdc374b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:32.332859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:32.332859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:32.332859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:32.332859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:32.332859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:32.332859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:32.332859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:32.332859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:32.332859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:32.332859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:32.332859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:32.332859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:32.332859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:32.332859 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:32.333795 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:32.334793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:32.334793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:32.334793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:32.334793 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:32.334793 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 484/987] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:32.334793 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf80208-8d7a-48ac-b785-189acbdc374b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:32.404253 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f34177-f97d-4f53-94c6-b0e14d07a12c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:32.434037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf80208-8d7a-48ac-b785-189acbdc374b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:32.435808 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f81d0-d572-4908-970f-c983c94aa70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:32.436479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f81d0-d572-4908-970f-c983c94aa70f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:32.436760 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f81d0-d572-4908-970f-c983c94aa70f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:32.437038 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f81d0-d572-4908-970f-c983c94aa70f None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:32.437720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f81d0-d572-4908-970f-c983c94aa70f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:32.439098 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f81d0-d572-4908-970f-c983c94aa70f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:32.445780 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 504/988] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Jul 24 00:59:32 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 00:59:32.446549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f81d0-d572-4908-970f-c983c94aa70f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:32.473363 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd994ebe-fd9c-4e74-a9b3-5bf112a21a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:32.474063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd994ebe-fd9c-4e74-a9b3-5bf112a21a16 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:32.474346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd994ebe-fd9c-4e74-a9b3-5bf112a21a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:32.474630 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd994ebe-fd9c-4e74-a9b3-5bf112a21a16 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:32.475386 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd994ebe-fd9c-4e74-a9b3-5bf112a21a16 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:32.475702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd994ebe-fd9c-4e74-a9b3-5bf112a21a16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:32.477256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd994ebe-fd9c-4e74-a9b3-5bf112a21a16 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:32.482923 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 485/989] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Jul 24 00:59:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:32.488805 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd994ebe-fd9c-4e74-a9b3-5bf112a21a16 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:32.505598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:32.515818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:32.566133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f81d0-d572-4908-970f-c983c94aa70f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:32.603785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d36ef5-f615-44c8-8a06-7b34c4da64af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:32.604855 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d36ef5-f615-44c8-8a06-7b34c4da64af None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:32.605300 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d36ef5-f615-44c8-8a06-7b34c4da64af None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:32.605586 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d36ef5-f615-44c8-8a06-7b34c4da64af None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:32.606322 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d36ef5-f615-44c8-8a06-7b34c4da64af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:32.606618 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d36ef5-f615-44c8-8a06-7b34c4da64af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:32.608023 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d36ef5-f615-44c8-8a06-7b34c4da64af None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:32.608199 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd994ebe-fd9c-4e74-a9b3-5bf112a21a16 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:32.623595 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 505/990] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:32.635145 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d36ef5-f615-44c8-8a06-7b34c4da64af None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:32.645242 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eac527-0642-4b96-b022-694843d21205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:32.645968 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eac527-0642-4b96-b022-694843d21205 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:32.646262 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eac527-0642-4b96-b022-694843d21205 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:32.646539 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eac527-0642-4b96-b022-694843d21205 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:32.647246 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eac527-0642-4b96-b022-694843d21205 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:32.647605 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eac527-0642-4b96-b022-694843d21205 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:32.649039 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eac527-0642-4b96-b022-694843d21205 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:32.659350 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 486/991] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Jul 24 00:59:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:32.660927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eac527-0642-4b96-b022-694843d21205 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:32.731059 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d36ef5-f615-44c8-8a06-7b34c4da64af None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:32.748132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:32.750992 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:32.768379 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb95f3-b33e-460b-99a9-85cc1ed2eb74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:32.769113 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb95f3-b33e-460b-99a9-85cc1ed2eb74 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:32.769457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb95f3-b33e-460b-99a9-85cc1ed2eb74 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:32.769736 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb95f3-b33e-460b-99a9-85cc1ed2eb74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:32.774186 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eac527-0642-4b96-b022-694843d21205 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:32.777438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb95f3-b33e-460b-99a9-85cc1ed2eb74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:32.778915 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb95f3-b33e-460b-99a9-85cc1ed2eb74 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:32.794064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-92bb95f3-b33e-460b-99a9-85cc1ed2eb74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:32.794064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:32.794064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:32.794064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:32.794064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:32.794064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:32.794064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:32.794064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:32.794064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:32.794064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:32.794064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:32.794064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:32.794064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:32.794064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:32.794064 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:32.795021 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:32.796708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:32.796708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:32.796708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:32.796708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:32.796708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:32.796708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:32.796708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:32.796708 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:32.800286 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 506/992] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:32.801183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb95f3-b33e-460b-99a9-85cc1ed2eb74 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:32.819925 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca7eea-8c41-446a-bc9a-8464c5c0ef8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:32.820801 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca7eea-8c41-446a-bc9a-8464c5c0ef8e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:32.821255 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca7eea-8c41-446a-bc9a-8464c5c0ef8e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:32.821676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca7eea-8c41-446a-bc9a-8464c5c0ef8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:32.822623 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca7eea-8c41-446a-bc9a-8464c5c0ef8e None admin] RBAC: Adding query filter params (interface=public, service_id=60c1904cc5ee409884455932caf9212e, region_id=RegionOne) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:32.823076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca7eea-8c41-446a-bc9a-8464c5c0ef8e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:32.824625 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca7eea-8c41-446a-bc9a-8464c5c0ef8e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:32.830649 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 487/993] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Jul 24 00:59:32 2022] GET /identity/v3/endpoints?service_id=60c1904cc5ee409884455932caf9212e&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:32.836136 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca7eea-8c41-446a-bc9a-8464c5c0ef8e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:32.913902 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb95f3-b33e-460b-99a9-85cc1ed2eb74 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:32.944582 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca7eea-8c41-446a-bc9a-8464c5c0ef8e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:32.949468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1a583-0dfc-45a8-8702-0c0eb016aa13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:32.950145 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a583-0dfc-45a8-8702-0c0eb016aa13 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:32.950430 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a583-0dfc-45a8-8702-0c0eb016aa13 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:32.950708 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1a583-0dfc-45a8-8702-0c0eb016aa13 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:32.951528 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1a583-0dfc-45a8-8702-0c0eb016aa13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:32.951846 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1a583-0dfc-45a8-8702-0c0eb016aa13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:32.953293 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1a583-0dfc-45a8-8702-0c0eb016aa13 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:32.965771 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 507/994] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:32.971521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1a583-0dfc-45a8-8702-0c0eb016aa13 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:32.980298 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d966844c-81a1-4ae1-98e6-1faa360e98f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:32.981072 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966844c-81a1-4ae1-98e6-1faa360e98f8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:32.981354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966844c-81a1-4ae1-98e6-1faa360e98f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:32.981632 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d966844c-81a1-4ae1-98e6-1faa360e98f8 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:32.982316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966844c-81a1-4ae1-98e6-1faa360e98f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:32.983727 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d966844c-81a1-4ae1-98e6-1faa360e98f8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:32.990219 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 488/995] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Jul 24 00:59:32 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 00:59:33.020297 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:33.094327 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1a583-0dfc-45a8-8702-0c0eb016aa13 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:33.131812 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafaf1d5-b600-4ae5-a2a6-2bf473a9947b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:33.132656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafaf1d5-b600-4ae5-a2a6-2bf473a9947b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:33.132949 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafaf1d5-b600-4ae5-a2a6-2bf473a9947b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:33.133225 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafaf1d5-b600-4ae5-a2a6-2bf473a9947b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:33.134096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafaf1d5-b600-4ae5-a2a6-2bf473a9947b None admin] RBAC: Adding query filter params (role.id=f979bbbf2c2245abab79b296097bda95, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=87ce4ba479574d89990e23c157b2801b) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:33.134413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafaf1d5-b600-4ae5-a2a6-2bf473a9947b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:33.135907 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafaf1d5-b600-4ae5-a2a6-2bf473a9947b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:33.143129 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 508/996] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:59:32 2022] GET /identity/v3/role_assignments?user.id=87ce4ba479574d89990e23c157b2801b&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=f979bbbf2c2245abab79b296097bda95 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:34.471289 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9470118-0b02-4219-b6fd-da679a696646 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:34.471890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9470118-0b02-4219-b6fd-da679a696646 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:34.471890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9470118-0b02-4219-b6fd-da679a696646 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:34.473437 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 489/997] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:34.478750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63a206-3e1c-4048-a317-c814e3d3a34c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:34.479155 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63a206-3e1c-4048-a317-c814e3d3a34c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:34.479347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b63a206-3e1c-4048-a317-c814e3d3a34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:34.496730 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1b63a206-3e1c-4048-a317-c814e3d3a34c None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:34.497921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1b63a206-3e1c-4048-a317-c814e3d3a34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:34.565854 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 509/998] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:34 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:34.589096 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9470118-0b02-4219-b6fd-da679a696646 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:34.593099 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:34.693523 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9470118-0b02-4219-b6fd-da679a696646 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:34.727945 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7fc48-59ee-4457-a0e5-4fa6b40aaea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:34.728695 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7fc48-59ee-4457-a0e5-4fa6b40aaea8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:34.728974 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7fc48-59ee-4457-a0e5-4fa6b40aaea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:34.729262 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7fc48-59ee-4457-a0e5-4fa6b40aaea8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:34.729917 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7fc48-59ee-4457-a0e5-4fa6b40aaea8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:34.731328 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7fc48-59ee-4457-a0e5-4fa6b40aaea8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6fe7fc48-59ee-4457-a0e5-4fa6b40aaea8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:34.743520 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:34.744593 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:34.745453 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:34.745453 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:34.745453 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:34.745453 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:34.745453 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:34.745453 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:34.745453 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:34.745453 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:34.745453 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:34.745453 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:34.745453 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:34.745453 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:34.745453 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 24 00:59:34.745453 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:34.747637 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 490/999] 10.222.0.42 () {56 vars in 1126 bytes} [Sun Jul 24 00:59:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:34.750986 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63a206-3e1c-4048-a317-c814e3d3a34c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:34.781054 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:34.861841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b63a206-3e1c-4048-a317-c814e3d3a34c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:34.897010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931bfff-8e83-43be-a3e1-8c3639772b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:34.897706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931bfff-8e83-43be-a3e1-8c3639772b3b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:34.897989 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931bfff-8e83-43be-a3e1-8c3639772b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:34.898267 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931bfff-8e83-43be-a3e1-8c3639772b3b None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:34.898970 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931bfff-8e83-43be-a3e1-8c3639772b3b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:34.899274 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931bfff-8e83-43be-a3e1-8c3639772b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:34.900670 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931bfff-8e83-43be-a3e1-8c3639772b3b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:34.905749 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 510/1000] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Jul 24 00:59:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:34.911239 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7fc48-59ee-4457-a0e5-4fa6b40aaea8 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:34.977624 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:35.012511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7fc48-59ee-4457-a0e5-4fa6b40aaea8 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:35.024646 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d6488-d23d-4f2b-9d2f-3537e06ffe03 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:35.024958 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d6488-d23d-4f2b-9d2f-3537e06ffe03 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:35.025207 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d6488-d23d-4f2b-9d2f-3537e06ffe03 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:35.026613 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 511/1001] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:59:35.031463 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c71058-cef9-4170-bc8a-ec7bf12cd093 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:35.031754 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c71058-cef9-4170-bc8a-ec7bf12cd093 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:35.032043 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c71058-cef9-4170-bc8a-ec7bf12cd093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:35.047505 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794efd9-4736-4212-ae7f-02ee6625fc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:35.048185 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794efd9-4736-4212-ae7f-02ee6625fc64 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:35.048476 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794efd9-4736-4212-ae7f-02ee6625fc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:35.048759 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794efd9-4736-4212-ae7f-02ee6625fc64 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:35.049023 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-07c71058-cef9-4170-bc8a-ec7bf12cd093 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:35.049475 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794efd9-4736-4212-ae7f-02ee6625fc64 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:35.049782 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794efd9-4736-4212-ae7f-02ee6625fc64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:35.050196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-07c71058-cef9-4170-bc8a-ec7bf12cd093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:35.051175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794efd9-4736-4212-ae7f-02ee6625fc64 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:35.056518 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 491/1002] 10.222.0.42 () {56 vars in 1122 bytes} [Sun Jul 24 00:59:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:35.061889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794efd9-4736-4212-ae7f-02ee6625fc64 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:35.126721 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 512/1003] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:35 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:35.149614 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c71058-cef9-4170-bc8a-ec7bf12cd093 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:35.162727 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794efd9-4736-4212-ae7f-02ee6625fc64 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:35.173964 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:35.190674 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:35.196354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687e73a-0518-4b7c-befb-6c5527ef240e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:35.197015 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687e73a-0518-4b7c-befb-6c5527ef240e None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:35.197294 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687e73a-0518-4b7c-befb-6c5527ef240e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:35.197566 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687e73a-0518-4b7c-befb-6c5527ef240e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:35.198310 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687e73a-0518-4b7c-befb-6c5527ef240e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:35.199727 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687e73a-0518-4b7c-befb-6c5527ef240e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:35.214481 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 492/1004] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Jul 24 00:59:35 2022] POST /identity/v3/endpoints => generated 325 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:59:35.215750 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2628-879e-40a9-84f8-5d5bc725d361 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:35.216024 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2628-879e-40a9-84f8-5d5bc725d361 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:35.216289 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2628-879e-40a9-84f8-5d5bc725d361 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:35.219342 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 493/1005] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:35.223575 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afba17-827a-4a62-ba1c-ebe594568b7f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:35.224130 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afba17-827a-4a62-ba1c-ebe594568b7f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:35.224582 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afba17-827a-4a62-ba1c-ebe594568b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:35.255445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-61afba17-827a-4a62-ba1c-ebe594568b7f None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:35.256700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-61afba17-827a-4a62-ba1c-ebe594568b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:35.256956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c71058-cef9-4170-bc8a-ec7bf12cd093 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:35.304163 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daecfa-c09d-410f-a5b8-124dc64679b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:35.304898 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daecfa-c09d-410f-a5b8-124dc64679b4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:35.305182 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daecfa-c09d-410f-a5b8-124dc64679b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:35.305462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51daecfa-c09d-410f-a5b8-124dc64679b4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:35.306123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51daecfa-c09d-410f-a5b8-124dc64679b4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:35.307646 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51daecfa-c09d-410f-a5b8-124dc64679b4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-51daecfa-c09d-410f-a5b8-124dc64679b4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:35.320741 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:35.321883 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:35.323503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:35.323503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:35.323503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:35.323503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:35.323503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:35.323503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:35.323503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:35.323503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:35.323503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:35.323503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:35.323503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:35.323503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:35.323503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 24 00:59:35.323503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:35.323503 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 513/1006] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:35 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:35.328249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daecfa-c09d-410f-a5b8-124dc64679b4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:35.338329 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 494/1007] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:35.360787 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afba17-827a-4a62-ba1c-ebe594568b7f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:35.421477 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:35.438395 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51daecfa-c09d-410f-a5b8-124dc64679b4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:35.471134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afba17-827a-4a62-ba1c-ebe594568b7f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:35.477453 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba029066-dc36-4f7c-ae69-1b8c4c2d3f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:35.478399 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba029066-dc36-4f7c-ae69-1b8c4c2d3f5c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:35.478910 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba029066-dc36-4f7c-ae69-1b8c4c2d3f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:35.480221 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba029066-dc36-4f7c-ae69-1b8c4c2d3f5c None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:35.481132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba029066-dc36-4f7c-ae69-1b8c4c2d3f5c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:35.481926 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba029066-dc36-4f7c-ae69-1b8c4c2d3f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:35.483956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba029066-dc36-4f7c-ae69-1b8c4c2d3f5c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:35.494618 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 514/1008] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Jul 24 00:59:35 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:35.495611 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:35.496036 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba029066-dc36-4f7c-ae69-1b8c4c2d3f5c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:35.509766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4238e54-b305-4c60-8dfb-711e8a9f083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:35.510857 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4238e54-b305-4c60-8dfb-711e8a9f083c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:35.511144 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4238e54-b305-4c60-8dfb-711e8a9f083c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:35.511458 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4238e54-b305-4c60-8dfb-711e8a9f083c None admin] PATH_INFO: `/v3/services/image` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:35.512280 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4238e54-b305-4c60-8dfb-711e8a9f083c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:35.514325 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4238e54-b305-4c60-8dfb-711e8a9f083c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d4238e54-b305-4c60-8dfb-711e8a9f083c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:35.529041 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:35.530099 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:35.530982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:35.530982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:35.530982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:35.530982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:35.530982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:35.530982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:35.530982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:35.530982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:35.530982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:35.530982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:35.530982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:35.530982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:35.530982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:59:35.530982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:35.530982 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 495/1009] 10.222.0.42 () {56 vars in 1105 bytes} [Sun Jul 24 00:59:35 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:35.536573 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4238e54-b305-4c60-8dfb-711e8a9f083c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:35.605536 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba029066-dc36-4f7c-ae69-1b8c4c2d3f5c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:35.638754 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b740ae-5568-4c0b-b097-ba57fd2bf80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:35.638956 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4238e54-b305-4c60-8dfb-711e8a9f083c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:35.639464 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b740ae-5568-4c0b-b097-ba57fd2bf80c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:35.639750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b740ae-5568-4c0b-b097-ba57fd2bf80c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:35.640027 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b740ae-5568-4c0b-b097-ba57fd2bf80c None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:35.640874 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b740ae-5568-4c0b-b097-ba57fd2bf80c None admin] RBAC: Adding query filter params (type=compute) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:35.641189 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b740ae-5568-4c0b-b097-ba57fd2bf80c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:35.642578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b740ae-5568-4c0b-b097-ba57fd2bf80c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:35.647457 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 515/1010] 10.222.0.42 () {56 vars in 1112 bytes} [Sun Jul 24 00:59:35 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:35.653104 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b740ae-5568-4c0b-b097-ba57fd2bf80c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:35.668346 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:35.676532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3a00e-15d1-4730-bad5-982d78076869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:35.677211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3a00e-15d1-4730-bad5-982d78076869 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:35.677495 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3a00e-15d1-4730-bad5-982d78076869 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:35.677771 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff3a00e-15d1-4730-bad5-982d78076869 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:35.678500 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3a00e-15d1-4730-bad5-982d78076869 None admin] RBAC: Adding query filter params (name=image) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:35.678792 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3a00e-15d1-4730-bad5-982d78076869 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:35.680241 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff3a00e-15d1-4730-bad5-982d78076869 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:35.685212 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 496/1011] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:35.691335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3a00e-15d1-4730-bad5-982d78076869 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:35.744532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:35.764209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b740ae-5568-4c0b-b097-ba57fd2bf80c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:35.802339 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff3a00e-15d1-4730-bad5-982d78076869 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:35.805703 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6978a306-9d58-4fd1-9267-7e2863f0463f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:35.806548 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978a306-9d58-4fd1-9267-7e2863f0463f None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:35.807049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978a306-9d58-4fd1-9267-7e2863f0463f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:35.807514 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6978a306-9d58-4fd1-9267-7e2863f0463f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:35.808874 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978a306-9d58-4fd1-9267-7e2863f0463f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:35.810419 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6978a306-9d58-4fd1-9267-7e2863f0463f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:35.830824 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 516/1012] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Jul 24 00:59:35 2022] POST /identity/v3/endpoints => generated 334 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:59:35.850050 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838162f-62dc-4cdd-a990-98c192c00912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:35.850801 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838162f-62dc-4cdd-a990-98c192c00912 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:35.851088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838162f-62dc-4cdd-a990-98c192c00912 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:35.851404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838162f-62dc-4cdd-a990-98c192c00912 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:35.852211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838162f-62dc-4cdd-a990-98c192c00912 None admin] RBAC: Adding query filter params (type=image) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:35.852506 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838162f-62dc-4cdd-a990-98c192c00912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:35.854053 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838162f-62dc-4cdd-a990-98c192c00912 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:35.859939 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 497/1013] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:35 2022] GET /identity/v3/services?type=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:37.262389 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f017e8f-6129-46cc-83a4-665dab8e45fd None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:37.262972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f017e8f-6129-46cc-83a4-665dab8e45fd None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:37.262972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f017e8f-6129-46cc-83a4-665dab8e45fd None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:37.264551 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 517/1014] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:37.269615 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2ce5a-fda5-401f-93f4-6183fbc74d30 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:37.270048 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2ce5a-fda5-401f-93f4-6183fbc74d30 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:37.270208 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2ce5a-fda5-401f-93f4-6183fbc74d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:37.287497 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-28d2ce5a-fda5-401f-93f4-6183fbc74d30 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:37.288809 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-28d2ce5a-fda5-401f-93f4-6183fbc74d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:37.361144 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 498/1015] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:37 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:37.384414 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f017e8f-6129-46cc-83a4-665dab8e45fd None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:37.455556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:37.492863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f017e8f-6129-46cc-83a4-665dab8e45fd None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:37.530092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c6698-6439-4e68-98c0-f11a599050ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:37.530833 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c6698-6439-4e68-98c0-f11a599050ca None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:37.531121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c6698-6439-4e68-98c0-f11a599050ca None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:37.531431 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c6698-6439-4e68-98c0-f11a599050ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:37.532635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c6698-6439-4e68-98c0-f11a599050ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:37.534095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8c6698-6439-4e68-98c0-f11a599050ca None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:37.535940 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 518/1016] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:37.541676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2ce5a-fda5-401f-93f4-6183fbc74d30 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:37.584209 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:37.643737 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2ce5a-fda5-401f-93f4-6183fbc74d30 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:37.678124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e416a-4cef-45f5-a611-4276ecfccba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:37.678805 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e416a-4cef-45f5-a611-4276ecfccba3 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:37.679567 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e416a-4cef-45f5-a611-4276ecfccba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:37.679856 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e416a-4cef-45f5-a611-4276ecfccba3 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:37.680583 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e416a-4cef-45f5-a611-4276ecfccba3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:37.682219 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e416a-4cef-45f5-a611-4276ecfccba3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:37.708883 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 499/1017] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Jul 24 00:59:37 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:59:37.887942 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b103f9-a031-4011-b80f-6024dee6a14d None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:37.888236 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b103f9-a031-4011-b80f-6024dee6a14d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:37.888518 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b103f9-a031-4011-b80f-6024dee6a14d None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:37.889974 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 519/1018] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:37.895310 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137f16b-f9a2-4d6c-8f68-6ea9c3a1af2a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:37.895727 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137f16b-f9a2-4d6c-8f68-6ea9c3a1af2a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:37.896071 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137f16b-f9a2-4d6c-8f68-6ea9c3a1af2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:37.913479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3137f16b-f9a2-4d6c-8f68-6ea9c3a1af2a None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:37.914670 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3137f16b-f9a2-4d6c-8f68-6ea9c3a1af2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:37.986431 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edb3e7-4cf3-4b53-9d2f-b9ba33abab6a None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:37.986945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edb3e7-4cf3-4b53-9d2f-b9ba33abab6a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:37.987234 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2edb3e7-4cf3-4b53-9d2f-b9ba33abab6a None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:37.989152 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 520/1019] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:37.995122 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 500/1020] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:37 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:37.995664 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639aa6c-d331-4984-a5a8-c092021c3026 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:37.996350 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639aa6c-d331-4984-a5a8-c092021c3026 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:37.996963 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d639aa6c-d331-4984-a5a8-c092021c3026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:38.015572 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d639aa6c-d331-4984-a5a8-c092021c3026 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:38.017122 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d639aa6c-d331-4984-a5a8-c092021c3026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:38.017403 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137f16b-f9a2-4d6c-8f68-6ea9c3a1af2a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:38.041793 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:38.095416 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 521/1021] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:37 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:38.114633 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639aa6c-d331-4984-a5a8-c092021c3026 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:38.118085 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3137f16b-f9a2-4d6c-8f68-6ea9c3a1af2a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:38.153397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c767f2-ad69-46cc-af4d-b84d8b882795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:38.154075 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c767f2-ad69-46cc-af4d-b84d8b882795 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:38.154361 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c767f2-ad69-46cc-af4d-b84d8b882795 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:38.154645 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c767f2-ad69-46cc-af4d-b84d8b882795 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:38.155395 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c767f2-ad69-46cc-af4d-b84d8b882795 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:38.156801 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c767f2-ad69-46cc-af4d-b84d8b882795 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:38.174230 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 501/1022] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Jul 24 00:59:38 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:59:38.181145 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:38.223973 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d639aa6c-d331-4984-a5a8-c092021c3026 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:38.269931 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20363d-a32a-4562-b272-8075d324d125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:38.270788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20363d-a32a-4562-b272-8075d324d125 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:38.271024 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20363d-a32a-4562-b272-8075d324d125 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:38.271325 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c20363d-a32a-4562-b272-8075d324d125 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:38.284413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c20363d-a32a-4562-b272-8075d324d125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-5c20363d-a32a-4562-b272-8075d324d125 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:38.296978 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:38.298080 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:38.304390 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:38.304390 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:38.304390 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:38.304390 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:38.304390 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:38.304390 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:38.304390 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:38.304390 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:38.304390 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:38.304390 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:38.304390 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:59:38.304390 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:38.304390 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 522/1023] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Jul 24 00:59:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:38.306969 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c767f2-ad69-46cc-af4d-b84d8b882795 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:38.400499 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:38.420678 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c767f2-ad69-46cc-af4d-b84d8b882795 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:38.455399 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc93479-01c0-4732-8cd3-af25bb421c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:38.456083 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc93479-01c0-4732-8cd3-af25bb421c57 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:38.456364 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc93479-01c0-4732-8cd3-af25bb421c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:38.456637 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc93479-01c0-4732-8cd3-af25bb421c57 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:38.457392 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc93479-01c0-4732-8cd3-af25bb421c57 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:38.457696 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc93479-01c0-4732-8cd3-af25bb421c57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:38.459072 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc93479-01c0-4732-8cd3-af25bb421c57 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:38.468009 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 502/1024] 10.222.0.42 () {56 vars in 1115 bytes} [Sun Jul 24 00:59:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:38.473518 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20363d-a32a-4562-b272-8075d324d125 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:38.576378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c20363d-a32a-4562-b272-8075d324d125 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:38.598506 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:38.611749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4f4e0-c30a-4f9a-a125-d6640d7ce907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:38.612781 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4f4e0-c30a-4f9a-a125-d6640d7ce907 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:38.613213 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4f4e0-c30a-4f9a-a125-d6640d7ce907 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:38.613650 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4f4e0-c30a-4f9a-a125-d6640d7ce907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:38.625791 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4f4e0-c30a-4f9a-a125-d6640d7ce907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:38.627455 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4f4e0-c30a-4f9a-a125-d6640d7ce907 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:38.645556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-94d4f4e0-c30a-4f9a-a125-d6640d7ce907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:38.645556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:38.645556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:38.645556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:38.645556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:38.645556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:38.645556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:38.645556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:38.645556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:38.645556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:38.645556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:38.645556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:38.645556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:38.645556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:38.645556 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:38.646750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:38.647902 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:38.647902 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:38.647902 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:38.647902 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:38.649821 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 523/1025] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:38.655492 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc93479-01c0-4732-8cd3-af25bb421c57 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:38.765521 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc93479-01c0-4732-8cd3-af25bb421c57 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:38.804212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc068c0-dec5-4239-989a-1048016fefb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:38.804886 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc068c0-dec5-4239-989a-1048016fefb2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:38.805167 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc068c0-dec5-4239-989a-1048016fefb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:38.805437 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc068c0-dec5-4239-989a-1048016fefb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:38.806186 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc068c0-dec5-4239-989a-1048016fefb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:38.806491 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc068c0-dec5-4239-989a-1048016fefb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:38.807905 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc068c0-dec5-4239-989a-1048016fefb2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:38.824112 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 503/1026] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:38.829568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4f4e0-c30a-4f9a-a125-d6640d7ce907 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:38.932894 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4f4e0-c30a-4f9a-a125-d6640d7ce907 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:38.967579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d48f3c-40a4-44d9-9614-546fd6b195e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:38.968388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d48f3c-40a4-44d9-9614-546fd6b195e9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:38.968675 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d48f3c-40a4-44d9-9614-546fd6b195e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:38.968954 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d48f3c-40a4-44d9-9614-546fd6b195e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:38.976836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d48f3c-40a4-44d9-9614-546fd6b195e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:38.978294 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d48f3c-40a4-44d9-9614-546fd6b195e9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-25d48f3c-40a4-44d9-9614-546fd6b195e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:59:38.992373 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:38.993335 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:38.994321 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:38.994321 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:38.994321 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:59:38.994321 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:59:38.994321 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:59:38.994321 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:59:38.994321 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:59:38.994321 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:59:38.994321 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:59:38.994321 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:38.998350 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 524/1027] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Jul 24 00:59:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:38.999666 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc068c0-dec5-4239-989a-1048016fefb2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:39.003741 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:39.102369 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc068c0-dec5-4239-989a-1048016fefb2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:39.137038 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e6a37-6197-4fde-ad41-21238d5f6b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:39.137714 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e6a37-6197-4fde-ad41-21238d5f6b82 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:39.137998 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e6a37-6197-4fde-ad41-21238d5f6b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:39.138275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e6a37-6197-4fde-ad41-21238d5f6b82 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:39.139112 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e6a37-6197-4fde-ad41-21238d5f6b82 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:39.139454 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e6a37-6197-4fde-ad41-21238d5f6b82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:39.140906 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e6a37-6197-4fde-ad41-21238d5f6b82 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:39.158177 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 504/1028] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Jul 24 00:59:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:39.164039 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d48f3c-40a4-44d9-9614-546fd6b195e9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:39.199834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:39.266084 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d48f3c-40a4-44d9-9614-546fd6b195e9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:39.301198 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac6a11-9300-4162-988e-94793ed907ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:39.301854 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac6a11-9300-4162-988e-94793ed907ba None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:39.302149 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac6a11-9300-4162-988e-94793ed907ba None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:39.302410 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac6a11-9300-4162-988e-94793ed907ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:39.369844 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac6a11-9300-4162-988e-94793ed907ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:39.371316 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac6a11-9300-4162-988e-94793ed907ba None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:39.404121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:39.473556 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 525/1029] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:59:39 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 00:59:39.479673 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e6a37-6197-4fde-ad41-21238d5f6b82 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:39.542570 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:39.583952 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e6a37-6197-4fde-ad41-21238d5f6b82 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:39.619716 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f84b5db-3b18-4812-bcbd-c2ea94cc2800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:39.620746 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84b5db-3b18-4812-bcbd-c2ea94cc2800 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:39.621179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84b5db-3b18-4812-bcbd-c2ea94cc2800 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:39.621634 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f84b5db-3b18-4812-bcbd-c2ea94cc2800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:39.632630 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84b5db-3b18-4812-bcbd-c2ea94cc2800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:39.634279 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f84b5db-3b18-4812-bcbd-c2ea94cc2800 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:39.652441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1f84b5db-3b18-4812-bcbd-c2ea94cc2800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:39.652441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:39.652441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:39.652441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:39.652441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:39.652441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:39.652441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:39.652441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:39.652441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:39.652441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:39.652441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:39.652441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:39.652441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:39.652441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:39.652441 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:39.653439 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:39.654385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:39.654385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:39.654385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:39.654385 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:39.659075 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 505/1030] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:39.660482 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac6a11-9300-4162-988e-94793ed907ba None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:39.762781 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac6a11-9300-4162-988e-94793ed907ba None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:39.766709 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77757981-16bc-49fb-ac43-3f4087633c86 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:39.766997 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77757981-16bc-49fb-ac43-3f4087633c86 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:39.767277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77757981-16bc-49fb-ac43-3f4087633c86 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:39.768876 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 506/1031] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 00:59:39.773711 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aea31e-4f6b-4f30-a053-f3719c6e3f6d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:39.773989 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aea31e-4f6b-4f30-a053-f3719c6e3f6d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:39.774261 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aea31e-4f6b-4f30-a053-f3719c6e3f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:39.791985 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f2aea31e-4f6b-4f30-a053-f3719c6e3f6d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:39.793229 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f2aea31e-4f6b-4f30-a053-f3719c6e3f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:39.803323 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f39cbd-9a1e-4d8f-93e2-20a38f044be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:39.804132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f39cbd-9a1e-4d8f-93e2-20a38f044be4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:39.804414 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f39cbd-9a1e-4d8f-93e2-20a38f044be4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:39.804685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f39cbd-9a1e-4d8f-93e2-20a38f044be4 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:39.805411 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f39cbd-9a1e-4d8f-93e2-20a38f044be4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:39.805713 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f39cbd-9a1e-4d8f-93e2-20a38f044be4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:39.807089 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f39cbd-9a1e-4d8f-93e2-20a38f044be4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:39.808720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:39.825366 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 526/1032] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:39.826525 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f39cbd-9a1e-4d8f-93e2-20a38f044be4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:39.878074 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 507/1033] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:39.902756 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aea31e-4f6b-4f30-a053-f3719c6e3f6d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:39.933571 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f39cbd-9a1e-4d8f-93e2-20a38f044be4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:39.950515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:39.968738 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b77da-3711-4811-b242-c90ed71c086b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:39.969549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b77da-3711-4811-b242-c90ed71c086b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:39.969832 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b77da-3711-4811-b242-c90ed71c086b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:39.970104 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b77da-3711-4811-b242-c90ed71c086b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:39.977099 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b77da-3711-4811-b242-c90ed71c086b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:39.978545 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b77da-3711-4811-b242-c90ed71c086b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:39.992692 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-9f6b77da-3711-4811-b242-c90ed71c086b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:39.992692 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:39.992692 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:39.992692 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:39.992692 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:39.992692 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:39.992692 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:39.992692 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:39.992692 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:39.992692 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:39.992692 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:39.992692 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:39.992692 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:39.992692 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:39.992692 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:39.993700 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:39.994639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:39.994639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:39.994639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:39.994639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:39.994639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:39.994639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:39.994639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:39.994639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:39.994639 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 527/1034] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:40.000586 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b77da-3711-4811-b242-c90ed71c086b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:40.020883 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aea31e-4f6b-4f30-a053-f3719c6e3f6d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:40.057756 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:40.059864 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81e07d-6cf7-4a42-bb1f-40792fa230f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:40.060728 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81e07d-6cf7-4a42-bb1f-40792fa230f2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:40.060958 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81e07d-6cf7-4a42-bb1f-40792fa230f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:40.061227 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81e07d-6cf7-4a42-bb1f-40792fa230f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:40.062400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81e07d-6cf7-4a42-bb1f-40792fa230f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:40.063890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81e07d-6cf7-4a42-bb1f-40792fa230f2 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:40.065519 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 508/1035] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:40.071646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81e07d-6cf7-4a42-bb1f-40792fa230f2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:40.105155 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b77da-3711-4811-b242-c90ed71c086b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:40.140790 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea94ec-91a3-4b50-86c9-5f75b3125c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:40.141461 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea94ec-91a3-4b50-86c9-5f75b3125c05 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:40.141748 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea94ec-91a3-4b50-86c9-5f75b3125c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:40.142019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea94ec-91a3-4b50-86c9-5f75b3125c05 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:40.142810 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea94ec-91a3-4b50-86c9-5f75b3125c05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:40.143121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea94ec-91a3-4b50-86c9-5f75b3125c05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:40.144603 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea94ec-91a3-4b50-86c9-5f75b3125c05 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:40.156429 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 528/1036] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:40.162555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea94ec-91a3-4b50-86c9-5f75b3125c05 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:40.175890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81e07d-6cf7-4a42-bb1f-40792fa230f2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:40.189644 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:40.212963 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd698053-87b3-4420-b50f-3e4009b20928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:40.213637 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698053-87b3-4420-b50f-3e4009b20928 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:40.213914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698053-87b3-4420-b50f-3e4009b20928 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:40.214186 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd698053-87b3-4420-b50f-3e4009b20928 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:40.214896 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd698053-87b3-4420-b50f-3e4009b20928 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:40.216378 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd698053-87b3-4420-b50f-3e4009b20928 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:40.237328 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 509/1037] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 00:59:40 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 00:59:40.238624 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0464db-c701-499b-9385-49dbad268337 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:40.238919 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0464db-c701-499b-9385-49dbad268337 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:40.239201 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0464db-c701-499b-9385-49dbad268337 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:40.240660 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 510/1038] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:40.246488 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56434ef-bb2c-460d-87d3-1d292ef0c610 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:40.246851 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56434ef-bb2c-460d-87d3-1d292ef0c610 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:40.247336 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56434ef-bb2c-460d-87d3-1d292ef0c610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:40.265316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d56434ef-bb2c-460d-87d3-1d292ef0c610 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:40.265587 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea94ec-91a3-4b50-86c9-5f75b3125c05 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:40.266538 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d56434ef-bb2c-460d-87d3-1d292ef0c610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:40.281973 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:40.305678 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d33b0b-a440-400f-baea-3a08895bb85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:40.306360 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d33b0b-a440-400f-baea-3a08895bb85b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:40.306650 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d33b0b-a440-400f-baea-3a08895bb85b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:40.307137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d33b0b-a440-400f-baea-3a08895bb85b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:40.308006 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d33b0b-a440-400f-baea-3a08895bb85b None admin] RBAC: Adding query filter params (role.id=f979bbbf2c2245abab79b296097bda95, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=6c32c443ee1a421e98e7656e8e86e27a) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:40.309093 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d33b0b-a440-400f-baea-3a08895bb85b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:40.310011 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d33b0b-a440-400f-baea-3a08895bb85b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:40.316583 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 529/1039] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:59:40 2022] GET /identity/v3/role_assignments?user.id=6c32c443ee1a421e98e7656e8e86e27a&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=f979bbbf2c2245abab79b296097bda95 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:40.350206 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 511/1040] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:40 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:40.373898 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d33b0b-a440-400f-baea-3a08895bb85b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:40.488389 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d33b0b-a440-400f-baea-3a08895bb85b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:40.523178 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616bab2-ef3c-451c-999a-52a3fe89587a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:40.524031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616bab2-ef3c-451c-999a-52a3fe89587a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:40.524320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616bab2-ef3c-451c-999a-52a3fe89587a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:40.524591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616bab2-ef3c-451c-999a-52a3fe89587a None admin] PATH_INFO: `/v3/services/image` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:40.525242 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616bab2-ef3c-451c-999a-52a3fe89587a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:40.526653 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616bab2-ef3c-451c-999a-52a3fe89587a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-e616bab2-ef3c-451c-999a-52a3fe89587a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:40.538781 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:40.540145 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:40.541265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:40.541265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:40.541265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:40.541265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:40.541265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:40.541265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:40.541265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:40.541265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:40.541265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:40.541265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:40.541265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:40.541265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:40.541265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:59:40.541265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:40.541265 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 530/1041] 10.222.0.42 () {56 vars in 1105 bytes} [Sun Jul 24 00:59:40 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:40.548425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56434ef-bb2c-460d-87d3-1d292ef0c610 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:40.650058 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:40.654951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56434ef-bb2c-460d-87d3-1d292ef0c610 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:40.691157 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b8c80-0b6a-4deb-810a-b132ee9e4c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:40.692347 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b8c80-0b6a-4deb-810a-b132ee9e4c74 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:40.692704 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b8c80-0b6a-4deb-810a-b132ee9e4c74 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:40.693054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0b8c80-0b6a-4deb-810a-b132ee9e4c74 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:40.693843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b8c80-0b6a-4deb-810a-b132ee9e4c74 None admin] RBAC: Adding query filter params (name=image) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:40.694226 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b8c80-0b6a-4deb-810a-b132ee9e4c74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:40.695771 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0b8c80-0b6a-4deb-810a-b132ee9e4c74 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:40.700932 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 512/1042] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:40.706784 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616bab2-ef3c-451c-999a-52a3fe89587a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:40.752494 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:40.819803 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616bab2-ef3c-451c-999a-52a3fe89587a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:40.855258 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415b722-7b3c-4067-bb4f-4b22840b4d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:40.856088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415b722-7b3c-4067-bb4f-4b22840b4d11 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:40.856466 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415b722-7b3c-4067-bb4f-4b22840b4d11 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:40.856842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7415b722-7b3c-4067-bb4f-4b22840b4d11 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:40.857641 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415b722-7b3c-4067-bb4f-4b22840b4d11 None admin] RBAC: Adding query filter params (type=image) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:40.858062 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415b722-7b3c-4067-bb4f-4b22840b4d11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:40.859552 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7415b722-7b3c-4067-bb4f-4b22840b4d11 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:40.865056 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 531/1043] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:40.870956 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b8c80-0b6a-4deb-810a-b132ee9e4c74 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:40.971921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0b8c80-0b6a-4deb-810a-b132ee9e4c74 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:41.006705 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf2ba03-543b-47aa-8b2b-4a0cd89fed6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:41.007731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2ba03-543b-47aa-8b2b-4a0cd89fed6c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:41.008153 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2ba03-543b-47aa-8b2b-4a0cd89fed6c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:41.008592 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf2ba03-543b-47aa-8b2b-4a0cd89fed6c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:41.009522 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2ba03-543b-47aa-8b2b-4a0cd89fed6c None admin] RBAC: Adding query filter params (interface=public, service_id=5f297bb646094444b239ae717d81b44d, region_id=RegionOne) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:41.009974 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2ba03-543b-47aa-8b2b-4a0cd89fed6c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:41.011541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf2ba03-543b-47aa-8b2b-4a0cd89fed6c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:41.016812 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 513/1044] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Jul 24 00:59:40 2022] GET /identity/v3/endpoints?service_id=5f297bb646094444b239ae717d81b44d&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:41.022622 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415b722-7b3c-4067-bb4f-4b22840b4d11 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:41.122530 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7415b722-7b3c-4067-bb4f-4b22840b4d11 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:41.130007 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:41.157873 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b2af1-e5e6-4810-a2a7-063146f12116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:41.158532 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b2af1-e5e6-4810-a2a7-063146f12116 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:41.158810 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b2af1-e5e6-4810-a2a7-063146f12116 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:41.159084 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b2af1-e5e6-4810-a2a7-063146f12116 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:41.159797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b2af1-e5e6-4810-a2a7-063146f12116 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:41.161232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b2af1-e5e6-4810-a2a7-063146f12116 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:41.175336 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 532/1045] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Jul 24 00:59:41 2022] GET /identity/v3/services => generated 1957 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 00:59:42.330298 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3ea81-d112-4810-8c93-89867fa8b9fe None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:42.330854 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3ea81-d112-4810-8c93-89867fa8b9fe None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:42.330854 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3ea81-d112-4810-8c93-89867fa8b9fe None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:42.332505 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 514/1046] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:42.333689 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0907a78-ad36-4c02-95b9-d1c3f78bf027 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:42.334096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0907a78-ad36-4c02-95b9-d1c3f78bf027 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:42.334265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0907a78-ad36-4c02-95b9-d1c3f78bf027 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:42.335843 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 533/1047] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:42.337487 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476e9b3-0cc1-4f6d-ae95-7fa760a3cb50 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:42.337754 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476e9b3-0cc1-4f6d-ae95-7fa760a3cb50 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:42.338054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476e9b3-0cc1-4f6d-ae95-7fa760a3cb50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:42.340525 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a4dcd-acf4-43fc-892d-f8c9f602a936 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:42.340819 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a4dcd-acf4-43fc-892d-f8c9f602a936 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:42.341102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a4dcd-acf4-43fc-892d-f8c9f602a936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:42.356101 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5476e9b3-0cc1-4f6d-ae95-7fa760a3cb50 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:42.357299 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5476e9b3-0cc1-4f6d-ae95-7fa760a3cb50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:42.358337 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fd9a4dcd-acf4-43fc-892d-f8c9f602a936 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:42.359536 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fd9a4dcd-acf4-43fc-892d-f8c9f602a936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:42.377841 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:42.435791 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 534/1048] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:42.443361 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 515/1049] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:42 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:42.459168 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a4dcd-acf4-43fc-892d-f8c9f602a936 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:42.463649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476e9b3-0cc1-4f6d-ae95-7fa760a3cb50 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:42.562605 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:42.566439 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a4dcd-acf4-43fc-892d-f8c9f602a936 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:42.571700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476e9b3-0cc1-4f6d-ae95-7fa760a3cb50 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:42.600715 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985efc3-f077-4c65-88f3-d160fdd08900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:42.601469 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985efc3-f077-4c65-88f3-d160fdd08900 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:42.601752 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985efc3-f077-4c65-88f3-d160fdd08900 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:42.602034 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985efc3-f077-4c65-88f3-d160fdd08900 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:42.606743 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c939eb-16a9-49e8-afa5-976d0e4e5b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:42.607718 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c939eb-16a9-49e8-afa5-976d0e4e5b01 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:42.608007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c939eb-16a9-49e8-afa5-976d0e4e5b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:42.608287 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c939eb-16a9-49e8-afa5-976d0e4e5b01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:42.612996 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2985efc3-f077-4c65-88f3-d160fdd08900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:42.618625 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c939eb-16a9-49e8-afa5-976d0e4e5b01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-2985efc3-f077-4c65-88f3-d160fdd08900 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:42.621538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:42.622462 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:42.623355 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:42.623355 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:42.623355 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:42.623355 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:42.623355 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:42.623355 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:42.623355 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:42.623355 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:42.623355 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:42.623355 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:42.623355 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:59:42.623355 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-e0c939eb-16a9-49e8-afa5-976d0e4e5b01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:42.626374 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:42.627362 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:42.634023 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:42.634023 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:42.634023 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:42.634023 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:42.634023 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:42.634023 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:42.634023 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:42.634023 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:42.634023 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:42.634023 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:42.634023 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:42.634023 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:42.636644 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 535/1050] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Jul 24 00:59:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:42.636804 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 516/1051] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:59:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:42.636945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985efc3-f077-4c65-88f3-d160fdd08900 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:42.637747 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c939eb-16a9-49e8-afa5-976d0e4e5b01 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:42.652760 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:42.739873 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c939eb-16a9-49e8-afa5-976d0e4e5b01 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:42.740670 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2985efc3-f077-4c65-88f3-d160fdd08900 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:42.777563 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8f275-5c8c-4cde-8fc1-03dee4e983a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:42.778249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8f275-5c8c-4cde-8fc1-03dee4e983a2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:42.778528 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8f275-5c8c-4cde-8fc1-03dee4e983a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:42.778804 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8f275-5c8c-4cde-8fc1-03dee4e983a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:42.779596 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8f275-5c8c-4cde-8fc1-03dee4e983a2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:42.779907 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8f275-5c8c-4cde-8fc1-03dee4e983a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:42.781306 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8f275-5c8c-4cde-8fc1-03dee4e983a2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:42.782273 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35fc03-6384-4b58-82e4-069e6f0577f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:42.783288 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35fc03-6384-4b58-82e4-069e6f0577f3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:42.784096 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35fc03-6384-4b58-82e4-069e6f0577f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:42.784531 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f35fc03-6384-4b58-82e4-069e6f0577f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:42.785434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35fc03-6384-4b58-82e4-069e6f0577f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:42.785895 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35fc03-6384-4b58-82e4-069e6f0577f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:42.788235 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f35fc03-6384-4b58-82e4-069e6f0577f3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:42.790329 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 536/1052] 10.222.0.42 () {56 vars in 1115 bytes} [Sun Jul 24 00:59:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:42.797342 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8f275-5c8c-4cde-8fc1-03dee4e983a2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:42.807276 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 517/1053] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:59:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:42.808366 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35fc03-6384-4b58-82e4-069e6f0577f3 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:42.825625 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:42.893313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:42.907216 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8f275-5c8c-4cde-8fc1-03dee4e983a2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:42.916921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f35fc03-6384-4b58-82e4-069e6f0577f3 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:42.944256 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a036474-619c-4911-b396-35b929952132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:42.945199 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a036474-619c-4911-b396-35b929952132 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:42.945483 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a036474-619c-4911-b396-35b929952132 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:42.945755 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a036474-619c-4911-b396-35b929952132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:42.955870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd1c56-36a1-43d6-b670-6658a5a4de83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:42.956425 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a036474-619c-4911-b396-35b929952132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:42.957123 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd1c56-36a1-43d6-b670-6658a5a4de83 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:42.957554 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd1c56-36a1-43d6-b670-6658a5a4de83 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:42.957876 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a036474-619c-4911-b396-35b929952132 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:42.958125 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbd1c56-36a1-43d6-b670-6658a5a4de83 None admin] PATH_INFO: `/v3/users/c253ed5d94cc497d899f0b55274ed2ff` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:42.972984 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd1c56-36a1-43d6-b670-6658a5a4de83 None admin] RBAC: Authorizing `identity:get_user(user_id=c253ed5d94cc497d899f0b55274ed2ff)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:42.974714 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbd1c56-36a1-43d6-b670-6658a5a4de83 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:42.974843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-6a036474-619c-4911-b396-35b929952132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:42.974843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:42.974843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:42.974843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:42.974843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:42.974843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:42.974843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:42.974843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:42.974843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:42.974843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:42.974843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:42.974843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:42.974843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:42.974843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:42.974843 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:42.975910 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:42.976822 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:42.976822 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:42.976822 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:42.976822 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:42.979449 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 518/1054] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:59:42 2022] GET /identity/v3/users/c253ed5d94cc497d899f0b55274ed2ff => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:42.981316 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 537/1055] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:42.982139 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd1c56-36a1-43d6-b670-6658a5a4de83 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:42.982947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a036474-619c-4911-b396-35b929952132 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:43.061664 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:43.086249 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbd1c56-36a1-43d6-b670-6658a5a4de83 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:43.087373 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a036474-619c-4911-b396-35b929952132 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:43.123254 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c4c0e-5018-4515-a632-6c35f6d16733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:43.123960 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4c0e-5018-4515-a632-6c35f6d16733 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:43.124245 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4c0e-5018-4515-a632-6c35f6d16733 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:43.124556 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351c4c0e-5018-4515-a632-6c35f6d16733 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:43.125295 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c4c0e-5018-4515-a632-6c35f6d16733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:43.125608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c4c0e-5018-4515-a632-6c35f6d16733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:43.125776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681e0f62-1f9d-4e0b-bd60-9b832afab782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:43.126391 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e0f62-1f9d-4e0b-bd60-9b832afab782 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:43.126672 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e0f62-1f9d-4e0b-bd60-9b832afab782 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:43.126945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681e0f62-1f9d-4e0b-bd60-9b832afab782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:43.127041 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351c4c0e-5018-4515-a632-6c35f6d16733 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:43.130046 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:43.140720 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 519/1056] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:43.146588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c4c0e-5018-4515-a632-6c35f6d16733 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:43.201433 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e0f62-1f9d-4e0b-bd60-9b832afab782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:43.202890 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681e0f62-1f9d-4e0b-bd60-9b832afab782 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:43.248202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351c4c0e-5018-4515-a632-6c35f6d16733 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:43.274520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:43.280888 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed6dc9a-be1d-439f-ab77-4a0aee65faa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:43.281695 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6dc9a-be1d-439f-ab77-4a0aee65faa8 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:43.281978 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6dc9a-be1d-439f-ab77-4a0aee65faa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:43.282256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed6dc9a-be1d-439f-ab77-4a0aee65faa8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:43.289759 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6dc9a-be1d-439f-ab77-4a0aee65faa8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:43.291206 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed6dc9a-be1d-439f-ab77-4a0aee65faa8 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:43.299211 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 538/1057] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:59:42 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 00:59:43.300550 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ac77b-a5f8-4654-a180-92408dc0811c None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:43.300840 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ac77b-a5f8-4654-a180-92408dc0811c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:43.301114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342ac77b-a5f8-4654-a180-92408dc0811c None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:43.303324 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 539/1058] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:43.305089 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ac77b-a5f8-4654-a180-92408dc0811c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-bed6dc9a-be1d-439f-ab77-4a0aee65faa8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:59:43.305303 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:43.306231 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:43.307219 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:43.307219 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:43.307219 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:59:43.307219 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:59:43.307219 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:59:43.307219 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:59:43.307219 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:59:43.307219 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:59:43.307219 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:59:43.307219 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:43.307219 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 520/1059] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Jul 24 00:59:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:43.308453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66bd6c-6060-473b-9a7a-50362e5f1469 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:43.308453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66bd6c-6060-473b-9a7a-50362e5f1469 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:43.308631 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c66bd6c-6060-473b-9a7a-50362e5f1469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:43.324846 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5c66bd6c-6060-473b-9a7a-50362e5f1469 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:43.326025 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5c66bd6c-6060-473b-9a7a-50362e5f1469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:43.374816 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:43.390491 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 521/1060] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:43 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:43.391316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66bd6c-6060-473b-9a7a-50362e5f1469 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:43.412767 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342ac77b-a5f8-4654-a180-92408dc0811c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:43.446001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff05ecf-d921-4bfe-a964-e013ba20416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:43.446881 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff05ecf-d921-4bfe-a964-e013ba20416d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:43.447164 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff05ecf-d921-4bfe-a964-e013ba20416d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:43.447476 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff05ecf-d921-4bfe-a964-e013ba20416d None admin] PATH_INFO: `/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:43.448645 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff05ecf-d921-4bfe-a964-e013ba20416d None admin] RBAC: Authorizing `identity:get_project(project_id=c4388c9bfe984aa0893b9ed0c544bb2e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:43.450098 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff05ecf-d921-4bfe-a964-e013ba20416d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:43.451852 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 540/1061] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:59:43 2022] GET /identity/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:43.452671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff05ecf-d921-4bfe-a964-e013ba20416d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:43.494881 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c66bd6c-6060-473b-9a7a-50362e5f1469 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:43.495906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:43.529375 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196633c9-7da8-479b-bf90-076af4d50431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:43.530056 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196633c9-7da8-479b-bf90-076af4d50431 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:43.530340 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196633c9-7da8-479b-bf90-076af4d50431 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:43.530619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196633c9-7da8-479b-bf90-076af4d50431 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:43.531510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196633c9-7da8-479b-bf90-076af4d50431 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:43.531823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196633c9-7da8-479b-bf90-076af4d50431 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:43.533279 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196633c9-7da8-479b-bf90-076af4d50431 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:43.550501 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 522/1062] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Jul 24 00:59:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:43.551335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196633c9-7da8-479b-bf90-076af4d50431 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:43.551464 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff05ecf-d921-4bfe-a964-e013ba20416d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:43.588291 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3fdbd-8bda-4b86-a4ea-b9b4e7e46e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:43.589087 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3fdbd-8bda-4b86-a4ea-b9b4e7e46e83 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:43.589378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3fdbd-8bda-4b86-a4ea-b9b4e7e46e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:43.589651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd3fdbd-8bda-4b86-a4ea-b9b4e7e46e83 None admin] PATH_INFO: `/v3/services/image` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:43.590299 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3fdbd-8bda-4b86-a4ea-b9b4e7e46e83 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:43.591709 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd3fdbd-8bda-4b86-a4ea-b9b4e7e46e83 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:43.597385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-efd3fdbd-8bda-4b86-a4ea-b9b4e7e46e83 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:43.603048 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:43.604338 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:43.605431 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:43.605431 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:43.605431 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:43.605431 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:43.605431 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:43.605431 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:43.605431 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:43.605431 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:43.605431 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:43.605431 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:43.605431 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 00:59:43.605431 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 00:59:43.605431 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 24 00:59:43.605431 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:43.605431 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 541/1063] 10.222.0.42 () {56 vars in 1105 bytes} [Sun Jul 24 00:59:43 2022] GET /identity/v3/services/image => generated 86 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:43.606337 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3fdbd-8bda-4b86-a4ea-b9b4e7e46e83 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:43.655699 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196633c9-7da8-479b-bf90-076af4d50431 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:43.689484 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb88a58-739f-4ee7-93c3-aa21ca0ce889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:43.690454 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb88a58-739f-4ee7-93c3-aa21ca0ce889 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:43.690738 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb88a58-739f-4ee7-93c3-aa21ca0ce889 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:43.691015 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb88a58-739f-4ee7-93c3-aa21ca0ce889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:43.692256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb88a58-739f-4ee7-93c3-aa21ca0ce889 None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=c4388c9bfe984aa0893b9ed0c544bb2e, user.id=c253ed5d94cc497d899f0b55274ed2ff) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:43.692569 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb88a58-739f-4ee7-93c3-aa21ca0ce889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:43.694014 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb88a58-739f-4ee7-93c3-aa21ca0ce889 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:43.699378 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 523/1064] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:59:43 2022] GET /identity/v3/role_assignments?user.id=c253ed5d94cc497d899f0b55274ed2ff&scope.project.id=c4388c9bfe984aa0893b9ed0c544bb2e&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:43.700148 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb88a58-739f-4ee7-93c3-aa21ca0ce889 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:43.701622 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd3fdbd-8bda-4b86-a4ea-b9b4e7e46e83 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:43.710443 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:43.742267 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a79df-e6ee-4306-a1c6-6c2c398cc4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:43.743103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a79df-e6ee-4306-a1c6-6c2c398cc4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:43.743571 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a79df-e6ee-4306-a1c6-6c2c398cc4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:43.743852 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1a79df-e6ee-4306-a1c6-6c2c398cc4c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:43.758390 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a79df-e6ee-4306-a1c6-6c2c398cc4c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:43.759941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1a79df-e6ee-4306-a1c6-6c2c398cc4c7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:43.779152 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-7d1a79df-e6ee-4306-a1c6-6c2c398cc4c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:43.779152 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:43.779152 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:43.779152 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:43.779152 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:43.779152 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:43.779152 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:43.779152 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:43.779152 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:43.779152 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:43.779152 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:43.779152 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:43.779152 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:43.779152 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:43.779152 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:43.780343 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:43.781265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:43.781265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:43.781265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:43.781265 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:43.785871 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 542/1065] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:43.786490 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a79df-e6ee-4306-a1c6-6c2c398cc4c7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:43.814640 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb88a58-739f-4ee7-93c3-aa21ca0ce889 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:43.828517 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:43.857857 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a6de8-93f1-42e8-9f59-37b328800247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:43.858543 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a6de8-93f1-42e8-9f59-37b328800247 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:43.858827 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a6de8-93f1-42e8-9f59-37b328800247 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:43.859101 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a6de8-93f1-42e8-9f59-37b328800247 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:43.859876 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a6de8-93f1-42e8-9f59-37b328800247 None admin] RBAC: Adding query filter params (name=image) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:43.860186 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a6de8-93f1-42e8-9f59-37b328800247 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:43.861584 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a6de8-93f1-42e8-9f59-37b328800247 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:43.867351 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 524/1066] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:43.873387 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a6de8-93f1-42e8-9f59-37b328800247 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:43.899459 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1a79df-e6ee-4306-a1c6-6c2c398cc4c7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:43.935823 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5db890-f048-43ce-aae4-a989eeb0e70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:43.936505 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5db890-f048-43ce-aae4-a989eeb0e70e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:43.936788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5db890-f048-43ce-aae4-a989eeb0e70e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:43.937064 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5db890-f048-43ce-aae4-a989eeb0e70e None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:43.937790 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5db890-f048-43ce-aae4-a989eeb0e70e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:43.938100 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5db890-f048-43ce-aae4-a989eeb0e70e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:43.939578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5db890-f048-43ce-aae4-a989eeb0e70e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:43.955848 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 543/1067] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:43.956910 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5db890-f048-43ce-aae4-a989eeb0e70e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:43.977355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:43.987115 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a6de8-93f1-42e8-9f59-37b328800247 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:44.026739 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2901b-1a00-42c1-9d17-4e12863e6428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:44.027559 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2901b-1a00-42c1-9d17-4e12863e6428 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:44.027767 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2901b-1a00-42c1-9d17-4e12863e6428 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:44.027999 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e2901b-1a00-42c1-9d17-4e12863e6428 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:44.028708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2901b-1a00-42c1-9d17-4e12863e6428 None admin] RBAC: Adding query filter params (type=image) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:44.029017 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2901b-1a00-42c1-9d17-4e12863e6428 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:44.030399 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e2901b-1a00-42c1-9d17-4e12863e6428 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:44.035622 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 525/1068] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:44.041571 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2901b-1a00-42c1-9d17-4e12863e6428 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:44.063218 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5db890-f048-43ce-aae4-a989eeb0e70e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:44.081926 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:44.096952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2b82b-9d80-4bec-bec1-db288afd4435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:44.097776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b82b-9d80-4bec-bec1-db288afd4435 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:44.098060 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b82b-9d80-4bec-bec1-db288afd4435 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:44.098339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2b82b-9d80-4bec-bec1-db288afd4435 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:44.105244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2b82b-9d80-4bec-bec1-db288afd4435 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:44.106712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2b82b-9d80-4bec-bec1-db288afd4435 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:44.121075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-d8b2b82b-9d80-4bec-bec1-db288afd4435 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:44.121075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:44.121075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:44.121075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:44.121075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:44.121075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:44.121075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:44.121075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:44.121075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:44.121075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:44.121075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:44.121075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:44.121075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:44.121075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:44.121075 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:44.122192 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:44.123172 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:44.123172 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:44.123172 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:44.123172 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:44.123172 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:44.123172 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:44.123172 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:44.123172 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:44.123172 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 544/1069] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:44.127981 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2b82b-9d80-4bec-bec1-db288afd4435 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:44.169424 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e2901b-1a00-42c1-9d17-4e12863e6428 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:44.204717 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb45689-793a-4b98-bca3-b7aa1728465f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:44.205392 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb45689-793a-4b98-bca3-b7aa1728465f None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:44.205676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb45689-793a-4b98-bca3-b7aa1728465f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:44.205953 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb45689-793a-4b98-bca3-b7aa1728465f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:44.206675 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:44.206795 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb45689-793a-4b98-bca3-b7aa1728465f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:44.208543 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb45689-793a-4b98-bca3-b7aa1728465f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:44.229150 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 526/1070] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Jul 24 00:59:44 2022] POST /identity/v3/endpoints => generated 327 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:59:44.235547 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2b82b-9d80-4bec-bec1-db288afd4435 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:44.277904 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4544489-f5d2-4fa6-b8a5-44808aec0328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:44.278598 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4544489-f5d2-4fa6-b8a5-44808aec0328 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:44.278886 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4544489-f5d2-4fa6-b8a5-44808aec0328 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:44.279231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4544489-f5d2-4fa6-b8a5-44808aec0328 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:44.280083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4544489-f5d2-4fa6-b8a5-44808aec0328 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:44.280407 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4544489-f5d2-4fa6-b8a5-44808aec0328 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:44.281993 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4544489-f5d2-4fa6-b8a5-44808aec0328 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:44.300621 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 545/1071] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:44.302663 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb45689-793a-4b98-bca3-b7aa1728465f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:44.410382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:44.420340 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb45689-793a-4b98-bca3-b7aa1728465f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:44.458222 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f69d48-4b43-4464-8aee-2e2ccc62398b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:44.459040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f69d48-4b43-4464-8aee-2e2ccc62398b None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:44.459350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f69d48-4b43-4464-8aee-2e2ccc62398b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:44.459629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f69d48-4b43-4464-8aee-2e2ccc62398b None admin] PATH_INFO: `/v3/projects/604801625292482a9fb4b70c416dc438/users/6c32c443ee1a421e98e7656e8e86e27a/roles/f979bbbf2c2245abab79b296097bda95` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:44.461872 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f69d48-4b43-4464-8aee-2e2ccc62398b None admin] RBAC: Authorizing `identity:create_grant(project_id=604801625292482a9fb4b70c416dc438, user_id=6c32c443ee1a421e98e7656e8e86e27a, role_id=f979bbbf2c2245abab79b296097bda95)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:44.463344 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f69d48-4b43-4464-8aee-2e2ccc62398b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:44.478983 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 527/1072] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:59:44 2022] PUT /identity/v3/projects/604801625292482a9fb4b70c416dc438/users/6c32c443ee1a421e98e7656e8e86e27a/roles/f979bbbf2c2245abab79b296097bda95 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:59:45.681332 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9886d-3d77-4427-9cd2-8c073a228e19 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:45.681883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9886d-3d77-4427-9cd2-8c073a228e19 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:45.681883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e9886d-3d77-4427-9cd2-8c073a228e19 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:45.683232 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 546/1073] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:45.688759 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ee93e-f24e-4420-8eb2-36d8643f63de None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:45.689168 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ee93e-f24e-4420-8eb2-36d8643f63de None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:45.689264 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ee93e-f24e-4420-8eb2-36d8643f63de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:45.706774 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5b0ee93e-f24e-4420-8eb2-36d8643f63de None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:45.707981 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5b0ee93e-f24e-4420-8eb2-36d8643f63de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:45.775872 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 528/1074] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:45.798948 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9886d-3d77-4427-9cd2-8c073a228e19 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:45.906822 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e9886d-3d77-4427-9cd2-8c073a228e19 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:45.940774 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8555d5-8d15-4954-a924-d3e32d729c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:45.941942 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8555d5-8d15-4954-a924-d3e32d729c22 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:45.942227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8555d5-8d15-4954-a924-d3e32d729c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:45.942501 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8555d5-8d15-4954-a924-d3e32d729c22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:45.944522 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:45.954206 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8555d5-8d15-4954-a924-d3e32d729c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-1e8555d5-8d15-4954-a924-d3e32d729c22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:45.961984 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:45.963057 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:45.964270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:45.964270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:45.964270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:45.964270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:45.964270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:45.964270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:45.964270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:45.964270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:45.964270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:45.964270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:45.964270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:45.964270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:45.964270 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 547/1075] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:59:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:45.969171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ee93e-f24e-4420-8eb2-36d8643f63de None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:46.051122 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:46.072126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ee93e-f24e-4420-8eb2-36d8643f63de None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:46.106771 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e285b-2da7-463f-967c-00923c1af2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:46.107476 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e285b-2da7-463f-967c-00923c1af2e4 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:46.107762 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e285b-2da7-463f-967c-00923c1af2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:46.108253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e285b-2da7-463f-967c-00923c1af2e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:46.109004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e285b-2da7-463f-967c-00923c1af2e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:46.109305 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e285b-2da7-463f-967c-00923c1af2e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:46.110673 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e285b-2da7-463f-967c-00923c1af2e4 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:46.120717 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 529/1076] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:59:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:46.125428 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8555d5-8d15-4954-a924-d3e32d729c22 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:46.229568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8555d5-8d15-4954-a924-d3e32d729c22 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:46.263215 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ae0e7-6643-4719-be08-ea7cbcf633e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:46.264459 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ae0e7-6643-4719-be08-ea7cbcf633e7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:46.264916 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ae0e7-6643-4719-be08-ea7cbcf633e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:46.265373 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ae0e7-6643-4719-be08-ea7cbcf633e7 None admin] PATH_INFO: `/v3/users/c253ed5d94cc497d899f0b55274ed2ff` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:46.266736 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ae0e7-6643-4719-be08-ea7cbcf633e7 None admin] RBAC: Authorizing `identity:get_user(user_id=c253ed5d94cc497d899f0b55274ed2ff)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:46.268397 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ae0e7-6643-4719-be08-ea7cbcf633e7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:46.276295 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e285b-2da7-463f-967c-00923c1af2e4 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:46.276635 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 548/1077] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:59:46 2022] GET /identity/v3/users/c253ed5d94cc497d899f0b55274ed2ff => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:46.298744 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049205f-8443-4ff9-b7a2-06e37831acbf None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:46.299046 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049205f-8443-4ff9-b7a2-06e37831acbf None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:46.299318 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1049205f-8443-4ff9-b7a2-06e37831acbf None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:46.300987 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 549/1078] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:46.306574 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12b846-03c6-4a4c-bc63-50b24210b547 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:46.306869 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12b846-03c6-4a4c-bc63-50b24210b547 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:46.307124 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12b846-03c6-4a4c-bc63-50b24210b547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:46.324246 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2f12b846-03c6-4a4c-bc63-50b24210b547 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:46.325480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2f12b846-03c6-4a4c-bc63-50b24210b547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:46.382812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e285b-2da7-463f-967c-00923c1af2e4 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:46.396095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:46.409456 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 550/1079] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:46.418407 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c2b8f-b9e0-4910-b16e-f027fbf8bae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:46.419289 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c2b8f-b9e0-4910-b16e-f027fbf8bae5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:46.419602 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c2b8f-b9e0-4910-b16e-f027fbf8bae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:46.419890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c2b8f-b9e0-4910-b16e-f027fbf8bae5 None admin] PATH_INFO: `/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:46.421083 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c2b8f-b9e0-4910-b16e-f027fbf8bae5 None admin] RBAC: Authorizing `identity:get_project(project_id=c4388c9bfe984aa0893b9ed0c544bb2e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:46.422539 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c2b8f-b9e0-4910-b16e-f027fbf8bae5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:46.429419 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 530/1080] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:59:46 2022] GET /identity/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:46.430452 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12b846-03c6-4a4c-bc63-50b24210b547 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:46.431515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c2b8f-b9e0-4910-b16e-f027fbf8bae5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:46.448870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:46.532539 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12b846-03c6-4a4c-bc63-50b24210b547 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:46.545110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c2b8f-b9e0-4910-b16e-f027fbf8bae5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:46.565302 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57209a22-02db-43f3-86e9-34dbfbaec054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:46.566206 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57209a22-02db-43f3-86e9-34dbfbaec054 None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:46.566845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57209a22-02db-43f3-86e9-34dbfbaec054 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:46.567130 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57209a22-02db-43f3-86e9-34dbfbaec054 None admin] PATH_INFO: `/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e/users/c253ed5d94cc497d899f0b55274ed2ff/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:46.569144 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57209a22-02db-43f3-86e9-34dbfbaec054 None admin] RBAC: Authorizing `identity:create_grant(project_id=c4388c9bfe984aa0893b9ed0c544bb2e, user_id=c253ed5d94cc497d899f0b55274ed2ff, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:46.570630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57209a22-02db-43f3-86e9-34dbfbaec054 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:46.578306 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0da262-4400-4079-a0e1-921f8fc9f37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:46.579114 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0da262-4400-4079-a0e1-921f8fc9f37f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:46.579408 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0da262-4400-4079-a0e1-921f8fc9f37f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:46.579749 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0da262-4400-4079-a0e1-921f8fc9f37f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:46.583872 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 551/1081] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:59:46 2022] PUT /identity/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e/users/c253ed5d94cc497d899f0b55274ed2ff/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 00:59:46.585192 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c65846-eeae-4723-a0c8-a823f82a8386 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:46.585481 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c65846-eeae-4723-a0c8-a823f82a8386 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:46.585759 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c65846-eeae-4723-a0c8-a823f82a8386 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:46.587033 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 552/1082] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:46.592764 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d285556-47da-4c72-b37d-b652afc3ac93 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:46.593053 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d285556-47da-4c72-b37d-b652afc3ac93 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:46.593330 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d285556-47da-4c72-b37d-b652afc3ac93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:46.611450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9d285556-47da-4c72-b37d-b652afc3ac93 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:46.612698 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9d285556-47da-4c72-b37d-b652afc3ac93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:46.667860 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:46.668203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0da262-4400-4079-a0e1-921f8fc9f37f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:46.670163 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0da262-4400-4079-a0e1-921f8fc9f37f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:46.687368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:46.694487 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 553/1083] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 00:59:46.718530 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d285556-47da-4c72-b37d-b652afc3ac93 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:46.790355 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 531/1084] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:59:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 00:59:46.798614 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0da262-4400-4079-a0e1-921f8fc9f37f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:46.826969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d285556-47da-4c72-b37d-b652afc3ac93 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:46.863430 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312747db-4a46-4ab2-9134-4287e141970c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:46.864346 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312747db-4a46-4ab2-9134-4287e141970c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:46.864639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312747db-4a46-4ab2-9134-4287e141970c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:46.864918 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312747db-4a46-4ab2-9134-4287e141970c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:46.875593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312747db-4a46-4ab2-9134-4287e141970c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-312747db-4a46-4ab2-9134-4287e141970c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:46.884044 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:46.885040 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:46.885921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:46.885921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:46.885921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:46.885921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:46.885921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:46.885921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:46.885921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:46.885921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:46.885921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:46.885921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:46.885921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 24 00:59:46.885921 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:46.890384 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 554/1085] 10.222.0.42 () {56 vars in 1120 bytes} [Sun Jul 24 00:59:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:46.891672 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312747db-4a46-4ab2-9134-4287e141970c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:46.905709 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0da262-4400-4079-a0e1-921f8fc9f37f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:46.919254 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:46.937708 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:46.946536 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0605b89-55bf-4e47-a575-0a0a4067f9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:46.947371 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605b89-55bf-4e47-a575-0a0a4067f9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:46.948061 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605b89-55bf-4e47-a575-0a0a4067f9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:46.948344 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0605b89-55bf-4e47-a575-0a0a4067f9e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:46.961032 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0605b89-55bf-4e47-a575-0a0a4067f9e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:46.962950 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0605b89-55bf-4e47-a575-0a0a4067f9e1 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:46.983535 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-b0605b89-55bf-4e47-a575-0a0a4067f9e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:46.983535 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:46.983535 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:46.983535 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:46.983535 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:46.983535 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:46.983535 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:46.983535 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:46.983535 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:46.983535 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:46.983535 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:46.983535 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:46.983535 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:46.983535 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:46.983535 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:46.984508 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:46.985455 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:46.985455 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:46.985455 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:46.985455 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:46.985455 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 532/1086] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:46.990860 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0605b89-55bf-4e47-a575-0a0a4067f9e1 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:46.999310 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312747db-4a46-4ab2-9134-4287e141970c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:47.033929 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c8f1e-11fd-40d5-90cd-340de20032da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:47.034914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c8f1e-11fd-40d5-90cd-340de20032da None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:47.035427 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c8f1e-11fd-40d5-90cd-340de20032da None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:47.035879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c8f1e-11fd-40d5-90cd-340de20032da None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:47.036791 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c8f1e-11fd-40d5-90cd-340de20032da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:47.037296 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c8f1e-11fd-40d5-90cd-340de20032da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:47.038926 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c8f1e-11fd-40d5-90cd-340de20032da None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:47.051420 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 555/1087] 10.222.0.42 () {56 vars in 1115 bytes} [Sun Jul 24 00:59:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:47.054443 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c8f1e-11fd-40d5-90cd-340de20032da None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:47.101341 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0605b89-55bf-4e47-a575-0a0a4067f9e1 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:47.135257 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032defe-8ba0-4bfb-891b-675fc60a534a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:47.135957 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032defe-8ba0-4bfb-891b-675fc60a534a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:47.136245 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032defe-8ba0-4bfb-891b-675fc60a534a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:47.136525 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d032defe-8ba0-4bfb-891b-675fc60a534a None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:47.137251 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032defe-8ba0-4bfb-891b-675fc60a534a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:47.137558 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032defe-8ba0-4bfb-891b-675fc60a534a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:47.138963 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d032defe-8ba0-4bfb-891b-675fc60a534a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:47.150309 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 533/1088] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:47.172110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c8f1e-11fd-40d5-90cd-340de20032da None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:47.175875 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:47.213612 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1097f40-961b-4889-a685-45581534cf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:47.214445 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1097f40-961b-4889-a685-45581534cf47 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:47.214728 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1097f40-961b-4889-a685-45581534cf47 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:47.215007 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1097f40-961b-4889-a685-45581534cf47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:47.226990 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1097f40-961b-4889-a685-45581534cf47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:47.228522 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1097f40-961b-4889-a685-45581534cf47 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:47.248909 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-e1097f40-961b-4889-a685-45581534cf47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:47.248909 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:47.248909 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:47.248909 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:47.248909 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:47.248909 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:47.248909 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:47.248909 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:47.248909 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:47.248909 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:47.248909 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:47.248909 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:47.248909 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:47.248909 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:47.248909 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:47.249942 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:47.250902 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:47.250902 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:47.250902 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:47.250902 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:47.255187 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 556/1089] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 00:59:47.256551 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032defe-8ba0-4bfb-891b-675fc60a534a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:47.284460 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:47.366189 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d032defe-8ba0-4bfb-891b-675fc60a534a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:47.402004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb441767-6bf3-4274-8f04-ad3639370a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:47.402742 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb441767-6bf3-4274-8f04-ad3639370a93 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:47.403031 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb441767-6bf3-4274-8f04-ad3639370a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:47.403346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb441767-6bf3-4274-8f04-ad3639370a93 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:47.404065 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb441767-6bf3-4274-8f04-ad3639370a93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:47.404431 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb441767-6bf3-4274-8f04-ad3639370a93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:47.405765 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb441767-6bf3-4274-8f04-ad3639370a93 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:47.417795 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 534/1090] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:47.424301 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1097f40-961b-4889-a685-45581534cf47 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:47.529496 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1097f40-961b-4889-a685-45581534cf47 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:47.565016 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dcfe9-fd02-458f-8d01-9c559166974f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:47.565815 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dcfe9-fd02-458f-8d01-9c559166974f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:47.566101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dcfe9-fd02-458f-8d01-9c559166974f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:47.566379 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281dcfe9-fd02-458f-8d01-9c559166974f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:47.574110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dcfe9-fd02-458f-8d01-9c559166974f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:47.575606 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281dcfe9-fd02-458f-8d01-9c559166974f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-281dcfe9-fd02-458f-8d01-9c559166974f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 00:59:47.589960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:47.590950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:47.591964 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:47.591964 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:47.591964 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 00:59:47.591964 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 00:59:47.591964 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 00:59:47.591964 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 00:59:47.591964 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 00:59:47.591964 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 00:59:47.591964 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 24 00:59:47.591964 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 00:59:47.595467 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 557/1091] 10.222.0.42 () {56 vars in 1093 bytes} [Sun Jul 24 00:59:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:47.596982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb441767-6bf3-4274-8f04-ad3639370a93 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:47.683759 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:47.702482 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb441767-6bf3-4274-8f04-ad3639370a93 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:47.737972 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f530c-ae69-4c4f-b439-3c639c05130c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:47.738644 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f530c-ae69-4c4f-b439-3c639c05130c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:47.738927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f530c-ae69-4c4f-b439-3c639c05130c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:47.739211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f530c-ae69-4c4f-b439-3c639c05130c None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:47.740089 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f530c-ae69-4c4f-b439-3c639c05130c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:47.740394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f530c-ae69-4c4f-b439-3c639c05130c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:47.741873 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f530c-ae69-4c4f-b439-3c639c05130c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:47.759034 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 535/1092] 10.222.0.42 () {56 vars in 1133 bytes} [Sun Jul 24 00:59:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:47.764890 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dcfe9-fd02-458f-8d01-9c559166974f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:47.783436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:47.867908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281dcfe9-fd02-458f-8d01-9c559166974f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:47.901913 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02eb9b8-c698-4389-a546-7c7bd49299e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:47.902555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02eb9b8-c698-4389-a546-7c7bd49299e7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:47.902841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02eb9b8-c698-4389-a546-7c7bd49299e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:47.903117 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02eb9b8-c698-4389-a546-7c7bd49299e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:47.970474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02eb9b8-c698-4389-a546-7c7bd49299e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:47.971973 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02eb9b8-c698-4389-a546-7c7bd49299e7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:47.988548 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:48.070984 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 558/1093] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:59:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 00:59:48.076948 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f530c-ae69-4c4f-b439-3c639c05130c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:48.177264 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f530c-ae69-4c4f-b439-3c639c05130c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:48.212395 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76d910-2bd3-42ce-b529-04aff492fb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:48.213202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d910-2bd3-42ce-b529-04aff492fb89 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:48.213484 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d910-2bd3-42ce-b529-04aff492fb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:48.213758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b76d910-2bd3-42ce-b529-04aff492fb89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:48.224045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76d910-2bd3-42ce-b529-04aff492fb89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:48.225592 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b76d910-2bd3-42ce-b529-04aff492fb89 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:48.227403 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:48.243682 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-3b76d910-2bd3-42ce-b529-04aff492fb89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:48.243682 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:48.243682 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:48.243682 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:48.243682 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:48.243682 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:48.243682 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:48.243682 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:48.243682 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:48.243682 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:48.243682 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:48.243682 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:48.243682 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 00:59:48.243682 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 00:59:48.243682 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:48.244764 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:48.245809 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 00:59:48.245809 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 00:59:48.245809 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 00:59:48.245809 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:48.247707 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 536/1094] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:48.250578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02eb9b8-c698-4389-a546-7c7bd49299e7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:48.351270 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02eb9b8-c698-4389-a546-7c7bd49299e7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:48.367965 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:48.387370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0b92e-6815-426e-ac2f-736d0568f507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:48.388052 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0b92e-6815-426e-ac2f-736d0568f507 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:48.388332 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0b92e-6815-426e-ac2f-736d0568f507 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:48.388606 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0b92e-6815-426e-ac2f-736d0568f507 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:48.389332 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0b92e-6815-426e-ac2f-736d0568f507 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:48.389641 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0b92e-6815-426e-ac2f-736d0568f507 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:48.391036 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0b92e-6815-426e-ac2f-736d0568f507 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:48.402484 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 559/1095] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 00:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:48.408267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76d910-2bd3-42ce-b529-04aff492fb89 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:48.506364 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b76d910-2bd3-42ce-b529-04aff492fb89 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:48.540173 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea4e4e-94f6-4e47-ad2f-3c1f20f75151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:48.540973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea4e4e-94f6-4e47-ad2f-3c1f20f75151 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:48.541256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea4e4e-94f6-4e47-ad2f-3c1f20f75151 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:48.541523 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea4e4e-94f6-4e47-ad2f-3c1f20f75151 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:48.548120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea4e4e-94f6-4e47-ad2f-3c1f20f75151 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:48.549579 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea4e4e-94f6-4e47-ad2f-3c1f20f75151 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:48.563333 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-bcea4e4e-94f6-4e47-ad2f-3c1f20f75151 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:48.563333 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:48.563333 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:48.563333 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:48.563333 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:48.563333 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:48.563333 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:48.563333 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:48.563333 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:48.563333 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:48.563333 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:48.563333 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:48.563333 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 00:59:48.563333 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 00:59:48.563333 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:48.564271 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:48.565286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 00:59:48.565286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 00:59:48.565286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 00:59:48.565286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 00:59:48.565286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 00:59:48.565286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 00:59:48.565286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 00:59:48.565286 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:48.565286 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 537/1096] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 00:59:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:48.570947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0b92e-6815-426e-ac2f-736d0568f507 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:48.611732 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a45f5-f113-4a94-a308-2217625f1191 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:48.612023 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a45f5-f113-4a94-a308-2217625f1191 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:48.612330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a45f5-f113-4a94-a308-2217625f1191 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:48.613914 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 538/1097] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:48.618826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39942023-638a-40f7-ac8b-1cea5891e07e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:48.619108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39942023-638a-40f7-ac8b-1cea5891e07e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:48.619432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39942023-638a-40f7-ac8b-1cea5891e07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:48.636768 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-39942023-638a-40f7-ac8b-1cea5891e07e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:48.637973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-39942023-638a-40f7-ac8b-1cea5891e07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:48.676200 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0b92e-6815-426e-ac2f-736d0568f507 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:48.688037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:48.706397 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 539/1098] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:48.710942 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ef7f2-a30e-4190-acb1-bfe7f72373dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:48.711647 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ef7f2-a30e-4190-acb1-bfe7f72373dc None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:48.711934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ef7f2-a30e-4190-acb1-bfe7f72373dc None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:48.712214 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ef7f2-a30e-4190-acb1-bfe7f72373dc None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:48.713001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ef7f2-a30e-4190-acb1-bfe7f72373dc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:48.713314 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ef7f2-a30e-4190-acb1-bfe7f72373dc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:48.714773 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ef7f2-a30e-4190-acb1-bfe7f72373dc None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:48.726775 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 560/1099] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 00:59:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:48.730104 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39942023-638a-40f7-ac8b-1cea5891e07e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:48.732828 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ef7f2-a30e-4190-acb1-bfe7f72373dc None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:48.765327 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:48.831367 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ef7f2-a30e-4190-acb1-bfe7f72373dc None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:48.833424 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39942023-638a-40f7-ac8b-1cea5891e07e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:48.865865 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffed79-ba68-46b3-a24d-f42171be382b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:48.866636 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffed79-ba68-46b3-a24d-f42171be382b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:48.866925 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffed79-ba68-46b3-a24d-f42171be382b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:48.867223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ffed79-ba68-46b3-a24d-f42171be382b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:48.868089 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffed79-ba68-46b3-a24d-f42171be382b None admin] RBAC: Adding query filter params (role.id=f979bbbf2c2245abab79b296097bda95, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=6c32c443ee1a421e98e7656e8e86e27a) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:48.868411 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffed79-ba68-46b3-a24d-f42171be382b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:48.868776 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21eb552-5773-4363-86f3-dcdd3cd00c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:48.869589 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eb552-5773-4363-86f3-dcdd3cd00c25 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:48.869851 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ffed79-ba68-46b3-a24d-f42171be382b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:48.869947 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eb552-5773-4363-86f3-dcdd3cd00c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:48.870141 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21eb552-5773-4363-86f3-dcdd3cd00c25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:48.875865 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 561/1100] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:59:48 2022] GET /identity/v3/role_assignments?user.id=6c32c443ee1a421e98e7656e8e86e27a&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=f979bbbf2c2245abab79b296097bda95 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:48.880974 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21eb552-5773-4363-86f3-dcdd3cd00c25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-d21eb552-5773-4363-86f3-dcdd3cd00c25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 00:59:48.889096 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 00:59:48.890189 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 00:59:48.891239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 00:59:48.891239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 00:59:48.891239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 00:59:48.891239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 00:59:48.891239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 00:59:48.891239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 00:59:48.891239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 00:59:48.891239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 00:59:48.891239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 00:59:48.891239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 00:59:48.891239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 00:59:48.891239 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 00:59:48.891239 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 540/1101] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 00:59:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 00:59:48.897159 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffed79-ba68-46b3-a24d-f42171be382b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:49.005315 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:49.008960 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ffed79-ba68-46b3-a24d-f42171be382b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:49.048581 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6c1a8-ad56-4621-a190-9295f0644fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:49.049172 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6c1a8-ad56-4621-a190-9295f0644fba None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:49.049450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6c1a8-ad56-4621-a190-9295f0644fba None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:49.049706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6c1a8-ad56-4621-a190-9295f0644fba None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:49.050457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6c1a8-ad56-4621-a190-9295f0644fba None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:49.050766 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6c1a8-ad56-4621-a190-9295f0644fba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:49.052169 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6c1a8-ad56-4621-a190-9295f0644fba None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:49.060542 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 562/1102] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 00:59:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:49.067052 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21eb552-5773-4363-86f3-dcdd3cd00c25 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:49.117254 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:49.172103 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21eb552-5773-4363-86f3-dcdd3cd00c25 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:49.205772 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1d6a5-edef-49a9-ad1f-b4b17b95d3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:49.206628 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1d6a5-edef-49a9-ad1f-b4b17b95d3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:49.206911 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1d6a5-edef-49a9-ad1f-b4b17b95d3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:49.207193 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e1d6a5-edef-49a9-ad1f-b4b17b95d3d6 None admin] PATH_INFO: `/v3/users/c253ed5d94cc497d899f0b55274ed2ff` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:49.208421 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1d6a5-edef-49a9-ad1f-b4b17b95d3d6 None admin] RBAC: Authorizing `identity:get_user(user_id=c253ed5d94cc497d899f0b55274ed2ff)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:49.209915 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e1d6a5-edef-49a9-ad1f-b4b17b95d3d6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:49.211586 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 541/1103] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:59:49 2022] GET /identity/v3/users/c253ed5d94cc497d899f0b55274ed2ff => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:49.217668 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6c1a8-ad56-4621-a190-9295f0644fba None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:49.323559 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6c1a8-ad56-4621-a190-9295f0644fba None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:49.355939 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242246e1-a72a-4bd7-8bd0-9b84b1dec81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:49.356594 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242246e1-a72a-4bd7-8bd0-9b84b1dec81b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:49.356876 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242246e1-a72a-4bd7-8bd0-9b84b1dec81b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:49.357151 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242246e1-a72a-4bd7-8bd0-9b84b1dec81b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:49.387156 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:49.424166 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242246e1-a72a-4bd7-8bd0-9b84b1dec81b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:49.425641 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242246e1-a72a-4bd7-8bd0-9b84b1dec81b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:49.525750 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 563/1104] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:59:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:59:49.532217 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1d6a5-edef-49a9-ad1f-b4b17b95d3d6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:49.633153 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e1d6a5-edef-49a9-ad1f-b4b17b95d3d6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:49.646066 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:49.669079 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbc0a54-2812-4751-abce-174d2ad2b98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:49.669958 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc0a54-2812-4751-abce-174d2ad2b98e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:49.670235 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc0a54-2812-4751-abce-174d2ad2b98e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:49.670508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbc0a54-2812-4751-abce-174d2ad2b98e None admin] PATH_INFO: `/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:49.671755 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc0a54-2812-4751-abce-174d2ad2b98e None admin] RBAC: Authorizing `identity:get_project(project_id=c4388c9bfe984aa0893b9ed0c544bb2e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:49.673211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbc0a54-2812-4751-abce-174d2ad2b98e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:49.674933 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 542/1105] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:59:49 2022] GET /identity/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:49.681415 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242246e1-a72a-4bd7-8bd0-9b84b1dec81b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:49.741383 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:49.781188 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242246e1-a72a-4bd7-8bd0-9b84b1dec81b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:49.817113 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853b90a0-c66f-48e2-8dbb-700cb45bef12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:49.817775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b90a0-c66f-48e2-8dbb-700cb45bef12 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:49.818064 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b90a0-c66f-48e2-8dbb-700cb45bef12 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:49.818335 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853b90a0-c66f-48e2-8dbb-700cb45bef12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:49.819157 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b90a0-c66f-48e2-8dbb-700cb45bef12 None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=c4388c9bfe984aa0893b9ed0c544bb2e, user.id=c253ed5d94cc497d899f0b55274ed2ff) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:49.819598 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b90a0-c66f-48e2-8dbb-700cb45bef12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:49.821059 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853b90a0-c66f-48e2-8dbb-700cb45bef12 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:49.827140 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 564/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:59:49 2022] GET /identity/v3/role_assignments?user.id=c253ed5d94cc497d899f0b55274ed2ff&scope.project.id=c4388c9bfe984aa0893b9ed0c544bb2e&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:51.849139 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db6095-277c-43a0-a30b-ee88f4e135a4 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:51.849608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db6095-277c-43a0-a30b-ee88f4e135a4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:51.849698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db6095-277c-43a0-a30b-ee88f4e135a4 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:51.852074 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 543/1107] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:51.857557 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820301f1-2fb9-455c-bcff-2d2f57c040bf None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:51.857975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820301f1-2fb9-455c-bcff-2d2f57c040bf None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:51.858103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820301f1-2fb9-455c-bcff-2d2f57c040bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:51.876065 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-820301f1-2fb9-455c-bcff-2d2f57c040bf None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:51.877262 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-820301f1-2fb9-455c-bcff-2d2f57c040bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:51.945762 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 565/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:51.970312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db6095-277c-43a0-a30b-ee88f4e135a4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:52.074646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db6095-277c-43a0-a30b-ee88f4e135a4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:52.109562 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c593af5-a847-4f76-bfb4-464957d48c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:52.110347 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c593af5-a847-4f76-bfb4-464957d48c4a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:52.110635 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c593af5-a847-4f76-bfb4-464957d48c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:52.110913 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c593af5-a847-4f76-bfb4-464957d48c4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:52.112233 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c593af5-a847-4f76-bfb4-464957d48c4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:52.113697 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c593af5-a847-4f76-bfb4-464957d48c4a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:52.115318 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 544/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 00:59:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:52.121274 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820301f1-2fb9-455c-bcff-2d2f57c040bf None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:52.184498 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:52.235968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820301f1-2fb9-455c-bcff-2d2f57c040bf None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:52.278930 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a91127c-de16-48d4-bd44-4eff64cae36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:52.279624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91127c-de16-48d4-bd44-4eff64cae36b None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:52.279908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91127c-de16-48d4-bd44-4eff64cae36b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:52.280185 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a91127c-de16-48d4-bd44-4eff64cae36b None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:52.280894 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91127c-de16-48d4-bd44-4eff64cae36b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:52.282326 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a91127c-de16-48d4-bd44-4eff64cae36b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:52.307412 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 566/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 00:59:52 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 00:59:54.384967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be04419-0c09-4fab-8eef-21005a3f015b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:54.385827 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be04419-0c09-4fab-8eef-21005a3f015b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:54.385827 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be04419-0c09-4fab-8eef-21005a3f015b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:54.388081 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 545/1111] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:54.394319 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b33ab4-75bf-4625-bc12-b7ef855c6be0 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:54.394749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b33ab4-75bf-4625-bc12-b7ef855c6be0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:54.394872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b33ab4-75bf-4625-bc12-b7ef855c6be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:54.419223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a4b33ab4-75bf-4625-bc12-b7ef855c6be0 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:54.420452 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a4b33ab4-75bf-4625-bc12-b7ef855c6be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:54.489009 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 567/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:54.519899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be04419-0c09-4fab-8eef-21005a3f015b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:54.573792 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:54.633021 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be04419-0c09-4fab-8eef-21005a3f015b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:54.667259 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab852de3-a5bd-4321-a57e-9e1d5b3afd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:54.668083 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab852de3-a5bd-4321-a57e-9e1d5b3afd88 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:54.668365 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab852de3-a5bd-4321-a57e-9e1d5b3afd88 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:54.668638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab852de3-a5bd-4321-a57e-9e1d5b3afd88 None admin] PATH_INFO: `/v3/roles/e7e71ae9fccc4607808005a2e261bab1` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:54.670211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab852de3-a5bd-4321-a57e-9e1d5b3afd88 None admin] RBAC: Authorizing `identity:get_role(role_id=e7e71ae9fccc4607808005a2e261bab1)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:54.671618 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab852de3-a5bd-4321-a57e-9e1d5b3afd88 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:54.672972 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 546/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:59:54 2022] GET /identity/v3/roles/e7e71ae9fccc4607808005a2e261bab1 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:54.681438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b33ab4-75bf-4625-bc12-b7ef855c6be0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:54.726050 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:54.783899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b33ab4-75bf-4625-bc12-b7ef855c6be0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:54.822962 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154aecb-3105-4117-b750-9883cf73adff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:54.823960 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154aecb-3105-4117-b750-9883cf73adff None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:54.824243 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154aecb-3105-4117-b750-9883cf73adff None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:54.824520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154aecb-3105-4117-b750-9883cf73adff None admin] PATH_INFO: `/v3/users/df8604f6768e4333862f27bd87bdf86d` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:54.839585 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154aecb-3105-4117-b750-9883cf73adff None admin] RBAC: Authorizing `identity:get_user(user_id=df8604f6768e4333862f27bd87bdf86d)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:54.841048 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154aecb-3105-4117-b750-9883cf73adff None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:54.842729 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 568/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:59:54 2022] GET /identity/v3/users/df8604f6768e4333862f27bd87bdf86d => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 00:59:54.848938 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab852de3-a5bd-4321-a57e-9e1d5b3afd88 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:54.952463 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab852de3-a5bd-4321-a57e-9e1d5b3afd88 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:54.968469 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:54.988492 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f752533-3a5b-4a64-b9e8-d5fad924eb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:54.989135 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f752533-3a5b-4a64-b9e8-d5fad924eb4e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:54.989420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f752533-3a5b-4a64-b9e8-d5fad924eb4e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:54.989696 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f752533-3a5b-4a64-b9e8-d5fad924eb4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:55.058564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f752533-3a5b-4a64-b9e8-d5fad924eb4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:55.060045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f752533-3a5b-4a64-b9e8-d5fad924eb4e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:55.160267 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 547/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 00:59:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 00:59:55.167084 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154aecb-3105-4117-b750-9883cf73adff None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:55.288929 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:55.292110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154aecb-3105-4117-b750-9883cf73adff None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:55.330864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a73b30-87e0-4087-92a3-89c48325a265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:55.331761 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a73b30-87e0-4087-92a3-89c48325a265 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:55.332044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a73b30-87e0-4087-92a3-89c48325a265 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:55.332317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a73b30-87e0-4087-92a3-89c48325a265 None admin] PATH_INFO: `/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:55.333605 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a73b30-87e0-4087-92a3-89c48325a265 None admin] RBAC: Authorizing `identity:get_project(project_id=c4388c9bfe984aa0893b9ed0c544bb2e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:55.335181 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a73b30-87e0-4087-92a3-89c48325a265 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:55.337020 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 569/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:59:55 2022] GET /identity/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:55.346988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f752533-3a5b-4a64-b9e8-d5fad924eb4e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:55.372793 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:55.458281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f752533-3a5b-4a64-b9e8-d5fad924eb4e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:55.494799 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae28e7-9aa3-4fd4-a228-7374e65d6c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:55.495532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae28e7-9aa3-4fd4-a228-7374e65d6c49 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:55.495814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae28e7-9aa3-4fd4-a228-7374e65d6c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:55.496086 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae28e7-9aa3-4fd4-a228-7374e65d6c49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:55.496918 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae28e7-9aa3-4fd4-a228-7374e65d6c49 None admin] RBAC: Adding query filter params (role.id=e7e71ae9fccc4607808005a2e261bab1, scope.project.id=c4388c9bfe984aa0893b9ed0c544bb2e, user.id=df8604f6768e4333862f27bd87bdf86d) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 00:59:55.497232 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae28e7-9aa3-4fd4-a228-7374e65d6c49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:55.498667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae28e7-9aa3-4fd4-a228-7374e65d6c49 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:55.504201 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 548/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 00:59:55 2022] GET /identity/v3/role_assignments?user.id=df8604f6768e4333862f27bd87bdf86d&scope.project.id=c4388c9bfe984aa0893b9ed0c544bb2e&role.id=e7e71ae9fccc4607808005a2e261bab1 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:57.488034 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca89bc2-92c7-4de8-8441-b6934f230f9e None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:57.488701 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca89bc2-92c7-4de8-8441-b6934f230f9e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:57.488701 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca89bc2-92c7-4de8-8441-b6934f230f9e None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:57.490719 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 570/1118] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 00:59:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 00:59:57.499565 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d55e7-55f2-4b01-8c5f-4a5be294a3ab None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:57.499973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d55e7-55f2-4b01-8c5f-4a5be294a3ab None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:57.500191 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056d55e7-55f2-4b01-8c5f-4a5be294a3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:57.519965 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-056d55e7-55f2-4b01-8c5f-4a5be294a3ab None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 00:59:57.521187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-056d55e7-55f2-4b01-8c5f-4a5be294a3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 00:59:57.600882 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 549/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 00:59:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 00:59:57.625350 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca89bc2-92c7-4de8-8441-b6934f230f9e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:57.734435 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca89bc2-92c7-4de8-8441-b6934f230f9e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:57.769293 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79d965-1c9b-4654-9e9e-626a8e4da900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:57.770082 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79d965-1c9b-4654-9e9e-626a8e4da900 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:57.770360 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79d965-1c9b-4654-9e9e-626a8e4da900 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:57.770634 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79d965-1c9b-4654-9e9e-626a8e4da900 None admin] PATH_INFO: `/v3/roles/e7e71ae9fccc4607808005a2e261bab1` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:57.772243 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79d965-1c9b-4654-9e9e-626a8e4da900 None admin] RBAC: Authorizing `identity:get_role(role_id=e7e71ae9fccc4607808005a2e261bab1)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:57.773636 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79d965-1c9b-4654-9e9e-626a8e4da900 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:57.774997 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 571/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:59:57 2022] GET /identity/v3/roles/e7e71ae9fccc4607808005a2e261bab1 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:57.784238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d55e7-55f2-4b01-8c5f-4a5be294a3ab None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:57.797136 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:57.903879 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056d55e7-55f2-4b01-8c5f-4a5be294a3ab None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:57.940095 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d3d07-2975-436a-86d3-f821e39d8ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:57.940994 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d3d07-2975-436a-86d3-f821e39d8ebd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:57.941631 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d3d07-2975-436a-86d3-f821e39d8ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:57.941908 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d3d07-2975-436a-86d3-f821e39d8ebd None admin] PATH_INFO: `/v3/users/df8604f6768e4333862f27bd87bdf86d` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:57.943276 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d3d07-2975-436a-86d3-f821e39d8ebd None admin] RBAC: Authorizing `identity:get_user(user_id=df8604f6768e4333862f27bd87bdf86d)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:57.944906 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d3d07-2975-436a-86d3-f821e39d8ebd None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:57.946593 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 550/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 00:59:57 2022] GET /identity/v3/users/df8604f6768e4333862f27bd87bdf86d => generated 286 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:57.955774 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79d965-1c9b-4654-9e9e-626a8e4da900 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:58.001332 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:58.070604 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79d965-1c9b-4654-9e9e-626a8e4da900 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:58.104662 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7a8a82-0d65-4607-8ffe-ca7067ef6f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:58.105521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a8a82-0d65-4607-8ffe-ca7067ef6f3f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:58.105800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a8a82-0d65-4607-8ffe-ca7067ef6f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:58.106074 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7a8a82-0d65-4607-8ffe-ca7067ef6f3f None admin] PATH_INFO: `/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:58.107400 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a8a82-0d65-4607-8ffe-ca7067ef6f3f None admin] RBAC: Authorizing `identity:get_project(project_id=c4388c9bfe984aa0893b9ed0c544bb2e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:58.108844 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7a8a82-0d65-4607-8ffe-ca7067ef6f3f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:58.110532 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 572/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 00:59:57 2022] GET /identity/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 00:59:58.120125 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d3d07-2975-436a-86d3-f821e39d8ebd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 00:59:58.198054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 00:59:58.220032 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d3d07-2975-436a-86d3-f821e39d8ebd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 00:59:58.254144 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c75a03-8039-4e4b-a860-2ff0965aa63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 00:59:58.255038 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c75a03-8039-4e4b-a860-2ff0965aa63f None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 00:59:58.255335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c75a03-8039-4e4b-a860-2ff0965aa63f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 00:59:58.255620 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c75a03-8039-4e4b-a860-2ff0965aa63f None admin] PATH_INFO: `/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e/users/df8604f6768e4333862f27bd87bdf86d/roles/e7e71ae9fccc4607808005a2e261bab1` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 00:59:58.258038 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c75a03-8039-4e4b-a860-2ff0965aa63f None admin] RBAC: Authorizing `identity:create_grant(project_id=c4388c9bfe984aa0893b9ed0c544bb2e, user_id=df8604f6768e4333862f27bd87bdf86d, role_id=e7e71ae9fccc4607808005a2e261bab1)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 00:59:58.259526 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c75a03-8039-4e4b-a860-2ff0965aa63f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 00:59:58.275348 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 551/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 00:59:58 2022] PUT /identity/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e/users/df8604f6768e4333862f27bd87bdf86d/roles/e7e71ae9fccc4607808005a2e261bab1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:00:00.259343 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c1a94-d206-46b5-8575-9ba7f3da56df None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:00.259906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c1a94-d206-46b5-8575-9ba7f3da56df None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:00.259906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c1a94-d206-46b5-8575-9ba7f3da56df None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:00.262131 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 573/1124] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:00:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:00.270962 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5e3c8-8472-4553-a2b8-dfa64fedbb5a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:00.271382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5e3c8-8472-4553-a2b8-dfa64fedbb5a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:00.271603 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5e3c8-8472-4553-a2b8-dfa64fedbb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:00.294957 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-32d5e3c8-8472-4553-a2b8-dfa64fedbb5a None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:00.296192 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-32d5e3c8-8472-4553-a2b8-dfa64fedbb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:00.369411 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 552/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:00:00.398674 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c1a94-d206-46b5-8575-9ba7f3da56df None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:00.511537 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c1a94-d206-46b5-8575-9ba7f3da56df None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:00.513796 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:00.555921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8342d9-73b1-41a4-a038-0a151c1ec3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:00.556788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8342d9-73b1-41a4-a038-0a151c1ec3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:00.557075 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8342d9-73b1-41a4-a038-0a151c1ec3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:00.557357 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8342d9-73b1-41a4-a038-0a151c1ec3a9 None admin] PATH_INFO: `/v3/roles/e7e71ae9fccc4607808005a2e261bab1` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:00.558972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8342d9-73b1-41a4-a038-0a151c1ec3a9 None admin] RBAC: Authorizing `identity:get_role(role_id=e7e71ae9fccc4607808005a2e261bab1)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:00.560394 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8342d9-73b1-41a4-a038-0a151c1ec3a9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:00.561801 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 574/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 01:00:00 2022] GET /identity/v3/roles/e7e71ae9fccc4607808005a2e261bab1 => generated 223 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:00.571670 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5e3c8-8472-4553-a2b8-dfa64fedbb5a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:00.652937 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:00.689669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5e3c8-8472-4553-a2b8-dfa64fedbb5a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:00.725403 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437f0c7-7e78-487c-a840-f527f40b3021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:00.726272 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437f0c7-7e78-487c-a840-f527f40b3021 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:00.726552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437f0c7-7e78-487c-a840-f527f40b3021 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:00.726820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437f0c7-7e78-487c-a840-f527f40b3021 None admin] PATH_INFO: `/v3/users/df8604f6768e4333862f27bd87bdf86d` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:00.728054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437f0c7-7e78-487c-a840-f527f40b3021 None admin] RBAC: Authorizing `identity:get_user(user_id=df8604f6768e4333862f27bd87bdf86d)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:00.729529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e437f0c7-7e78-487c-a840-f527f40b3021 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:00.731131 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 553/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 01:00:00 2022] GET /identity/v3/users/df8604f6768e4333862f27bd87bdf86d => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:00.737514 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8342d9-73b1-41a4-a038-0a151c1ec3a9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:00.852887 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8342d9-73b1-41a4-a038-0a151c1ec3a9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:00.896596 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15db1d-b706-4929-8470-5ddedfc17ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:00.897622 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15db1d-b706-4929-8470-5ddedfc17ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:00.897911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15db1d-b706-4929-8470-5ddedfc17ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:00.898381 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15db1d-b706-4929-8470-5ddedfc17ef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:00.940184 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:00.970281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15db1d-b706-4929-8470-5ddedfc17ef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:00.971776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15db1d-b706-4929-8470-5ddedfc17ef9 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:01.075495 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 575/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 01:00:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 01:00:01.085134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437f0c7-7e78-487c-a840-f527f40b3021 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:01.191046 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e437f0c7-7e78-487c-a840-f527f40b3021 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:01.226262 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051de5c1-235c-4a87-94b9-676a83f38bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:01.227142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051de5c1-235c-4a87-94b9-676a83f38bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:01.227456 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051de5c1-235c-4a87-94b9-676a83f38bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:01.227728 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051de5c1-235c-4a87-94b9-676a83f38bf6 None admin] PATH_INFO: `/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:01.229009 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051de5c1-235c-4a87-94b9-676a83f38bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=c4388c9bfe984aa0893b9ed0c544bb2e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:01.230455 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051de5c1-235c-4a87-94b9-676a83f38bf6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:01.232143 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 554/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 01:00:01 2022] GET /identity/v3/projects/c4388c9bfe984aa0893b9ed0c544bb2e => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:01.239099 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15db1d-b706-4929-8470-5ddedfc17ef9 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:01.317845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:01.353130 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15db1d-b706-4929-8470-5ddedfc17ef9 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:01.387062 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf5710-14e9-40f5-ab22-7b5b9e3d4a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:01.387735 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf5710-14e9-40f5-ab22-7b5b9e3d4a72 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:01.388014 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf5710-14e9-40f5-ab22-7b5b9e3d4a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:01.388289 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf5710-14e9-40f5-ab22-7b5b9e3d4a72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:01.389109 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf5710-14e9-40f5-ab22-7b5b9e3d4a72 None admin] RBAC: Adding query filter params (role.id=e7e71ae9fccc4607808005a2e261bab1, scope.project.id=c4388c9bfe984aa0893b9ed0c544bb2e, user.id=df8604f6768e4333862f27bd87bdf86d) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:00:01.389420 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf5710-14e9-40f5-ab22-7b5b9e3d4a72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:01.390863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf5710-14e9-40f5-ab22-7b5b9e3d4a72 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:01.396714 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 576/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 01:00:01 2022] GET /identity/v3/role_assignments?user.id=df8604f6768e4333862f27bd87bdf86d&scope.project.id=c4388c9bfe984aa0893b9ed0c544bb2e&role.id=e7e71ae9fccc4607808005a2e261bab1 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:03.401312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02902a6f-d43a-422b-b72a-874e87d4a1a0 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:03.402214 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02902a6f-d43a-422b-b72a-874e87d4a1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:03.402214 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02902a6f-d43a-422b-b72a-874e87d4a1a0 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:03.404422 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 555/1131] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:00:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:03.412303 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342b4fd-9159-4e09-be7a-0893db73cac9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:03.412854 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342b4fd-9159-4e09-be7a-0893db73cac9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:03.412949 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4342b4fd-9159-4e09-be7a-0893db73cac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:03.430199 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4342b4fd-9159-4e09-be7a-0893db73cac9 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:03.431473 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4342b4fd-9159-4e09-be7a-0893db73cac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:03.498103 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 577/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 01:00:03.521113 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02902a6f-d43a-422b-b72a-874e87d4a1a0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:03.526648 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:03.628772 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02902a6f-d43a-422b-b72a-874e87d4a1a0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:03.666063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937aadfa-254f-4014-9364-f272ab386c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:03.666781 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aadfa-254f-4014-9364-f272ab386c50 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:03.667060 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aadfa-254f-4014-9364-f272ab386c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:03.667340 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937aadfa-254f-4014-9364-f272ab386c50 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:03.668649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937aadfa-254f-4014-9364-f272ab386c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:03.670092 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937aadfa-254f-4014-9364-f272ab386c50 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:03.671742 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 556/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:00:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:03.677822 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342b4fd-9159-4e09-be7a-0893db73cac9 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:03.743080 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:03.777944 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4342b4fd-9159-4e09-be7a-0893db73cac9 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:03.812222 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a6157f-b1d9-4a08-bf31-870133627015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:03.812882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6157f-b1d9-4a08-bf31-870133627015 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:03.813165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6157f-b1d9-4a08-bf31-870133627015 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:03.813437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a6157f-b1d9-4a08-bf31-870133627015 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:03.814468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6157f-b1d9-4a08-bf31-870133627015 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:03.815588 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a6157f-b1d9-4a08-bf31-870133627015 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:03.847502 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 578/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Jul 24 01:00:03 2022] POST /identity/v3/projects => generated 311 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:00:05.882190 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757589d-59f8-4644-b9d8-88171a4a487c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:05.882691 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757589d-59f8-4644-b9d8-88171a4a487c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:05.882691 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6757589d-59f8-4644-b9d8-88171a4a487c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:05.884146 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 557/1135] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:00:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:05.890509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5dad5-e8e6-4c0f-a364-750940fff67f None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:05.891274 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5dad5-e8e6-4c0f-a364-750940fff67f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:05.891443 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f5dad5-e8e6-4c0f-a364-750940fff67f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:05.912865 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f6f5dad5-e8e6-4c0f-a364-750940fff67f None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:05.914063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f6f5dad5-e8e6-4c0f-a364-750940fff67f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:05.985285 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 579/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:00:06.012203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757589d-59f8-4644-b9d8-88171a4a487c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:06.089467 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:06.121518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6757589d-59f8-4644-b9d8-88171a4a487c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:06.157407 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce020ae-3ac1-42cf-ac28-a5a1291e7767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:06.158205 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce020ae-3ac1-42cf-ac28-a5a1291e7767 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:06.158486 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce020ae-3ac1-42cf-ac28-a5a1291e7767 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:06.158755 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce020ae-3ac1-42cf-ac28-a5a1291e7767 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:06.159959 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce020ae-3ac1-42cf-ac28-a5a1291e7767 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:06.161420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce020ae-3ac1-42cf-ac28-a5a1291e7767 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:06.163049 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 558/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:00:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:06.169788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5dad5-e8e6-4c0f-a364-750940fff67f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:06.229896 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:06.290757 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f5dad5-e8e6-4c0f-a364-750940fff67f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:06.327703 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc7a0c9-a549-4082-986a-3461a741ef72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:06.328367 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7a0c9-a549-4082-986a-3461a741ef72 None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:06.328652 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7a0c9-a549-4082-986a-3461a741ef72 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:06.328933 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc7a0c9-a549-4082-986a-3461a741ef72 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:06.329645 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7a0c9-a549-4082-986a-3461a741ef72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:06.331103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc7a0c9-a549-4082-986a-3461a741ef72 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:06.353384 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 580/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 01:00:06 2022] POST /identity/v3/users => generated 286 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:00:08.409940 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45f0ab-1a67-47df-b721-862b72dbfcb6 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:08.410797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45f0ab-1a67-47df-b721-862b72dbfcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:08.410797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45f0ab-1a67-47df-b721-862b72dbfcb6 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:08.412954 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 559/1139] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:00:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:08.419235 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e4f9-1096-4c8c-ba84-32aece138b67 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:08.419693 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e4f9-1096-4c8c-ba84-32aece138b67 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:08.419826 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d1e4f9-1096-4c8c-ba84-32aece138b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:08.446159 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-89d1e4f9-1096-4c8c-ba84-32aece138b67 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:08.447376 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-89d1e4f9-1096-4c8c-ba84-32aece138b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:08.516093 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 581/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:00:08.548710 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45f0ab-1a67-47df-b721-862b72dbfcb6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:08.654594 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45f0ab-1a67-47df-b721-862b72dbfcb6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:08.698092 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac0ebd-238d-445a-abf0-cc6830d3027e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:08.698894 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac0ebd-238d-445a-abf0-cc6830d3027e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:08.699174 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac0ebd-238d-445a-abf0-cc6830d3027e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:08.699478 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ac0ebd-238d-445a-abf0-cc6830d3027e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:08.707961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:08.711500 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ac0ebd-238d-445a-abf0-cc6830d3027e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-c0ac0ebd-238d-445a-abf0-cc6830d3027e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 01:00:08.719710 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:00:08.720807 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:00:08.721732 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:00:08.721732 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:00:08.721732 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:00:08.721732 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:00:08.721732 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 01:00:08.721732 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 01:00:08.721732 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 01:00:08.721732 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 01:00:08.721732 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 01:00:08.721732 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:00:08.721732 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:00:08.721732 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:00:08.721732 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 560/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 01:00:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:00:08.727145 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1e4f9-1096-4c8c-ba84-32aece138b67 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:08.761047 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:08.829161 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d1e4f9-1096-4c8c-ba84-32aece138b67 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:08.863829 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af36709-9f87-4ac9-9bd3-4fc9184eeb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:08.864485 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af36709-9f87-4ac9-9bd3-4fc9184eeb2a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:08.864767 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af36709-9f87-4ac9-9bd3-4fc9184eeb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:08.865036 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af36709-9f87-4ac9-9bd3-4fc9184eeb2a None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:08.865775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af36709-9f87-4ac9-9bd3-4fc9184eeb2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:00:08.866128 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af36709-9f87-4ac9-9bd3-4fc9184eeb2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:08.867544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af36709-9f87-4ac9-9bd3-4fc9184eeb2a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:08.875640 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 582/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 01:00:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:08.882321 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac0ebd-238d-445a-abf0-cc6830d3027e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:08.995527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ac0ebd-238d-445a-abf0-cc6830d3027e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:09.030207 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee36ef2-7e96-4209-ac5b-05b95c0ab990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:09.031075 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee36ef2-7e96-4209-ac5b-05b95c0ab990 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:09.031352 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee36ef2-7e96-4209-ac5b-05b95c0ab990 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:09.031656 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee36ef2-7e96-4209-ac5b-05b95c0ab990 None admin] PATH_INFO: `/v3/users/95b02e0e3f09409fba94eda0d0665e03` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:09.045194 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee36ef2-7e96-4209-ac5b-05b95c0ab990 None admin] RBAC: Authorizing `identity:get_user(user_id=95b02e0e3f09409fba94eda0d0665e03)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:09.046682 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee36ef2-7e96-4209-ac5b-05b95c0ab990 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:09.048321 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 561/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 01:00:08 2022] GET /identity/v3/users/95b02e0e3f09409fba94eda0d0665e03 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:09.054063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af36709-9f87-4ac9-9bd3-4fc9184eeb2a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:09.148669 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:09.155662 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af36709-9f87-4ac9-9bd3-4fc9184eeb2a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:09.190718 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbc86c-67ba-4031-85be-03494e25aa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:09.191746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc86c-67ba-4031-85be-03494e25aa0d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:09.192025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc86c-67ba-4031-85be-03494e25aa0d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:09.192301 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fbc86c-67ba-4031-85be-03494e25aa0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:09.258797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbc86c-67ba-4031-85be-03494e25aa0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:09.260207 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fbc86c-67ba-4031-85be-03494e25aa0d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:09.349019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:09.356006 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 583/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 01:00:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 01:00:09.362054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee36ef2-7e96-4209-ac5b-05b95c0ab990 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:09.420017 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:09.462160 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee36ef2-7e96-4209-ac5b-05b95c0ab990 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:09.494583 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7474f-7f61-4d75-8280-11bc878b05b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:09.495491 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7474f-7f61-4d75-8280-11bc878b05b7 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:09.495777 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7474f-7f61-4d75-8280-11bc878b05b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:09.496054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7474f-7f61-4d75-8280-11bc878b05b7 None admin] PATH_INFO: `/v3/projects/16fbeceae8554a6fa2f3a7e29c7ed633` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:09.497225 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7474f-7f61-4d75-8280-11bc878b05b7 None admin] RBAC: Authorizing `identity:get_project(project_id=16fbeceae8554a6fa2f3a7e29c7ed633)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:09.498693 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7474f-7f61-4d75-8280-11bc878b05b7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:09.500555 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 562/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 01:00:09 2022] GET /identity/v3/projects/16fbeceae8554a6fa2f3a7e29c7ed633 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:09.509502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbc86c-67ba-4031-85be-03494e25aa0d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:09.608128 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fbc86c-67ba-4031-85be-03494e25aa0d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:09.645089 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0108f7f-dd07-4154-a8a0-0872cb1cf52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:09.645729 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0108f7f-dd07-4154-a8a0-0872cb1cf52b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:09.646006 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0108f7f-dd07-4154-a8a0-0872cb1cf52b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:09.646281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0108f7f-dd07-4154-a8a0-0872cb1cf52b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:09.647086 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0108f7f-dd07-4154-a8a0-0872cb1cf52b None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=16fbeceae8554a6fa2f3a7e29c7ed633, user.id=95b02e0e3f09409fba94eda0d0665e03) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:00:09.647489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0108f7f-dd07-4154-a8a0-0872cb1cf52b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:09.648923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0108f7f-dd07-4154-a8a0-0872cb1cf52b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:09.654272 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 584/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 01:00:09 2022] GET /identity/v3/role_assignments?user.id=95b02e0e3f09409fba94eda0d0665e03&scope.project.id=16fbeceae8554a6fa2f3a7e29c7ed633&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:11.759034 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146030f-7348-48d1-bcbc-5adebba342f2 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:11.759634 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146030f-7348-48d1-bcbc-5adebba342f2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:11.759727 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146030f-7348-48d1-bcbc-5adebba342f2 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:11.761830 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 563/1147] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:00:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:11.767581 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20daf2b-944d-49d8-943a-0c5b6fda537a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:11.768050 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20daf2b-944d-49d8-943a-0c5b6fda537a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:11.768163 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20daf2b-944d-49d8-943a-0c5b6fda537a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:11.786665 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f20daf2b-944d-49d8-943a-0c5b6fda537a None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:11.787892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f20daf2b-944d-49d8-943a-0c5b6fda537a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:11.850756 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:11.866386 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 585/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 01:00:11.898500 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146030f-7348-48d1-bcbc-5adebba342f2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:12.026183 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146030f-7348-48d1-bcbc-5adebba342f2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:12.052385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:12.062238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365c0f3-8768-446c-a96c-17407f896acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:12.063043 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365c0f3-8768-446c-a96c-17407f896acd None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:12.063326 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365c0f3-8768-446c-a96c-17407f896acd None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:12.063634 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365c0f3-8768-446c-a96c-17407f896acd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:12.074199 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365c0f3-8768-446c-a96c-17407f896acd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-e365c0f3-8768-446c-a96c-17407f896acd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 01:00:12.081912 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:00:12.082982 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:00:12.083925 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:00:12.083925 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:00:12.083925 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:00:12.083925 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:00:12.083925 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 01:00:12.083925 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 01:00:12.083925 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 01:00:12.083925 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 01:00:12.083925 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 01:00:12.083925 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:00:12.083925 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:00:12.083925 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:00:12.083925 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 564/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 01:00:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 01:00:12.091500 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20daf2b-944d-49d8-943a-0c5b6fda537a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:12.193117 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20daf2b-944d-49d8-943a-0c5b6fda537a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:12.227180 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcac533-13a1-4616-a8b5-f63e6bf6d238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:12.227858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcac533-13a1-4616-a8b5-f63e6bf6d238 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:12.228160 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcac533-13a1-4616-a8b5-f63e6bf6d238 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:12.228420 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcac533-13a1-4616-a8b5-f63e6bf6d238 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:12.229160 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcac533-13a1-4616-a8b5-f63e6bf6d238 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:00:12.229464 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcac533-13a1-4616-a8b5-f63e6bf6d238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:12.230824 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcac533-13a1-4616-a8b5-f63e6bf6d238 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:12.238795 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 586/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 01:00:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:12.247487 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365c0f3-8768-446c-a96c-17407f896acd None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:12.351081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365c0f3-8768-446c-a96c-17407f896acd None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:12.400856 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab5ab5-795f-4615-9854-53cfe82abf55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:12.401739 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5ab5-795f-4615-9854-53cfe82abf55 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:12.402020 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5ab5-795f-4615-9854-53cfe82abf55 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:12.402293 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab5ab5-795f-4615-9854-53cfe82abf55 None admin] PATH_INFO: `/v3/users/95b02e0e3f09409fba94eda0d0665e03` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:12.404326 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab5ab5-795f-4615-9854-53cfe82abf55 None admin] RBAC: Authorizing `identity:get_user(user_id=95b02e0e3f09409fba94eda0d0665e03)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:12.405886 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab5ab5-795f-4615-9854-53cfe82abf55 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:12.407558 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 565/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 01:00:12 2022] GET /identity/v3/users/95b02e0e3f09409fba94eda0d0665e03 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:00:12.413923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcac533-13a1-4616-a8b5-f63e6bf6d238 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:12.470784 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:12.522925 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcac533-13a1-4616-a8b5-f63e6bf6d238 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:12.559482 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b40e62-1861-4478-84d7-65bfa273726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:12.560347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40e62-1861-4478-84d7-65bfa273726a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:12.560625 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40e62-1861-4478-84d7-65bfa273726a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:12.560898 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b40e62-1861-4478-84d7-65bfa273726a None admin] PATH_INFO: `/v3/projects/16fbeceae8554a6fa2f3a7e29c7ed633` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:12.562202 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b40e62-1861-4478-84d7-65bfa273726a None admin] RBAC: Authorizing `identity:get_project(project_id=16fbeceae8554a6fa2f3a7e29c7ed633)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:12.563734 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b40e62-1861-4478-84d7-65bfa273726a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:12.565740 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 587/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 01:00:12 2022] GET /identity/v3/projects/16fbeceae8554a6fa2f3a7e29c7ed633 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:12.572530 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab5ab5-795f-4615-9854-53cfe82abf55 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:12.629764 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:12.678146 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab5ab5-795f-4615-9854-53cfe82abf55 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:12.712855 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0218723d-aa2d-486b-b844-a2e7738ee695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:12.713755 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218723d-aa2d-486b-b844-a2e7738ee695 None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:12.714041 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218723d-aa2d-486b-b844-a2e7738ee695 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:12.714300 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0218723d-aa2d-486b-b844-a2e7738ee695 None admin] PATH_INFO: `/v3/projects/16fbeceae8554a6fa2f3a7e29c7ed633/users/95b02e0e3f09409fba94eda0d0665e03/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:12.716364 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218723d-aa2d-486b-b844-a2e7738ee695 None admin] RBAC: Authorizing `identity:create_grant(project_id=16fbeceae8554a6fa2f3a7e29c7ed633, user_id=95b02e0e3f09409fba94eda0d0665e03, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:12.717817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0218723d-aa2d-486b-b844-a2e7738ee695 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:12.731470 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 566/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 01:00:12 2022] PUT /identity/v3/projects/16fbeceae8554a6fa2f3a7e29c7ed633/users/95b02e0e3f09409fba94eda0d0665e03/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:00:14.729775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9967d7a-624c-4a45-a4a5-426b3830ba33 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:14.730686 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9967d7a-624c-4a45-a4a5-426b3830ba33 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:14.730686 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9967d7a-624c-4a45-a4a5-426b3830ba33 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:14.732984 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 588/1154] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:00:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:14.739268 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7875f8-5823-4a76-9f9a-d807cc947d20 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:14.739921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7875f8-5823-4a76-9f9a-d807cc947d20 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:14.740040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7875f8-5823-4a76-9f9a-d807cc947d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:14.763596 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5f7875f8-5823-4a76-9f9a-d807cc947d20 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:14.764777 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5f7875f8-5823-4a76-9f9a-d807cc947d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:14.844632 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 567/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:00:14.868761 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9967d7a-624c-4a45-a4a5-426b3830ba33 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:14.984971 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9967d7a-624c-4a45-a4a5-426b3830ba33 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:15.007209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:15.022087 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0a7ea-bcd5-45fd-9f16-234fd4621aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:15.022941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0a7ea-bcd5-45fd-9f16-234fd4621aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:15.023226 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0a7ea-bcd5-45fd-9f16-234fd4621aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:15.023530 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0a7ea-bcd5-45fd-9f16-234fd4621aa6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:15.033537 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb0a7ea-bcd5-45fd-9f16-234fd4621aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-1bb0a7ea-bcd5-45fd-9f16-234fd4621aa6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 01:00:15.041208 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:00:15.042240 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:00:15.043268 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:00:15.043268 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:00:15.043268 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:00:15.043268 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:00:15.043268 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 01:00:15.043268 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 01:00:15.043268 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 01:00:15.043268 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 01:00:15.043268 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 01:00:15.043268 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:00:15.043268 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:00:15.043268 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:00:15.043268 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 589/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 01:00:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:00:15.048527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7875f8-5823-4a76-9f9a-d807cc947d20 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:15.096030 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:15.152154 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7875f8-5823-4a76-9f9a-d807cc947d20 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:15.187673 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60633e9d-7922-4ed4-8411-214313bb4f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:15.188335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60633e9d-7922-4ed4-8411-214313bb4f75 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:15.188618 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60633e9d-7922-4ed4-8411-214313bb4f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:15.188896 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60633e9d-7922-4ed4-8411-214313bb4f75 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:15.189640 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60633e9d-7922-4ed4-8411-214313bb4f75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:00:15.189948 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60633e9d-7922-4ed4-8411-214313bb4f75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:15.191701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60633e9d-7922-4ed4-8411-214313bb4f75 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:15.200432 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 568/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 01:00:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:15.206632 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0a7ea-bcd5-45fd-9f16-234fd4621aa6 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:15.313292 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0a7ea-bcd5-45fd-9f16-234fd4621aa6 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:15.345940 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91556182-5ff6-4a5a-8806-94496607c0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:15.346811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556182-5ff6-4a5a-8806-94496607c0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:15.347095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556182-5ff6-4a5a-8806-94496607c0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:15.347394 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91556182-5ff6-4a5a-8806-94496607c0c1 None admin] PATH_INFO: `/v3/users/95b02e0e3f09409fba94eda0d0665e03` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:15.348588 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91556182-5ff6-4a5a-8806-94496607c0c1 None admin] RBAC: Authorizing `identity:get_user(user_id=95b02e0e3f09409fba94eda0d0665e03)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:15.350042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91556182-5ff6-4a5a-8806-94496607c0c1 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:15.351755 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 590/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 01:00:15 2022] GET /identity/v3/users/95b02e0e3f09409fba94eda0d0665e03 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:00:15.357664 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60633e9d-7922-4ed4-8411-214313bb4f75 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:15.473691 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60633e9d-7922-4ed4-8411-214313bb4f75 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:15.480830 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:15.511039 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be437-a064-499e-9e55-31a98bc8c81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:15.511709 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be437-a064-499e-9e55-31a98bc8c81b None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:15.512001 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be437-a064-499e-9e55-31a98bc8c81b None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:15.512281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900be437-a064-499e-9e55-31a98bc8c81b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:15.597547 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900be437-a064-499e-9e55-31a98bc8c81b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:15.598930 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900be437-a064-499e-9e55-31a98bc8c81b None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:15.699635 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 569/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 01:00:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 24 01:00:15.705945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91556182-5ff6-4a5a-8806-94496607c0c1 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:15.769060 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:15.823957 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91556182-5ff6-4a5a-8806-94496607c0c1 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:15.859236 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef109043-7c36-423e-96ec-e46e9baa3d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:15.860082 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef109043-7c36-423e-96ec-e46e9baa3d27 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:15.860370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef109043-7c36-423e-96ec-e46e9baa3d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:15.860646 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef109043-7c36-423e-96ec-e46e9baa3d27 None admin] PATH_INFO: `/v3/projects/16fbeceae8554a6fa2f3a7e29c7ed633` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:15.861916 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef109043-7c36-423e-96ec-e46e9baa3d27 None admin] RBAC: Authorizing `identity:get_project(project_id=16fbeceae8554a6fa2f3a7e29c7ed633)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:15.863405 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef109043-7c36-423e-96ec-e46e9baa3d27 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:15.865127 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 591/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 01:00:15 2022] GET /identity/v3/projects/16fbeceae8554a6fa2f3a7e29c7ed633 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:00:15.874393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be437-a064-499e-9e55-31a98bc8c81b None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:15.882953 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:15.980163 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900be437-a064-499e-9e55-31a98bc8c81b None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:16.014794 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be096d-d5f4-4640-8453-9b027640ee83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:16.015476 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be096d-d5f4-4640-8453-9b027640ee83 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:16.015767 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be096d-d5f4-4640-8453-9b027640ee83 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:16.016039 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be096d-d5f4-4640-8453-9b027640ee83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:16.016877 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be096d-d5f4-4640-8453-9b027640ee83 None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=16fbeceae8554a6fa2f3a7e29c7ed633, user.id=95b02e0e3f09409fba94eda0d0665e03) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:00:16.017199 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be096d-d5f4-4640-8453-9b027640ee83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:16.018645 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be096d-d5f4-4640-8453-9b027640ee83 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:16.024692 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 570/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 01:00:15 2022] GET /identity/v3/role_assignments?user.id=95b02e0e3f09409fba94eda0d0665e03&scope.project.id=16fbeceae8554a6fa2f3a7e29c7ed633&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:00:18.056120 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cf91c-a7fb-4b75-ae47-eb080ef8bc82 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:18.057048 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cf91c-a7fb-4b75-ae47-eb080ef8bc82 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:18.057048 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7cf91c-a7fb-4b75-ae47-eb080ef8bc82 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:18.059214 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 592/1162] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:00:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:18.066062 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb589-d743-4a49-be45-efa03568c0cb None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:18.066479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb589-d743-4a49-be45-efa03568c0cb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:18.066574 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dafb589-d743-4a49-be45-efa03568c0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:18.091281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1dafb589-d743-4a49-be45-efa03568c0cb None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:18.092509 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1dafb589-d743-4a49-be45-efa03568c0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:18.156385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:18.161479 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 571/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:00:18.184183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7cf91c-a7fb-4b75-ae47-eb080ef8bc82 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:18.293999 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7cf91c-a7fb-4b75-ae47-eb080ef8bc82 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:18.310128 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:18.329356 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5c391-80d6-444e-9a60-d8f7c36c3e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:18.329928 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5c391-80d6-444e-9a60-d8f7c36c3e15 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:18.330209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5c391-80d6-444e-9a60-d8f7c36c3e15 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:18.330480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b5c391-80d6-444e-9a60-d8f7c36c3e15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:18.397345 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5c391-80d6-444e-9a60-d8f7c36c3e15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:18.398800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b5c391-80d6-444e-9a60-d8f7c36c3e15 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:18.499872 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 593/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 01:00:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 01:00:18.506672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafb589-d743-4a49-be45-efa03568c0cb None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:18.615572 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dafb589-d743-4a49-be45-efa03568c0cb None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:18.651845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0eb9e-ea27-4d65-83a2-33280a8e20de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:18.652647 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0eb9e-ea27-4d65-83a2-33280a8e20de None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:18.652936 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0eb9e-ea27-4d65-83a2-33280a8e20de None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:18.653210 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0eb9e-ea27-4d65-83a2-33280a8e20de None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:18.660298 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0eb9e-ea27-4d65-83a2-33280a8e20de None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:18.661823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0eb9e-ea27-4d65-83a2-33280a8e20de None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-3ae0eb9e-ea27-4d65-83a2-33280a8e20de None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:00:18.676463 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:00:18.677647 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:00:18.678597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:00:18.678597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:00:18.678597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:00:18.678597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:00:18.678597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:00:18.678597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:00:18.678597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:00:18.678597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:00:18.678597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:00:18.678597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:00:18.678597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 24 01:00:18.678597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:00:18.678597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 24 01:00:18.678597 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:00:18.678597 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 572/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Jul 24 01:00:18 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:00:18.683919 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5c391-80d6-444e-9a60-d8f7c36c3e15 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:18.701966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:18.786908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b5c391-80d6-444e-9a60-d8f7c36c3e15 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:18.822308 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81ddcc-b393-4cb4-b029-7f718fee3a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:18.822969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81ddcc-b393-4cb4-b029-7f718fee3a57 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:18.823249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81ddcc-b393-4cb4-b029-7f718fee3a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:18.823556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81ddcc-b393-4cb4-b029-7f718fee3a57 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:18.824272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81ddcc-b393-4cb4-b029-7f718fee3a57 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:00:18.824560 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81ddcc-b393-4cb4-b029-7f718fee3a57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:18.825934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81ddcc-b393-4cb4-b029-7f718fee3a57 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:18.833593 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 594/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Sun Jul 24 01:00:18 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:20.829554 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c16bc-81f4-4493-8a1a-b1f75f08b96f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:20.830030 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c16bc-81f4-4493-8a1a-b1f75f08b96f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:20.830118 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c16bc-81f4-4493-8a1a-b1f75f08b96f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:20.832321 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 573/1167] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:00:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:20.837963 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49831b3e-c0dc-44b2-98e5-027a1e07b6e9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:20.838401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49831b3e-c0dc-44b2-98e5-027a1e07b6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:20.838494 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49831b3e-c0dc-44b2-98e5-027a1e07b6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:20.855812 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-49831b3e-c0dc-44b2-98e5-027a1e07b6e9 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:20.857018 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-49831b3e-c0dc-44b2-98e5-027a1e07b6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:20.929139 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 595/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:00:20.964072 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c16bc-81f4-4493-8a1a-b1f75f08b96f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:21.027739 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:21.083931 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c16bc-81f4-4493-8a1a-b1f75f08b96f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:21.119606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54098d-4214-4692-b914-07375c85e9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:21.120266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54098d-4214-4692-b914-07375c85e9c7 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:21.120549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54098d-4214-4692-b914-07375c85e9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:21.120829 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54098d-4214-4692-b914-07375c85e9c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:21.121569 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54098d-4214-4692-b914-07375c85e9c7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:21.122958 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b54098d-4214-4692-b914-07375c85e9c7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:21.140034 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 574/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Sun Jul 24 01:00:20 2022] POST /identity/v3/domains => generated 267 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:00:23.156651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e7ecf-0bda-41f8-a87f-5e59cfbbb9a0 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:23.157493 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e7ecf-0bda-41f8-a87f-5e59cfbbb9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:23.157493 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e7ecf-0bda-41f8-a87f-5e59cfbbb9a0 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:23.159706 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 596/1170] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:00:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:23.165188 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e3132-49d2-4116-a220-5cfc12c4b516 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:23.165606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e3132-49d2-4116-a220-5cfc12c4b516 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:23.165696 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e3132-49d2-4116-a220-5cfc12c4b516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:23.184206 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bc4e3132-49d2-4116-a220-5cfc12c4b516 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:23.185383 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bc4e3132-49d2-4116-a220-5cfc12c4b516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:23.255909 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 575/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:00:23.279718 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e7ecf-0bda-41f8-a87f-5e59cfbbb9a0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:23.299259 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:23.400733 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e7ecf-0bda-41f8-a87f-5e59cfbbb9a0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:23.435682 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b301a5b9-eef6-4d5d-8845-6907f3674524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:23.436474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301a5b9-eef6-4d5d-8845-6907f3674524 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:23.436759 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301a5b9-eef6-4d5d-8845-6907f3674524 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:23.437030 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b301a5b9-eef6-4d5d-8845-6907f3674524 None admin] PATH_INFO: `/v3/domains/925e8b8916464e98beb4374153e8c7ef` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:23.448165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301a5b9-eef6-4d5d-8845-6907f3674524 None admin] RBAC: Authorizing `identity:get_domain(domain_id=925e8b8916464e98beb4374153e8c7ef)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:23.449619 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b301a5b9-eef6-4d5d-8845-6907f3674524 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:23.451236 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 597/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Sun Jul 24 01:00:23 2022] GET /identity/v3/domains/925e8b8916464e98beb4374153e8c7ef => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:23.457130 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e3132-49d2-4116-a220-5cfc12c4b516 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:23.515013 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:23.564654 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e3132-49d2-4116-a220-5cfc12c4b516 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:23.599659 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10d7b09-2212-4724-a8cd-00b1dfcb3251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:23.600414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d7b09-2212-4724-a8cd-00b1dfcb3251 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:23.600701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d7b09-2212-4724-a8cd-00b1dfcb3251 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:23.600980 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10d7b09-2212-4724-a8cd-00b1dfcb3251 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:23.601694 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d7b09-2212-4724-a8cd-00b1dfcb3251 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:23.603141 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10d7b09-2212-4724-a8cd-00b1dfcb3251 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:23.639048 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 576/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Jul 24 01:00:23 2022] POST /identity/v3/projects => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:00:25.683930 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46479393-b60c-4e1a-b1ef-21627cd9a78d None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:25.684498 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46479393-b60c-4e1a-b1ef-21627cd9a78d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:25.684498 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46479393-b60c-4e1a-b1ef-21627cd9a78d None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:25.685880 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 598/1174] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:25.692798 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56620a1-f331-4727-af22-4f7a025b284e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:25.693514 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56620a1-f331-4727-af22-4f7a025b284e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:25.693656 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56620a1-f331-4727-af22-4f7a025b284e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:25.712818 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c56620a1-f331-4727-af22-4f7a025b284e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:25.714027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c56620a1-f331-4727-af22-4f7a025b284e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:25.786280 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 577/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:00:25.825142 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46479393-b60c-4e1a-b1ef-21627cd9a78d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:25.900591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:25.935657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46479393-b60c-4e1a-b1ef-21627cd9a78d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:25.971114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6aa8e-ef84-4364-b73f-9ef400e4db88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:25.972010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6aa8e-ef84-4364-b73f-9ef400e4db88 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:25.972287 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6aa8e-ef84-4364-b73f-9ef400e4db88 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:25.972551 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6aa8e-ef84-4364-b73f-9ef400e4db88 None admin] PATH_INFO: `/v3/domains/925e8b8916464e98beb4374153e8c7ef` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:25.973731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6aa8e-ef84-4364-b73f-9ef400e4db88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=925e8b8916464e98beb4374153e8c7ef)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:25.975270 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6aa8e-ef84-4364-b73f-9ef400e4db88 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:25.976884 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 599/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Sun Jul 24 01:00:25 2022] GET /identity/v3/domains/925e8b8916464e98beb4374153e8c7ef => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:25.985922 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56620a1-f331-4727-af22-4f7a025b284e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:26.023099 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:26.097870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56620a1-f331-4727-af22-4f7a025b284e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:26.136891 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc976d4-9fee-4b69-91ac-eeebfa5cb30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:26.137557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc976d4-9fee-4b69-91ac-eeebfa5cb30f None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:26.137849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc976d4-9fee-4b69-91ac-eeebfa5cb30f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:26.138120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc976d4-9fee-4b69-91ac-eeebfa5cb30f None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:26.138823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc976d4-9fee-4b69-91ac-eeebfa5cb30f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:26.140318 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc976d4-9fee-4b69-91ac-eeebfa5cb30f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:26.165289 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 578/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 01:00:25 2022] POST /identity/v3/users => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:00:28.202401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3116c55-46a2-4757-8605-d80afa4a9f30 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:28.203446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3116c55-46a2-4757-8605-d80afa4a9f30 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:28.203446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3116c55-46a2-4757-8605-d80afa4a9f30 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:28.205569 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 600/1178] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:00:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:28.211985 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1f5fe-5d9c-455b-bf78-e600001beaae None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:28.212766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1f5fe-5d9c-455b-bf78-e600001beaae None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:28.212946 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1f5fe-5d9c-455b-bf78-e600001beaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:28.234948 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-31d1f5fe-5d9c-455b-bf78-e600001beaae None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:28.236193 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-31d1f5fe-5d9c-455b-bf78-e600001beaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:28.312375 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 579/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:00:28.336205 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3116c55-46a2-4757-8605-d80afa4a9f30 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:28.444159 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3116c55-46a2-4757-8605-d80afa4a9f30 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:28.479471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b8665-e128-4bc8-8fa7-9c17b35f0ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:28.480191 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b8665-e128-4bc8-8fa7-9c17b35f0ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:28.480469 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b8665-e128-4bc8-8fa7-9c17b35f0ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:28.480746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100b8665-e128-4bc8-8fa7-9c17b35f0ce0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:28.488060 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:28.492377 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100b8665-e128-4bc8-8fa7-9c17b35f0ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-100b8665-e128-4bc8-8fa7-9c17b35f0ce0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 01:00:28.500366 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:00:28.501503 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:00:28.502445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:00:28.502445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:00:28.502445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:00:28.502445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:00:28.502445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 01:00:28.502445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 01:00:28.502445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 01:00:28.502445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 01:00:28.502445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 01:00:28.502445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:00:28.502445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:00:28.502445 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:00:28.502445 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 601/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 01:00:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:00:28.507797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1f5fe-5d9c-455b-bf78-e600001beaae None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:28.526549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:28.610292 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1f5fe-5d9c-455b-bf78-e600001beaae None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:28.646100 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c83131-e4f9-4b28-85ec-4947bc8b4655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:28.646756 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c83131-e4f9-4b28-85ec-4947bc8b4655 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:28.647086 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c83131-e4f9-4b28-85ec-4947bc8b4655 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:28.647358 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c83131-e4f9-4b28-85ec-4947bc8b4655 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:28.648135 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c83131-e4f9-4b28-85ec-4947bc8b4655 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:00:28.648440 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c83131-e4f9-4b28-85ec-4947bc8b4655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:28.649826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c83131-e4f9-4b28-85ec-4947bc8b4655 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:28.657943 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 580/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 01:00:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:28.664845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b8665-e128-4bc8-8fa7-9c17b35f0ce0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:28.794939 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100b8665-e128-4bc8-8fa7-9c17b35f0ce0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:28.833716 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd06f1-b5b1-43ce-bb38-ff1c7b089a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:28.834651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd06f1-b5b1-43ce-bb38-ff1c7b089a14 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:28.834937 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd06f1-b5b1-43ce-bb38-ff1c7b089a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:28.835216 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fd06f1-b5b1-43ce-bb38-ff1c7b089a14 None admin] PATH_INFO: `/v3/users/e53b45a1d0a84bc18a038948ac5141ed` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:28.847814 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd06f1-b5b1-43ce-bb38-ff1c7b089a14 None admin] RBAC: Authorizing `identity:get_user(user_id=e53b45a1d0a84bc18a038948ac5141ed)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:28.849307 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fd06f1-b5b1-43ce-bb38-ff1c7b089a14 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:28.851048 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 602/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 01:00:28 2022] GET /identity/v3/users/e53b45a1d0a84bc18a038948ac5141ed => generated 311 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:28.857838 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c83131-e4f9-4b28-85ec-4947bc8b4655 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:28.948699 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:28.969840 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c83131-e4f9-4b28-85ec-4947bc8b4655 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:29.004370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7d693-728d-4528-ac51-67a84f50428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:29.005004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7d693-728d-4528-ac51-67a84f50428f None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:29.005280 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7d693-728d-4528-ac51-67a84f50428f None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:29.005557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c7d693-728d-4528-ac51-67a84f50428f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:29.093643 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7d693-728d-4528-ac51-67a84f50428f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:29.095129 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c7d693-728d-4528-ac51-67a84f50428f None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:29.175474 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:29.197714 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 581/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 01:00:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 01:00:29.204018 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd06f1-b5b1-43ce-bb38-ff1c7b089a14 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:29.259871 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:29.304087 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fd06f1-b5b1-43ce-bb38-ff1c7b089a14 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:29.339910 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55b80a-c96f-4588-a805-31cc24bef64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:29.340768 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b80a-c96f-4588-a805-31cc24bef64f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:29.341025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b80a-c96f-4588-a805-31cc24bef64f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:29.341320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55b80a-c96f-4588-a805-31cc24bef64f None admin] PATH_INFO: `/v3/projects/6e419f37d038483fa385a976da82cddc` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:29.342534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55b80a-c96f-4588-a805-31cc24bef64f None admin] RBAC: Authorizing `identity:get_project(project_id=6e419f37d038483fa385a976da82cddc)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:29.344073 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a55b80a-c96f-4588-a805-31cc24bef64f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:29.345688 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 603/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 01:00:29 2022] GET /identity/v3/projects/6e419f37d038483fa385a976da82cddc => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:29.351902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7d693-728d-4528-ac51-67a84f50428f None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:29.468725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c7d693-728d-4528-ac51-67a84f50428f None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:29.503794 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24783bb8-bf33-48b9-872e-16bf5bd6be2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:29.504447 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24783bb8-bf33-48b9-872e-16bf5bd6be2a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:29.504727 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24783bb8-bf33-48b9-872e-16bf5bd6be2a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:29.505000 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24783bb8-bf33-48b9-872e-16bf5bd6be2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:29.505823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24783bb8-bf33-48b9-872e-16bf5bd6be2a None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=6e419f37d038483fa385a976da82cddc, user.id=e53b45a1d0a84bc18a038948ac5141ed) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:00:29.506137 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24783bb8-bf33-48b9-872e-16bf5bd6be2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:29.507657 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24783bb8-bf33-48b9-872e-16bf5bd6be2a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:29.513228 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 582/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 01:00:29 2022] GET /identity/v3/role_assignments?user.id=e53b45a1d0a84bc18a038948ac5141ed&scope.project.id=6e419f37d038483fa385a976da82cddc&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:31.518195 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea212c4-2df0-4f61-876d-a795fa9a1981 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:31.518789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea212c4-2df0-4f61-876d-a795fa9a1981 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:31.518789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea212c4-2df0-4f61-876d-a795fa9a1981 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:31.520172 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 604/1186] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:31.526608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815fb1-ed7b-4d1d-841e-37636c9047af None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:31.527418 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815fb1-ed7b-4d1d-841e-37636c9047af None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:31.527614 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c815fb1-ed7b-4d1d-841e-37636c9047af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:31.555219 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9c815fb1-ed7b-4d1d-841e-37636c9047af None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:31.556439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9c815fb1-ed7b-4d1d-841e-37636c9047af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:31.597944 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:31.627791 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 583/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:00:31.650038 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea212c4-2df0-4f61-876d-a795fa9a1981 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:31.771080 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea212c4-2df0-4f61-876d-a795fa9a1981 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:31.796811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:31.810157 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929e288-b51b-442d-ba7d-3f56e6f5fc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:31.810980 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929e288-b51b-442d-ba7d-3f56e6f5fc30 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:31.811264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929e288-b51b-442d-ba7d-3f56e6f5fc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:31.811572 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2929e288-b51b-442d-ba7d-3f56e6f5fc30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:31.822363 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2929e288-b51b-442d-ba7d-3f56e6f5fc30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-2929e288-b51b-442d-ba7d-3f56e6f5fc30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 01:00:31.830316 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:00:31.831376 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:00:31.832270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:00:31.832270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:00:31.832270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:00:31.832270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:00:31.832270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 01:00:31.832270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 01:00:31.832270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 01:00:31.832270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 01:00:31.832270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 01:00:31.832270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:00:31.832270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:00:31.832270 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:00:31.832270 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 605/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 01:00:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:00:31.837987 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c815fb1-ed7b-4d1d-841e-37636c9047af None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:31.941373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c815fb1-ed7b-4d1d-841e-37636c9047af None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:31.976638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b50a0-2008-49f2-9787-75fa59a2a495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:31.977293 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b50a0-2008-49f2-9787-75fa59a2a495 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:31.977571 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b50a0-2008-49f2-9787-75fa59a2a495 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:31.977848 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b50a0-2008-49f2-9787-75fa59a2a495 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:31.978593 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b50a0-2008-49f2-9787-75fa59a2a495 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:00:31.978901 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b50a0-2008-49f2-9787-75fa59a2a495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:31.980327 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b50a0-2008-49f2-9787-75fa59a2a495 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:31.988649 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 584/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 01:00:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:31.994865 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929e288-b51b-442d-ba7d-3f56e6f5fc30 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:32.101404 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2929e288-b51b-442d-ba7d-3f56e6f5fc30 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:32.135629 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c63d4-4228-4285-9531-8a1ddf69c777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:32.136523 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c63d4-4228-4285-9531-8a1ddf69c777 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:32.136805 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c63d4-4228-4285-9531-8a1ddf69c777 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:32.137083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c63d4-4228-4285-9531-8a1ddf69c777 None admin] PATH_INFO: `/v3/users/e53b45a1d0a84bc18a038948ac5141ed` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:32.138321 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c63d4-4228-4285-9531-8a1ddf69c777 None admin] RBAC: Authorizing `identity:get_user(user_id=e53b45a1d0a84bc18a038948ac5141ed)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:32.139812 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c63d4-4228-4285-9531-8a1ddf69c777 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:32.141438 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 606/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 01:00:31 2022] GET /identity/v3/users/e53b45a1d0a84bc18a038948ac5141ed => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:32.149497 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b50a0-2008-49f2-9787-75fa59a2a495 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:32.187023 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:32.256135 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b50a0-2008-49f2-9787-75fa59a2a495 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:32.292097 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5f55af-c83a-4f3a-8f72-dbf59ee6bb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:32.292943 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f55af-c83a-4f3a-8f72-dbf59ee6bb50 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:32.293224 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f55af-c83a-4f3a-8f72-dbf59ee6bb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:32.293498 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f55af-c83a-4f3a-8f72-dbf59ee6bb50 None admin] PATH_INFO: `/v3/projects/6e419f37d038483fa385a976da82cddc` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:32.294783 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f55af-c83a-4f3a-8f72-dbf59ee6bb50 None admin] RBAC: Authorizing `identity:get_project(project_id=6e419f37d038483fa385a976da82cddc)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:32.296322 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5f55af-c83a-4f3a-8f72-dbf59ee6bb50 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:32.297986 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 585/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 01:00:32 2022] GET /identity/v3/projects/6e419f37d038483fa385a976da82cddc => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:32.304390 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c63d4-4228-4285-9531-8a1ddf69c777 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:32.361479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:32.408467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c63d4-4228-4285-9531-8a1ddf69c777 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:32.439493 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e06883-1b28-4eb0-b83c-3c80f4d54c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:32.440713 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e06883-1b28-4eb0-b83c-3c80f4d54c68 None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:32.441015 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e06883-1b28-4eb0-b83c-3c80f4d54c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:32.441285 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e06883-1b28-4eb0-b83c-3c80f4d54c68 None admin] PATH_INFO: `/v3/projects/6e419f37d038483fa385a976da82cddc/users/e53b45a1d0a84bc18a038948ac5141ed/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:32.443337 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e06883-1b28-4eb0-b83c-3c80f4d54c68 None admin] RBAC: Authorizing `identity:create_grant(project_id=6e419f37d038483fa385a976da82cddc, user_id=e53b45a1d0a84bc18a038948ac5141ed, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:32.444807 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e06883-1b28-4eb0-b83c-3c80f4d54c68 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:32.463558 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 607/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 01:00:32 2022] PUT /identity/v3/projects/6e419f37d038483fa385a976da82cddc/users/e53b45a1d0a84bc18a038948ac5141ed/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:00:34.441393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72fb5c-8c03-4ca8-bc0d-68fcd40c254b None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:34.442229 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72fb5c-8c03-4ca8-bc0d-68fcd40c254b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:34.442229 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d72fb5c-8c03-4ca8-bc0d-68fcd40c254b None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:34.444517 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 586/1193] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:00:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:00:34.450048 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69fcec-fd04-4ac6-b7a3-f85f2a1bb6db None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:34.450491 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69fcec-fd04-4ac6-b7a3-f85f2a1bb6db None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:34.450590 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df69fcec-fd04-4ac6-b7a3-f85f2a1bb6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:34.468720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-df69fcec-fd04-4ac6-b7a3-f85f2a1bb6db None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:00:34.469900 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-df69fcec-fd04-4ac6-b7a3-f85f2a1bb6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:00:34.542715 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 608/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:00:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 01:00:34.570613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72fb5c-8c03-4ca8-bc0d-68fcd40c254b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:34.678005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d72fb5c-8c03-4ca8-bc0d-68fcd40c254b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:34.680398 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:34.712862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfcd5c-0487-4f02-9b01-1c5164c07aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:34.713594 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfcd5c-0487-4f02-9b01-1c5164c07aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:34.713872 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfcd5c-0487-4f02-9b01-1c5164c07aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:34.714150 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cfcd5c-0487-4f02-9b01-1c5164c07aa2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:34.725803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cfcd5c-0487-4f02-9b01-1c5164c07aa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-f8cfcd5c-0487-4f02-9b01-1c5164c07aa2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 01:00:34.733570 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:00:34.734724 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:00:34.735755 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:00:34.735755 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:00:34.735755 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:00:34.735755 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:00:34.735755 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 01:00:34.735755 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 01:00:34.735755 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 01:00:34.735755 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 01:00:34.735755 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 01:00:34.735755 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:00:34.735755 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:00:34.735755 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:00:34.735755 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 587/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 01:00:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:00:34.741055 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69fcec-fd04-4ac6-b7a3-f85f2a1bb6db None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:34.787836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:34.843663 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df69fcec-fd04-4ac6-b7a3-f85f2a1bb6db None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:34.877567 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ce163-f4ab-44c8-addd-61f5fbb19d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:34.878233 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ce163-f4ab-44c8-addd-61f5fbb19d91 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:34.878518 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ce163-f4ab-44c8-addd-61f5fbb19d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:34.878793 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38ce163-f4ab-44c8-addd-61f5fbb19d91 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:34.879572 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ce163-f4ab-44c8-addd-61f5fbb19d91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:00:34.879878 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ce163-f4ab-44c8-addd-61f5fbb19d91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:34.881269 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38ce163-f4ab-44c8-addd-61f5fbb19d91 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:34.889444 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 609/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 01:00:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:00:34.896269 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfcd5c-0487-4f02-9b01-1c5164c07aa2 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:35.012110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cfcd5c-0487-4f02-9b01-1c5164c07aa2 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:35.046127 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f389302-c70c-4488-9498-f632f3be90cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:35.046996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f389302-c70c-4488-9498-f632f3be90cf None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:35.047272 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f389302-c70c-4488-9498-f632f3be90cf None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:35.047600 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f389302-c70c-4488-9498-f632f3be90cf None admin] PATH_INFO: `/v3/users/e53b45a1d0a84bc18a038948ac5141ed` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:35.048893 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f389302-c70c-4488-9498-f632f3be90cf None admin] RBAC: Authorizing `identity:get_user(user_id=e53b45a1d0a84bc18a038948ac5141ed)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:35.050337 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f389302-c70c-4488-9498-f632f3be90cf None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:35.052008 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 588/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Sun Jul 24 01:00:34 2022] GET /identity/v3/users/e53b45a1d0a84bc18a038948ac5141ed => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:35.060590 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ce163-f4ab-44c8-addd-61f5fbb19d91 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:35.164308 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38ce163-f4ab-44c8-addd-61f5fbb19d91 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:35.166591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:35.199583 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e151dd-cd82-4b04-8cbe-9d348b7362d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:35.200223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e151dd-cd82-4b04-8cbe-9d348b7362d4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:35.200502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e151dd-cd82-4b04-8cbe-9d348b7362d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:35.200773 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e151dd-cd82-4b04-8cbe-9d348b7362d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:35.271097 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e151dd-cd82-4b04-8cbe-9d348b7362d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:35.272536 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e151dd-cd82-4b04-8cbe-9d348b7362d4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:35.375865 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 610/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 01:00:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 01:00:35.381942 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f389302-c70c-4488-9498-f632f3be90cf None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:35.416866 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:35.488712 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f389302-c70c-4488-9498-f632f3be90cf None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:35.534636 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2a278-7750-4bbb-a990-0a5ff846da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:35.535479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2a278-7750-4bbb-a990-0a5ff846da0e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:35.535767 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2a278-7750-4bbb-a990-0a5ff846da0e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:35.536044 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2a278-7750-4bbb-a990-0a5ff846da0e None admin] PATH_INFO: `/v3/projects/6e419f37d038483fa385a976da82cddc` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:35.537275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2a278-7750-4bbb-a990-0a5ff846da0e None admin] RBAC: Authorizing `identity:get_project(project_id=6e419f37d038483fa385a976da82cddc)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:35.538734 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2a278-7750-4bbb-a990-0a5ff846da0e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:35.540430 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 589/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Sun Jul 24 01:00:35 2022] GET /identity/v3/projects/6e419f37d038483fa385a976da82cddc => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:35.549747 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e151dd-cd82-4b04-8cbe-9d348b7362d4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:00:35.552949 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:35.650519 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e151dd-cd82-4b04-8cbe-9d348b7362d4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:00:35.686017 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9505f28a-f809-46a7-8156-dae5ad08e07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:00:35.686657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505f28a-f809-46a7-8156-dae5ad08e07c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:00:35.686941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505f28a-f809-46a7-8156-dae5ad08e07c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:00:35.687211 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9505f28a-f809-46a7-8156-dae5ad08e07c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:00:35.688071 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505f28a-f809-46a7-8156-dae5ad08e07c None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=6e419f37d038483fa385a976da82cddc, user.id=e53b45a1d0a84bc18a038948ac5141ed) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:00:35.688386 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505f28a-f809-46a7-8156-dae5ad08e07c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:00:35.689822 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9505f28a-f809-46a7-8156-dae5ad08e07c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:00:35.698954 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 611/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 01:00:35 2022] GET /identity/v3/role_assignments?user.id=e53b45a1d0a84bc18a038948ac5141ed&scope.project.id=6e419f37d038483fa385a976da82cddc&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:00:45.530029 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=50 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:00:45.694132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=66 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:30.773051 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce9302-fc03-43f0-ad32-645bb3ff8bec None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:30.773709 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce9302-fc03-43f0-ad32-645bb3ff8bec None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:30.773801 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce9302-fc03-43f0-ad32-645bb3ff8bec None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:30.775469 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 590/1201] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:01:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:01:30.781187 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19718c-4b28-4b1b-86a4-2e212cf13d6b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:30.781851 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19718c-4b28-4b1b-86a4-2e212cf13d6b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:30.781851 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19718c-4b28-4b1b-86a4-2e212cf13d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:30.805569 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ed19718c-4b28-4b1b-86a4-2e212cf13d6b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:01:30.806905 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ed19718c-4b28-4b1b-86a4-2e212cf13d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:30.891653 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 612/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:01:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 01:01:30.917946 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce9302-fc03-43f0-ad32-645bb3ff8bec None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:31.062302 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce9302-fc03-43f0-ad32-645bb3ff8bec None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:31.105218 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bcf37-ae6e-410c-8361-c322e5d5882d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:31.106008 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bcf37-ae6e-410c-8361-c322e5d5882d None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:31.106283 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bcf37-ae6e-410c-8361-c322e5d5882d None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:31.106557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bcf37-ae6e-410c-8361-c322e5d5882d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:31.118346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bcf37-ae6e-410c-8361-c322e5d5882d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:31.120036 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8bcf37-ae6e-410c-8361-c322e5d5882d None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:31.138315 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-5c8bcf37-ae6e-410c-8361-c322e5d5882d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:31.138315 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:31.138315 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:31.138315 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:31.138315 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:31.138315 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:31.138315 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:31.138315 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:31.138315 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:31.138315 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:31.138315 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:31.138315 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:31.138315 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 01:01:31.138315 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 01:01:31.138315 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:31.140093 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:31.141342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 01:01:31.141342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:01:31.141342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:31.141342 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:31.145829 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 591/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:31.146490 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19718c-4b28-4b1b-86a4-2e212cf13d6b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:31.278767 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19718c-4b28-4b1b-86a4-2e212cf13d6b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:31.317633 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:31.324741 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91331a24-ee31-4695-b851-caec2b426231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:31.325489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91331a24-ee31-4695-b851-caec2b426231 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:31.325772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91331a24-ee31-4695-b851-caec2b426231 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:31.326039 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91331a24-ee31-4695-b851-caec2b426231 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:31.326870 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91331a24-ee31-4695-b851-caec2b426231 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:31.327197 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91331a24-ee31-4695-b851-caec2b426231 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:31.328687 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91331a24-ee31-4695-b851-caec2b426231 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:31.349717 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 613/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 01:01:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:31.351205 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bcf37-ae6e-410c-8361-c322e5d5882d None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:31.422503 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:31.484515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bcf37-ae6e-410c-8361-c322e5d5882d None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:31.526126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32467a58-a61f-485e-9154-657fe204806c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:31.526940 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32467a58-a61f-485e-9154-657fe204806c None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:31.527331 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32467a58-a61f-485e-9154-657fe204806c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:31.527706 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32467a58-a61f-485e-9154-657fe204806c None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:31.528645 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32467a58-a61f-485e-9154-657fe204806c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:31.530455 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32467a58-a61f-485e-9154-657fe204806c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:31.562661 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 592/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Sun Jul 24 01:01:31 2022] POST /identity/v3/users => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:01:33.831651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ddec0-f9da-482f-906d-b7ec816d9b93 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:33.832237 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ddec0-f9da-482f-906d-b7ec816d9b93 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:33.832237 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249ddec0-f9da-482f-906d-b7ec816d9b93 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:33.835364 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 614/1206] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:01:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:01:33.839195 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069343fa-c965-4fbb-9339-d56c3e95bf64 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:33.839706 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069343fa-c965-4fbb-9339-d56c3e95bf64 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:33.839808 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069343fa-c965-4fbb-9339-d56c3e95bf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:33.859618 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-069343fa-c965-4fbb-9339-d56c3e95bf64 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:01:33.860923 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-069343fa-c965-4fbb-9339-d56c3e95bf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:33.939533 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 593/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:01:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:01:33.963416 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ddec0-f9da-482f-906d-b7ec816d9b93 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:34.077254 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249ddec0-f9da-482f-906d-b7ec816d9b93 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:34.116426 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b5d7f-eb88-4219-be24-bfd011a44726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:34.117240 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b5d7f-eb88-4219-be24-bfd011a44726 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:34.117558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b5d7f-eb88-4219-be24-bfd011a44726 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:34.117837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b5d7f-eb88-4219-be24-bfd011a44726 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:34.130209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b5d7f-eb88-4219-be24-bfd011a44726 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-0f5b5d7f-eb88-4219-be24-bfd011a44726 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 01:01:34.138528 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:34.139639 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:34.140536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:34.140536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:34.140536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:34.140536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:34.140536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 01:01:34.140536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 01:01:34.140536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 01:01:34.140536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 01:01:34.140536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 01:01:34.140536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:01:34.140536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 01:01:34.140536 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:01:34.151380 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 615/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 01:01:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:34.151559 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069343fa-c965-4fbb-9339-d56c3e95bf64 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:34.200179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:34.269140 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069343fa-c965-4fbb-9339-d56c3e95bf64 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:34.310462 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c48ef-d0bd-47e1-b35e-55bd26def508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:34.311177 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c48ef-d0bd-47e1-b35e-55bd26def508 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:34.311496 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c48ef-d0bd-47e1-b35e-55bd26def508 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:34.311794 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c48ef-d0bd-47e1-b35e-55bd26def508 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:34.312651 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c48ef-d0bd-47e1-b35e-55bd26def508 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:34.312965 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c48ef-d0bd-47e1-b35e-55bd26def508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:34.315011 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c48ef-d0bd-47e1-b35e-55bd26def508 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:34.324450 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 594/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 01:01:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:34.330263 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b5d7f-eb88-4219-be24-bfd011a44726 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:34.390713 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:34.456580 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b5d7f-eb88-4219-be24-bfd011a44726 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:34.500013 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97038887-fcfb-41cc-8bf0-b250c6482034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:34.500864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97038887-fcfb-41cc-8bf0-b250c6482034 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:34.501178 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97038887-fcfb-41cc-8bf0-b250c6482034 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:34.501417 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97038887-fcfb-41cc-8bf0-b250c6482034 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:34.513350 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97038887-fcfb-41cc-8bf0-b250c6482034 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:34.514919 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97038887-fcfb-41cc-8bf0-b250c6482034 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:34.532750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-97038887-fcfb-41cc-8bf0-b250c6482034 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:34.532750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:34.532750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:34.532750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:34.532750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:34.532750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:34.532750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:34.532750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:34.532750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:34.532750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:34.532750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:34.532750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:34.532750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 01:01:34.532750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 01:01:34.532750 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:34.533954 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:34.535043 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 01:01:34.535043 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:01:34.535043 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:34.535043 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:01:34.535043 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 616/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 01:01:34.540575 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c48ef-d0bd-47e1-b35e-55bd26def508 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:34.675258 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:34.678556 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c48ef-d0bd-47e1-b35e-55bd26def508 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:34.722172 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbd6a4-4d7e-438c-881a-ec205678568e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:34.722934 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbd6a4-4d7e-438c-881a-ec205678568e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:34.723242 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbd6a4-4d7e-438c-881a-ec205678568e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:34.724627 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbd6a4-4d7e-438c-881a-ec205678568e None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:34.724627 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbd6a4-4d7e-438c-881a-ec205678568e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:34.724842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbd6a4-4d7e-438c-881a-ec205678568e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:34.726347 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbd6a4-4d7e-438c-881a-ec205678568e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:34.744941 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 595/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 01:01:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:01:34.745630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97038887-fcfb-41cc-8bf0-b250c6482034 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:34.861631 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97038887-fcfb-41cc-8bf0-b250c6482034 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:34.863266 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:34.898583 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57022b63-b020-42cc-9eff-f2cee49f2f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:34.899434 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57022b63-b020-42cc-9eff-f2cee49f2f4b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:34.899720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57022b63-b020-42cc-9eff-f2cee49f2f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:34.900010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57022b63-b020-42cc-9eff-f2cee49f2f4b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:34.908621 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57022b63-b020-42cc-9eff-f2cee49f2f4b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:34.909178 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57022b63-b020-42cc-9eff-f2cee49f2f4b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-57022b63-b020-42cc-9eff-f2cee49f2f4b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 01:01:34.925456 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:34.926670 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:34.927791 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:34.927791 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:34.927791 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 01:01:34.927791 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 01:01:34.927791 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 01:01:34.927791 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 01:01:34.927791 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 01:01:34.927791 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 01:01:34.927791 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 01:01:34.927791 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:01:34.927791 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 617/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 01:01:34.932784 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbd6a4-4d7e-438c-881a-ec205678568e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:35.043368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbd6a4-4d7e-438c-881a-ec205678568e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:35.081977 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf64441-615e-41c5-9ec4-ee2c54091126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:35.082721 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf64441-615e-41c5-9ec4-ee2c54091126 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:35.083030 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf64441-615e-41c5-9ec4-ee2c54091126 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:35.083361 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf64441-615e-41c5-9ec4-ee2c54091126 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:35.084206 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf64441-615e-41c5-9ec4-ee2c54091126 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:35.085289 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf64441-615e-41c5-9ec4-ee2c54091126 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:35.085952 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf64441-615e-41c5-9ec4-ee2c54091126 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:35.110536 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 596/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Sun Jul 24 01:01:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:35.111825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57022b63-b020-42cc-9eff-f2cee49f2f4b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:35.221145 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57022b63-b020-42cc-9eff-f2cee49f2f4b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:35.257892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c981280-94f3-416b-9d0f-cbca5a14ea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:35.258580 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c981280-94f3-416b-9d0f-cbca5a14ea0e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:35.258864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c981280-94f3-416b-9d0f-cbca5a14ea0e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:35.259179 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c981280-94f3-416b-9d0f-cbca5a14ea0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:35.293957 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:35.336950 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c981280-94f3-416b-9d0f-cbca5a14ea0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:35.338451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c981280-94f3-416b-9d0f-cbca5a14ea0e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:35.447002 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 618/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 01:01:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 01:01:35.453313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf64441-615e-41c5-9ec4-ee2c54091126 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:35.473432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:35.570452 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf64441-615e-41c5-9ec4-ee2c54091126 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:35.608555 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd4ab3-7da2-472a-aaa6-6f4859d07123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:35.609730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd4ab3-7da2-472a-aaa6-6f4859d07123 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:35.610034 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd4ab3-7da2-472a-aaa6-6f4859d07123 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:35.610312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd4ab3-7da2-472a-aaa6-6f4859d07123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:35.622901 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd4ab3-7da2-472a-aaa6-6f4859d07123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:35.624532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd4ab3-7da2-472a-aaa6-6f4859d07123 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:35.645957 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-97dd4ab3-7da2-472a-aaa6-6f4859d07123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:35.645957 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:35.645957 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:35.645957 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:35.645957 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:35.645957 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:35.645957 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:35.645957 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:35.645957 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:35.645957 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:35.645957 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:35.645957 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:35.645957 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 01:01:35.645957 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 01:01:35.645957 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:35.647060 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:35.648067 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 01:01:35.648067 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:01:35.648067 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:35.648067 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:35.648067 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 597/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:35.653703 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c981280-94f3-416b-9d0f-cbca5a14ea0e None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:35.728670 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:35.780194 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c981280-94f3-416b-9d0f-cbca5a14ea0e None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:35.840966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1946d4-2fb5-4604-9239-7afade9bb72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:35.841984 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1946d4-2fb5-4604-9239-7afade9bb72f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:35.842300 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1946d4-2fb5-4604-9239-7afade9bb72f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:35.842730 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1946d4-2fb5-4604-9239-7afade9bb72f None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:35.844010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1946d4-2fb5-4604-9239-7afade9bb72f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:35.844475 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1946d4-2fb5-4604-9239-7afade9bb72f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:35.846629 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1946d4-2fb5-4604-9239-7afade9bb72f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:35.861023 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 619/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 01:01:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:35.868554 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd4ab3-7da2-472a-aaa6-6f4859d07123 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:35.948987 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:35.983508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd4ab3-7da2-472a-aaa6-6f4859d07123 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:36.018641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ceeb9-d80f-4507-a245-9853fbc51618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:36.019813 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ceeb9-d80f-4507-a245-9853fbc51618 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:36.020336 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ceeb9-d80f-4507-a245-9853fbc51618 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:36.020842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ceeb9-d80f-4507-a245-9853fbc51618 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:36.028714 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ceeb9-d80f-4507-a245-9853fbc51618 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:36.030675 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594ceeb9-d80f-4507-a245-9853fbc51618 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:36.047698 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-594ceeb9-d80f-4507-a245-9853fbc51618 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 01:01:36.047698 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:36.047698 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:36.047698 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:36.047698 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:36.047698 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:36.047698 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:36.047698 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:36.047698 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:36.047698 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:36.047698 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:36.047698 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:36.047698 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 01:01:36.047698 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 01:01:36.047698 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:36.048666 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:36.049588 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 01:01:36.049588 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 01:01:36.049588 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:01:36.049588 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:01:36.049588 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:01:36.049588 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:01:36.049588 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 01:01:36.049588 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:36.051539 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 598/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 01:01:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 01:01:36.058066 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1946d4-2fb5-4604-9239-7afade9bb72f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:36.176094 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1946d4-2fb5-4604-9239-7afade9bb72f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:36.207773 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:36.221862 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e63008-05c3-40ea-8ba9-a2f63cd4ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:36.222559 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e63008-05c3-40ea-8ba9-a2f63cd4ce05 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:36.222848 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e63008-05c3-40ea-8ba9-a2f63cd4ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:36.223119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e63008-05c3-40ea-8ba9-a2f63cd4ce05 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:36.224011 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e63008-05c3-40ea-8ba9-a2f63cd4ce05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:36.224328 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e63008-05c3-40ea-8ba9-a2f63cd4ce05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:36.225789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e63008-05c3-40ea-8ba9-a2f63cd4ce05 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:36.239201 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 620/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 01:01:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:36.245528 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ceeb9-d80f-4507-a245-9853fbc51618 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:36.356751 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594ceeb9-d80f-4507-a245-9853fbc51618 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:36.389511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:36.397175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081fc4d-dc0b-413a-b700-ead3fed3c494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:36.398049 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081fc4d-dc0b-413a-b700-ead3fed3c494 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:36.398418 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081fc4d-dc0b-413a-b700-ead3fed3c494 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:36.398782 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081fc4d-dc0b-413a-b700-ead3fed3c494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:36.399754 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081fc4d-dc0b-413a-b700-ead3fed3c494 None admin] RBAC: Adding query filter params (role.id=566ec5e1e87245cea292823f58d150fd, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=333db0711d0f41fe8066ba5b9d91dacc) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:36.400173 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081fc4d-dc0b-413a-b700-ead3fed3c494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:36.401817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a081fc4d-dc0b-413a-b700-ead3fed3c494 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:36.408262 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 599/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 01:01:36 2022] GET /identity/v3/role_assignments?user.id=333db0711d0f41fe8066ba5b9d91dacc&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=566ec5e1e87245cea292823f58d150fd => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:38.452203 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155598c-65e9-431b-9ccb-0374afac0f89 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:38.452809 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155598c-65e9-431b-9ccb-0374afac0f89 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:38.452809 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b155598c-65e9-431b-9ccb-0374afac0f89 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:38.454343 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 621/1220] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:01:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:01:38.459947 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1543f45-f159-4539-974d-61b299a3167f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:38.460448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1543f45-f159-4539-974d-61b299a3167f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:38.460556 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1543f45-f159-4539-974d-61b299a3167f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:38.479246 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b1543f45-f159-4539-974d-61b299a3167f None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:01:38.480532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b1543f45-f159-4539-974d-61b299a3167f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:38.562365 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 600/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:01:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:01:38.588476 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155598c-65e9-431b-9ccb-0374afac0f89 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:38.703388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b155598c-65e9-431b-9ccb-0374afac0f89 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:38.738920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ee6b5-0cc8-4303-895c-792dc93d740a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:38.739870 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee6b5-0cc8-4303-895c-792dc93d740a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:38.740153 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee6b5-0cc8-4303-895c-792dc93d740a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:38.740429 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8ee6b5-0cc8-4303-895c-792dc93d740a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:38.755775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8ee6b5-0cc8-4303-895c-792dc93d740a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-df8ee6b5-0cc8-4303-895c-792dc93d740a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 01:01:38.763717 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:38.764879 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:38.766264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:38.766264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:38.766264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:38.766264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:38.766264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 01:01:38.766264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 01:01:38.766264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 01:01:38.766264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 01:01:38.766264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 01:01:38.766264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:01:38.766264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 01:01:38.766264 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:01:38.766264 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 622/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 01:01:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:38.771044 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1543f45-f159-4539-974d-61b299a3167f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:38.877103 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1543f45-f159-4539-974d-61b299a3167f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:38.903482 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:38.915403 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7f456-bd9a-4e08-80e8-14c081cd0756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:38.916154 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7f456-bd9a-4e08-80e8-14c081cd0756 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:38.916440 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7f456-bd9a-4e08-80e8-14c081cd0756 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:38.916723 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7f456-bd9a-4e08-80e8-14c081cd0756 None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:38.917477 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7f456-bd9a-4e08-80e8-14c081cd0756 None admin] RBAC: Adding query filter params (name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:38.917791 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7f456-bd9a-4e08-80e8-14c081cd0756 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:38.919187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea7f456-bd9a-4e08-80e8-14c081cd0756 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:38.927269 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 601/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 01:01:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:38.933231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ee6b5-0cc8-4303-895c-792dc93d740a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:38.980813 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:39.039599 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8ee6b5-0cc8-4303-895c-792dc93d740a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:39.076946 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450340dc-bc0b-4e92-9cd8-a40562fb429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:39.077866 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450340dc-bc0b-4e92-9cd8-a40562fb429c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:39.078263 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450340dc-bc0b-4e92-9cd8-a40562fb429c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:39.078619 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450340dc-bc0b-4e92-9cd8-a40562fb429c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:39.089610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450340dc-bc0b-4e92-9cd8-a40562fb429c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:39.091080 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450340dc-bc0b-4e92-9cd8-a40562fb429c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:39.108764 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-450340dc-bc0b-4e92-9cd8-a40562fb429c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:39.108764 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:39.108764 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:39.108764 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:39.108764 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:39.108764 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:39.108764 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:39.108764 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:39.108764 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:39.108764 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:39.108764 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:39.108764 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:39.108764 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 01:01:39.108764 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 01:01:39.108764 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:39.109880 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:39.110855 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 01:01:39.110855 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:01:39.110855 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:39.110855 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:01:39.110855 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 623/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:39.116352 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7f456-bd9a-4e08-80e8-14c081cd0756 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:39.228978 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7f456-bd9a-4e08-80e8-14c081cd0756 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:39.263938 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709637d8-df24-42ac-bedf-ee7d30e7bb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:39.264745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709637d8-df24-42ac-bedf-ee7d30e7bb02 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:39.265123 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709637d8-df24-42ac-bedf-ee7d30e7bb02 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:39.265449 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709637d8-df24-42ac-bedf-ee7d30e7bb02 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:39.266248 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709637d8-df24-42ac-bedf-ee7d30e7bb02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:39.266630 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709637d8-df24-42ac-bedf-ee7d30e7bb02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:39.268120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709637d8-df24-42ac-bedf-ee7d30e7bb02 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:39.281051 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 602/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 01:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:39.287378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450340dc-bc0b-4e92-9cd8-a40562fb429c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:39.388211 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:39.395132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450340dc-bc0b-4e92-9cd8-a40562fb429c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:39.427891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1eca8-9fbd-41bd-8323-1bc0f05312c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:39.428706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1eca8-9fbd-41bd-8323-1bc0f05312c4 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:39.428991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1eca8-9fbd-41bd-8323-1bc0f05312c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:39.429264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1eca8-9fbd-41bd-8323-1bc0f05312c4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:39.436878 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1eca8-9fbd-41bd-8323-1bc0f05312c4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:39.438319 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f1eca8-9fbd-41bd-8323-1bc0f05312c4 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-e9f1eca8-9fbd-41bd-8323-1bc0f05312c4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 01:01:39.453347 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:39.455260 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:39.456550 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:39.456550 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:39.456550 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 01:01:39.456550 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 01:01:39.456550 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 01:01:39.456550 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 01:01:39.456550 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 01:01:39.456550 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 01:01:39.456550 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 01:01:39.456550 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:01:39.456550 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 624/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:39.461143 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709637d8-df24-42ac-bedf-ee7d30e7bb02 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:39.508385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:39.565431 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709637d8-df24-42ac-bedf-ee7d30e7bb02 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:39.600708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41db544-7f4f-4f0a-8cfd-a7325b1b73fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:39.601391 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41db544-7f4f-4f0a-8cfd-a7325b1b73fc None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:39.601686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41db544-7f4f-4f0a-8cfd-a7325b1b73fc None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:39.601951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41db544-7f4f-4f0a-8cfd-a7325b1b73fc None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:39.602845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41db544-7f4f-4f0a-8cfd-a7325b1b73fc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:39.603156 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41db544-7f4f-4f0a-8cfd-a7325b1b73fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:39.604675 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41db544-7f4f-4f0a-8cfd-a7325b1b73fc None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:39.621540 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 603/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Sun Jul 24 01:01:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:01:39.627762 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1eca8-9fbd-41bd-8323-1bc0f05312c4 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:39.738482 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f1eca8-9fbd-41bd-8323-1bc0f05312c4 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:39.774736 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a609b-6650-44bc-9565-087b4b272ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:39.775592 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a609b-6650-44bc-9565-087b4b272ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:39.775882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a609b-6650-44bc-9565-087b4b272ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:39.776169 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a609b-6650-44bc-9565-087b4b272ad0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:39.787240 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a609b-6650-44bc-9565-087b4b272ad0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:39.788766 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376a609b-6650-44bc-9565-087b4b272ad0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:39.807904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-376a609b-6650-44bc-9565-087b4b272ad0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:39.807904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:39.807904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:39.807904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:39.807904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:39.807904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:39.807904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:39.807904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:39.807904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:39.807904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:39.807904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:39.807904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:39.807904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 01:01:39.807904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 01:01:39.807904 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:39.809129 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:39.810084 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 01:01:39.810084 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:01:39.810084 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:39.810084 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:01:39.814928 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 625/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:39.816136 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41db544-7f4f-4f0a-8cfd-a7325b1b73fc None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:39.926121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41db544-7f4f-4f0a-8cfd-a7325b1b73fc None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:39.928807 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:39.964625 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8683a1-a767-4518-8977-98a7a429fc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:39.965333 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8683a1-a767-4518-8977-98a7a429fc29 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:39.965656 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8683a1-a767-4518-8977-98a7a429fc29 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:39.965977 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8683a1-a767-4518-8977-98a7a429fc29 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:39.966656 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8683a1-a767-4518-8977-98a7a429fc29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:39.966964 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8683a1-a767-4518-8977-98a7a429fc29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:39.968388 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8683a1-a767-4518-8977-98a7a429fc29 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:39.980113 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 604/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 01:01:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:39.986071 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a609b-6650-44bc-9565-087b4b272ad0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:39.997564 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:40.095269 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a609b-6650-44bc-9565-087b4b272ad0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:40.130494 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f6a80-b12a-4bdf-a115-d39d56efc2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:40.131333 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f6a80-b12a-4bdf-a115-d39d56efc2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:40.131634 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f6a80-b12a-4bdf-a115-d39d56efc2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:40.131925 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f6a80-b12a-4bdf-a115-d39d56efc2d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:40.138641 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f6a80-b12a-4bdf-a115-d39d56efc2d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:40.140171 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f6a80-b12a-4bdf-a115-d39d56efc2d7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:40.154429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-f49f6a80-b12a-4bdf-a115-d39d56efc2d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 01:01:40.154429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:40.154429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:40.154429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:40.154429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:40.154429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:40.154429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:40.154429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:40.154429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:40.154429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:40.154429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:40.154429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:40.154429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 01:01:40.154429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 01:01:40.154429 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:40.155414 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:40.156538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 01:01:40.156538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 01:01:40.156538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:01:40.156538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:01:40.156538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:01:40.156538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:01:40.156538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 01:01:40.156538 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:01:40.156538 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 626/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 01:01:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:40.161833 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8683a1-a767-4518-8977-98a7a429fc29 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:40.271270 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8683a1-a767-4518-8977-98a7a429fc29 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:40.307523 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cb18a-4878-43c1-ad45-9b04b1331437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:40.308238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb18a-4878-43c1-ad45-9b04b1331437 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:40.308537 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb18a-4878-43c1-ad45-9b04b1331437 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:40.308809 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cb18a-4878-43c1-ad45-9b04b1331437 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:40.309830 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cb18a-4878-43c1-ad45-9b04b1331437 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:40.310150 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cb18a-4878-43c1-ad45-9b04b1331437 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:40.311838 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cb18a-4878-43c1-ad45-9b04b1331437 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:40.326161 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 605/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 01:01:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:40.332129 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f6a80-b12a-4bdf-a115-d39d56efc2d7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:40.401731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:40.437474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f6a80-b12a-4bdf-a115-d39d56efc2d7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:40.471531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b3d65-9720-4ed2-8df1-f8a51bfa465d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:40.472446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b3d65-9720-4ed2-8df1-f8a51bfa465d None admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:40.472728 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b3d65-9720-4ed2-8df1-f8a51bfa465d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:40.473005 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b3d65-9720-4ed2-8df1-f8a51bfa465d None admin] PATH_INFO: `/v3/projects/604801625292482a9fb4b70c416dc438/users/333db0711d0f41fe8066ba5b9d91dacc/roles/566ec5e1e87245cea292823f58d150fd` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:40.489107 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b3d65-9720-4ed2-8df1-f8a51bfa465d None admin] RBAC: Authorizing `identity:create_grant(project_id=604801625292482a9fb4b70c416dc438, user_id=333db0711d0f41fe8066ba5b9d91dacc, role_id=566ec5e1e87245cea292823f58d150fd)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:40.490608 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b3d65-9720-4ed2-8df1-f8a51bfa465d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:40.506828 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 627/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 01:01:40 2022] PUT /identity/v3/projects/604801625292482a9fb4b70c416dc438/users/333db0711d0f41fe8066ba5b9d91dacc/roles/566ec5e1e87245cea292823f58d150fd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:01:42.778541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8286a-776b-44ae-a05b-77775040d45e None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:42.779114 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8286a-776b-44ae-a05b-77775040d45e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:42.779235 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b8286a-776b-44ae-a05b-77775040d45e None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:42.780934 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 606/1233] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:01:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:01:42.787245 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9072d9c-e735-4c44-b382-0ca3b4835ec1 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:42.787690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9072d9c-e735-4c44-b382-0ca3b4835ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:42.787826 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9072d9c-e735-4c44-b382-0ca3b4835ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:42.805687 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d9072d9c-e735-4c44-b382-0ca3b4835ec1 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:01:42.806906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d9072d9c-e735-4c44-b382-0ca3b4835ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:42.874784 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 628/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:01:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:01:42.902995 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8286a-776b-44ae-a05b-77775040d45e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:42.930228 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:43.010573 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b8286a-776b-44ae-a05b-77775040d45e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:43.045274 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024a7a1-303f-47d2-9107-909cd13fc611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:43.045996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024a7a1-303f-47d2-9107-909cd13fc611 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:43.046275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024a7a1-303f-47d2-9107-909cd13fc611 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:43.046552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024a7a1-303f-47d2-9107-909cd13fc611 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:43.056297 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024a7a1-303f-47d2-9107-909cd13fc611 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-f024a7a1-303f-47d2-9107-909cd13fc611 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 01:01:43.064514 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:43.065683 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:43.066767 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:43.066767 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:43.066767 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:43.066767 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:43.066767 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 01:01:43.066767 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 01:01:43.066767 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 01:01:43.066767 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 01:01:43.066767 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 01:01:43.066767 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:01:43.066767 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 24 01:01:43.066767 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:43.066767 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 607/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Sun Jul 24 01:01:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:43.072490 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9072d9c-e735-4c44-b382-0ca3b4835ec1 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:43.119618 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:43.176234 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9072d9c-e735-4c44-b382-0ca3b4835ec1 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:43.211241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f2158-1ee6-4696-a747-256a3aa0ed3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:43.211947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f2158-1ee6-4696-a747-256a3aa0ed3b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:43.212232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f2158-1ee6-4696-a747-256a3aa0ed3b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:43.212508 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f2158-1ee6-4696-a747-256a3aa0ed3b None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:43.213252 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f2158-1ee6-4696-a747-256a3aa0ed3b None admin] RBAC: Adding query filter params (name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:43.213560 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f2158-1ee6-4696-a747-256a3aa0ed3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:43.214957 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f2158-1ee6-4696-a747-256a3aa0ed3b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:43.223164 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 629/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Sun Jul 24 01:01:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:43.229207 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024a7a1-303f-47d2-9107-909cd13fc611 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:43.313484 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:43.330715 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024a7a1-303f-47d2-9107-909cd13fc611 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:43.364758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043f92f-1094-47fa-b672-265b3d6b3c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:43.365570 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043f92f-1094-47fa-b672-265b3d6b3c36 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:43.365838 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043f92f-1094-47fa-b672-265b3d6b3c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:43.366108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1043f92f-1094-47fa-b672-265b3d6b3c36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:43.378666 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043f92f-1094-47fa-b672-265b3d6b3c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:43.380369 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1043f92f-1094-47fa-b672-265b3d6b3c36 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:43.401254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-1043f92f-1094-47fa-b672-265b3d6b3c36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:43.401254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:43.401254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:43.401254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:43.401254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:43.401254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:43.401254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:43.401254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:43.401254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:43.401254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:43.401254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:43.401254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:43.401254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 01:01:43.401254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 01:01:43.401254 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:43.402379 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:43.407123 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 01:01:43.407123 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:01:43.407123 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:43.407123 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:43.407123 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 608/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:43.408864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f2158-1ee6-4696-a747-256a3aa0ed3b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:43.521651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f2158-1ee6-4696-a747-256a3aa0ed3b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:43.531072 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:43.558481 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c27c70-173c-43df-bf90-57732244084b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:43.559155 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c27c70-173c-43df-bf90-57732244084b None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:43.559466 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c27c70-173c-43df-bf90-57732244084b None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:43.559740 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c27c70-173c-43df-bf90-57732244084b None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:43.560463 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c27c70-173c-43df-bf90-57732244084b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:43.560771 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c27c70-173c-43df-bf90-57732244084b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:43.562156 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c27c70-173c-43df-bf90-57732244084b None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:43.577275 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 630/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 01:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:43.582563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043f92f-1094-47fa-b672-265b3d6b3c36 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:43.682355 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1043f92f-1094-47fa-b672-265b3d6b3c36 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:43.715671 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d78a6-2ec6-43a6-ba49-2114ffbfe4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:43.716488 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d78a6-2ec6-43a6-ba49-2114ffbfe4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:43.716767 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d78a6-2ec6-43a6-ba49-2114ffbfe4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:43.717035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4d78a6-2ec6-43a6-ba49-2114ffbfe4d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:43.720039 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:43.726064 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d78a6-2ec6-43a6-ba49-2114ffbfe4d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:43.727795 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4d78a6-2ec6-43a6-ba49-2114ffbfe4d9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ac4d78a6-2ec6-43a6-ba49-2114ffbfe4d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 01:01:43.742322 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:43.744318 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:43.745501 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:43.745501 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:43.745501 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 01:01:43.745501 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 01:01:43.745501 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 01:01:43.745501 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 01:01:43.745501 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 01:01:43.745501 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 01:01:43.745501 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 01:01:43.745501 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:43.745501 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 609/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:43.749615 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c27c70-173c-43df-bf90-57732244084b None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:43.856785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c27c70-173c-43df-bf90-57732244084b None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:43.893676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80503e4-93e9-45fa-8a98-da4e50abc317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:43.894357 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80503e4-93e9-45fa-8a98-da4e50abc317 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:43.894641 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80503e4-93e9-45fa-8a98-da4e50abc317 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:43.894918 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80503e4-93e9-45fa-8a98-da4e50abc317 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:43.895823 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80503e4-93e9-45fa-8a98-da4e50abc317 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:43.896132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80503e4-93e9-45fa-8a98-da4e50abc317 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:43.897555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80503e4-93e9-45fa-8a98-da4e50abc317 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:43.915154 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 631/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Sun Jul 24 01:01:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:43.922538 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d78a6-2ec6-43a6-ba49-2114ffbfe4d9 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:44.027320 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4d78a6-2ec6-43a6-ba49-2114ffbfe4d9 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:44.066171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c50da5-3859-48a9-a1ca-77f5046036e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:44.067078 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c50da5-3859-48a9-a1ca-77f5046036e6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:44.067714 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c50da5-3859-48a9-a1ca-77f5046036e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:44.068178 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c50da5-3859-48a9-a1ca-77f5046036e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:44.134580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:44.141427 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c50da5-3859-48a9-a1ca-77f5046036e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:44.142899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c50da5-3859-48a9-a1ca-77f5046036e6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:44.252424 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 610/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 01:01:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 01:01:44.253618 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80503e4-93e9-45fa-8a98-da4e50abc317 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:44.283614 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:44.369382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80503e4-93e9-45fa-8a98-da4e50abc317 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:44.407111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e0301-519f-43aa-adc8-f0495596ca14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:44.408092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e0301-519f-43aa-adc8-f0495596ca14 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:44.408382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e0301-519f-43aa-adc8-f0495596ca14 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:44.408663 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0e0301-519f-43aa-adc8-f0495596ca14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:44.419842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e0301-519f-43aa-adc8-f0495596ca14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:44.421315 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0e0301-519f-43aa-adc8-f0495596ca14 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:44.441252 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-1b0e0301-519f-43aa-adc8-f0495596ca14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:44.441252 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:44.441252 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:44.441252 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:44.441252 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:44.441252 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:44.441252 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:44.441252 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:44.441252 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:44.441252 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:44.441252 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:44.441252 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:44.441252 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 01:01:44.441252 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 01:01:44.441252 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:44.442523 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:44.443517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 01:01:44.443517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:01:44.443517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:44.443517 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:01:44.443517 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 632/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 01:01:44.449186 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c50da5-3859-48a9-a1ca-77f5046036e6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:44.546823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:44.554868 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c50da5-3859-48a9-a1ca-77f5046036e6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:44.601236 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e346146-bd7a-419a-b7f4-afa500628c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:44.601913 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e346146-bd7a-419a-b7f4-afa500628c6c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:44.602194 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e346146-bd7a-419a-b7f4-afa500628c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:44.602470 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e346146-bd7a-419a-b7f4-afa500628c6c None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:44.603193 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e346146-bd7a-419a-b7f4-afa500628c6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:44.603527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e346146-bd7a-419a-b7f4-afa500628c6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:44.604921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e346146-bd7a-419a-b7f4-afa500628c6c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:44.617637 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 611/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 01:01:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:44.623723 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e0301-519f-43aa-adc8-f0495596ca14 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:44.707743 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:44.735947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0e0301-519f-43aa-adc8-f0495596ca14 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:44.774178 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b74ee-8e56-44e6-bc8d-8030c0dc8d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:44.775036 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b74ee-8e56-44e6-bc8d-8030c0dc8d1a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:44.775424 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b74ee-8e56-44e6-bc8d-8030c0dc8d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:44.775626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b74ee-8e56-44e6-bc8d-8030c0dc8d1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:44.783457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b74ee-8e56-44e6-bc8d-8030c0dc8d1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:44.785090 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291b74ee-8e56-44e6-bc8d-8030c0dc8d1a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:44.800847 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-291b74ee-8e56-44e6-bc8d-8030c0dc8d1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 01:01:44.800847 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:44.800847 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:44.800847 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:44.800847 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:44.800847 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:44.800847 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:44.800847 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:44.800847 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:44.800847 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:44.800847 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:44.800847 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:44.800847 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 01:01:44.800847 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 01:01:44.800847 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:44.801950 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:44.802889 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 01:01:44.802889 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 01:01:44.802889 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:01:44.802889 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:01:44.802889 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:01:44.802889 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:01:44.802889 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 01:01:44.802889 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:01:44.802889 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 633/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 01:01:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 01:01:44.808158 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e346146-bd7a-419a-b7f4-afa500628c6c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:44.918783 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e346146-bd7a-419a-b7f4-afa500628c6c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:44.954299 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3e0dc1-eed3-4430-ba26-f204d6dc88f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:44.955028 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e0dc1-eed3-4430-ba26-f204d6dc88f6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:44.955206 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e0dc1-eed3-4430-ba26-f204d6dc88f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:44.955518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3e0dc1-eed3-4430-ba26-f204d6dc88f6 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:44.956308 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e0dc1-eed3-4430-ba26-f204d6dc88f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:44.956649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e0dc1-eed3-4430-ba26-f204d6dc88f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:44.958197 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3e0dc1-eed3-4430-ba26-f204d6dc88f6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:44.976133 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 612/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 01:01:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:44.977450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b74ee-8e56-44e6-bc8d-8030c0dc8d1a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:45.082869 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b74ee-8e56-44e6-bc8d-8030c0dc8d1a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:45.118575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1341ad2-2c98-4a8f-8d27-2318ab21973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:45.119386 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1341ad2-2c98-4a8f-8d27-2318ab21973e None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:45.119733 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1341ad2-2c98-4a8f-8d27-2318ab21973e None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:45.120206 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1341ad2-2c98-4a8f-8d27-2318ab21973e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:45.121060 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1341ad2-2c98-4a8f-8d27-2318ab21973e None admin] RBAC: Adding query filter params (role.id=566ec5e1e87245cea292823f58d150fd, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=333db0711d0f41fe8066ba5b9d91dacc) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:45.121375 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1341ad2-2c98-4a8f-8d27-2318ab21973e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:45.122809 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1341ad2-2c98-4a8f-8d27-2318ab21973e None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:45.128647 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 634/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 01:01:44 2022] GET /identity/v3/role_assignments?user.id=333db0711d0f41fe8066ba5b9d91dacc&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=566ec5e1e87245cea292823f58d150fd => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:47.437453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68c8a6-5fd7-4a8f-82f5-82edef80c292 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:47.438040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68c8a6-5fd7-4a8f-82f5-82edef80c292 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:47.438040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68c8a6-5fd7-4a8f-82f5-82edef80c292 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:47.439783 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 613/1247] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:01:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:01:47.445512 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8e33d-d8cb-49c4-8f92-3121e7db53f5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:47.445930 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8e33d-d8cb-49c4-8f92-3121e7db53f5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:47.446095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8e33d-d8cb-49c4-8f92-3121e7db53f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:47.451638 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:47.465501 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-59c8e33d-d8cb-49c4-8f92-3121e7db53f5 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:01:47.466852 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-59c8e33d-d8cb-49c4-8f92-3121e7db53f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:47.544935 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 635/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:01:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:01:47.574911 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68c8a6-5fd7-4a8f-82f5-82edef80c292 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:47.602738 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:47.702766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68c8a6-5fd7-4a8f-82f5-82edef80c292 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:47.739849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31b2c8-7a08-4b9c-9359-3b97d744ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:47.740674 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31b2c8-7a08-4b9c-9359-3b97d744ea43 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:47.740963 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31b2c8-7a08-4b9c-9359-3b97d744ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:47.741243 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31b2c8-7a08-4b9c-9359-3b97d744ea43 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:47.752626 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31b2c8-7a08-4b9c-9359-3b97d744ea43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ba31b2c8-7a08-4b9c-9359-3b97d744ea43 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 01:01:47.760486 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:47.761704 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:47.762627 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:47.762627 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:47.762627 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:47.762627 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:47.762627 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 01:01:47.762627 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 01:01:47.762627 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 01:01:47.762627 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 01:01:47.762627 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 01:01:47.762627 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:01:47.762627 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:01:47.762627 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:47.762627 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 614/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 01:01:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:47.768176 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8e33d-d8cb-49c4-8f92-3121e7db53f5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:47.882149 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8e33d-d8cb-49c4-8f92-3121e7db53f5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:47.921487 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:47.927821 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6b31a-caf1-4b71-80bc-d6effb4e4e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:47.928504 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6b31a-caf1-4b71-80bc-d6effb4e4e6c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:47.938388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6b31a-caf1-4b71-80bc-d6effb4e4e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:47.938734 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a6b31a-caf1-4b71-80bc-d6effb4e4e6c None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:47.939940 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6b31a-caf1-4b71-80bc-d6effb4e4e6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:47.940429 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6b31a-caf1-4b71-80bc-d6effb4e4e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:47.942655 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a6b31a-caf1-4b71-80bc-d6effb4e4e6c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:47.963358 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 636/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 01:01:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:47.965594 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31b2c8-7a08-4b9c-9359-3b97d744ea43 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:48.061318 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:48.092552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31b2c8-7a08-4b9c-9359-3b97d744ea43 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:48.131608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33394402-1074-4c29-af1e-e596220fe58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:48.132432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33394402-1074-4c29-af1e-e596220fe58c None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:48.132713 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33394402-1074-4c29-af1e-e596220fe58c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:48.132989 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33394402-1074-4c29-af1e-e596220fe58c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:48.144227 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33394402-1074-4c29-af1e-e596220fe58c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:48.145850 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33394402-1074-4c29-af1e-e596220fe58c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:48.164802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-33394402-1074-4c29-af1e-e596220fe58c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:48.164802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:48.164802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:48.164802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:48.164802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:48.164802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:48.164802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:48.164802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:48.164802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:48.164802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:48.164802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:48.164802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:48.164802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 01:01:48.164802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 01:01:48.164802 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:48.165868 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:48.167032 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 01:01:48.167032 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:01:48.167032 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:48.167032 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:48.167032 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 615/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 01:01:48.172608 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6b31a-caf1-4b71-80bc-d6effb4e4e6c None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:48.284925 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a6b31a-caf1-4b71-80bc-d6effb4e4e6c None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:48.342389 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a9a66-a63e-4731-b9b9-3128c0505a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:48.343336 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a9a66-a63e-4731-b9b9-3128c0505a14 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:48.343647 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a9a66-a63e-4731-b9b9-3128c0505a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:48.343924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08a9a66-a63e-4731-b9b9-3128c0505a14 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:48.344660 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a9a66-a63e-4731-b9b9-3128c0505a14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:48.344952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a9a66-a63e-4731-b9b9-3128c0505a14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:48.346342 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08a9a66-a63e-4731-b9b9-3128c0505a14 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:48.361538 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 637/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 01:01:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:01:48.367843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33394402-1074-4c29-af1e-e596220fe58c None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:48.478234 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33394402-1074-4c29-af1e-e596220fe58c None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:48.503798 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:48.512483 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312bde5-725b-4758-b587-3f22021218b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:48.513376 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312bde5-725b-4758-b587-3f22021218b0 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:48.513729 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312bde5-725b-4758-b587-3f22021218b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:48.514017 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a312bde5-725b-4758-b587-3f22021218b0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:48.521928 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312bde5-725b-4758-b587-3f22021218b0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:48.523601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a312bde5-725b-4758-b587-3f22021218b0 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-a312bde5-725b-4758-b587-3f22021218b0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 01:01:48.541353 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:48.542373 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:48.543391 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:48.543391 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:48.543391 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 01:01:48.543391 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 01:01:48.543391 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 01:01:48.543391 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 01:01:48.543391 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 01:01:48.543391 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 01:01:48.543391 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 01:01:48.543391 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:48.543391 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 616/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:48.549768 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a9a66-a63e-4731-b9b9-3128c0505a14 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:48.619676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:48.672523 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08a9a66-a63e-4731-b9b9-3128c0505a14 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:48.713805 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dbef6-ed2d-4f14-aef8-be463a471c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:48.714637 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dbef6-ed2d-4f14-aef8-be463a471c40 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:48.715122 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dbef6-ed2d-4f14-aef8-be463a471c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:48.715720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707dbef6-ed2d-4f14-aef8-be463a471c40 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:48.717301 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dbef6-ed2d-4f14-aef8-be463a471c40 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:48.717810 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dbef6-ed2d-4f14-aef8-be463a471c40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:48.719639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707dbef6-ed2d-4f14-aef8-be463a471c40 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:48.741750 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 638/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Sun Jul 24 01:01:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:01:48.747837 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312bde5-725b-4758-b587-3f22021218b0 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:48.868259 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a312bde5-725b-4758-b587-3f22021218b0 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:48.906932 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4eb90-39c7-4b94-8876-c4080218fc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:48.907658 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4eb90-39c7-4b94-8876-c4080218fc91 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:48.907952 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4eb90-39c7-4b94-8876-c4080218fc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:48.908229 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4eb90-39c7-4b94-8876-c4080218fc91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:48.972081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:48.988417 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4eb90-39c7-4b94-8876-c4080218fc91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:48.990174 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4eb90-39c7-4b94-8876-c4080218fc91 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:49.104686 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 617/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 01:01:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 01:01:49.111400 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dbef6-ed2d-4f14-aef8-be463a471c40 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:49.222722 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707dbef6-ed2d-4f14-aef8-be463a471c40 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:49.238364 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:49.261452 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adb274-7bd4-465d-89e1-c640b38e43f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:49.262343 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adb274-7bd4-465d-89e1-c640b38e43f2 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:49.262658 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adb274-7bd4-465d-89e1-c640b38e43f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:49.262962 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99adb274-7bd4-465d-89e1-c640b38e43f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:49.274071 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adb274-7bd4-465d-89e1-c640b38e43f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:49.276160 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99adb274-7bd4-465d-89e1-c640b38e43f2 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:49.293960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-99adb274-7bd4-465d-89e1-c640b38e43f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:49.293960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:49.293960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:49.293960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:49.293960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:49.293960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:49.293960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:49.293960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:49.293960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:49.293960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:49.293960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:49.293960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:49.293960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 01:01:49.293960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 01:01:49.293960 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:49.295123 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:49.296140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 01:01:49.296140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:01:49.296140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:49.296140 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:01:49.296140 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 639/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:49.301539 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4eb90-39c7-4b94-8876-c4080218fc91 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:49.397336 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:49.410751 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4eb90-39c7-4b94-8876-c4080218fc91 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:49.449499 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd71beb-12e2-43c0-8750-6e561ce76b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:49.450245 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd71beb-12e2-43c0-8750-6e561ce76b89 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:49.450535 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd71beb-12e2-43c0-8750-6e561ce76b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:49.450833 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd71beb-12e2-43c0-8750-6e561ce76b89 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:49.452726 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd71beb-12e2-43c0-8750-6e561ce76b89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:49.453075 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd71beb-12e2-43c0-8750-6e561ce76b89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:49.454654 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd71beb-12e2-43c0-8750-6e561ce76b89 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:49.466612 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 618/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 01:01:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:49.472372 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adb274-7bd4-465d-89e1-c640b38e43f2 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:49.584337 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99adb274-7bd4-465d-89e1-c640b38e43f2 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:49.624198 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759eb0b8-1ec8-47a8-9613-c2d33e9d82f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:49.625026 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759eb0b8-1ec8-47a8-9613-c2d33e9d82f0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:49.625296 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759eb0b8-1ec8-47a8-9613-c2d33e9d82f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:49.625594 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759eb0b8-1ec8-47a8-9613-c2d33e9d82f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:49.632608 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759eb0b8-1ec8-47a8-9613-c2d33e9d82f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:49.634102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759eb0b8-1ec8-47a8-9613-c2d33e9d82f0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:49.648432 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-759eb0b8-1ec8-47a8-9613-c2d33e9d82f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 01:01:49.648432 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:49.648432 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:49.648432 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:49.648432 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:49.648432 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:49.648432 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:49.648432 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:49.648432 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:49.648432 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:49.648432 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:49.648432 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:49.648432 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 01:01:49.648432 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 01:01:49.648432 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:49.649525 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:49.650602 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 01:01:49.650602 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 01:01:49.650602 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:01:49.650602 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:01:49.650602 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:01:49.650602 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:01:49.650602 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 01:01:49.650602 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:01:49.650602 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 640/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 01:01:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 01:01:49.658211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd71beb-12e2-43c0-8750-6e561ce76b89 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:49.781557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd71beb-12e2-43c0-8750-6e561ce76b89 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:49.821736 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f09ef1-0df7-447c-a688-cae59de4a416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:49.822419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09ef1-0df7-447c-a688-cae59de4a416 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:49.822711 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09ef1-0df7-447c-a688-cae59de4a416 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:49.822993 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f09ef1-0df7-447c-a688-cae59de4a416 None admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:49.823835 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f09ef1-0df7-447c-a688-cae59de4a416 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:49.824154 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f09ef1-0df7-447c-a688-cae59de4a416 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:49.825649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f09ef1-0df7-447c-a688-cae59de4a416 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:49.839053 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 619/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 01:01:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:49.845376 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759eb0b8-1ec8-47a8-9613-c2d33e9d82f0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:49.874882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:49.953355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759eb0b8-1ec8-47a8-9613-c2d33e9d82f0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:49.988284 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a442d4-4f53-4c43-beee-7c02a6ca7d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:49.988954 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a442d4-4f53-4c43-beee-7c02a6ca7d4c None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:49.989267 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a442d4-4f53-4c43-beee-7c02a6ca7d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:49.989549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a442d4-4f53-4c43-beee-7c02a6ca7d4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:49.990380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a442d4-4f53-4c43-beee-7c02a6ca7d4c None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=333db0711d0f41fe8066ba5b9d91dacc) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:49.990715 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a442d4-4f53-4c43-beee-7c02a6ca7d4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:49.992158 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a442d4-4f53-4c43-beee-7c02a6ca7d4c None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:50.007034 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 641/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 01:01:49 2022] GET /identity/v3/role_assignments?user.id=333db0711d0f41fe8066ba5b9d91dacc&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:52.088346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf702e3d-fd3b-4ffc-bc0a-dd7e5cb47cd1 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:52.088868 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf702e3d-fd3b-4ffc-bc0a-dd7e5cb47cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:52.088868 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf702e3d-fd3b-4ffc-bc0a-dd7e5cb47cd1 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:52.090876 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 620/1261] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:01:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:01:52.098815 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abe06e-196b-40f5-8cac-84d6a47eb9d0 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:52.099255 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abe06e-196b-40f5-8cac-84d6a47eb9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:52.099378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76abe06e-196b-40f5-8cac-84d6a47eb9d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:52.117634 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-76abe06e-196b-40f5-8cac-84d6a47eb9d0 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:01:52.118811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-76abe06e-196b-40f5-8cac-84d6a47eb9d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:52.187179 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 642/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:01:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 24 01:01:52.211680 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf702e3d-fd3b-4ffc-bc0a-dd7e5cb47cd1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:52.222761 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:52.319906 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf702e3d-fd3b-4ffc-bc0a-dd7e5cb47cd1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:52.354313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557432b-b8cc-4fd6-a38f-5a29bc2c1766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:52.355037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557432b-b8cc-4fd6-a38f-5a29bc2c1766 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:52.355335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557432b-b8cc-4fd6-a38f-5a29bc2c1766 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:52.355626 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557432b-b8cc-4fd6-a38f-5a29bc2c1766 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:52.369883 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6557432b-b8cc-4fd6-a38f-5a29bc2c1766 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6557432b-b8cc-4fd6-a38f-5a29bc2c1766 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 01:01:52.382806 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:52.383940 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:52.384956 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:52.384956 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:52.384956 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:52.384956 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:52.384956 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 01:01:52.384956 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 01:01:52.384956 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 01:01:52.384956 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 01:01:52.384956 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 01:01:52.384956 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:01:52.384956 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:01:52.384956 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:52.384956 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 621/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 01:01:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:52.390031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abe06e-196b-40f5-8cac-84d6a47eb9d0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:52.408820 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:52.490188 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76abe06e-196b-40f5-8cac-84d6a47eb9d0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:52.523476 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0355a-ef37-42ec-b0ac-7689628aa5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:52.524131 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0355a-ef37-42ec-b0ac-7689628aa5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:52.524407 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0355a-ef37-42ec-b0ac-7689628aa5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:52.524685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0355a-ef37-42ec-b0ac-7689628aa5b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:52.525427 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0355a-ef37-42ec-b0ac-7689628aa5b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:52.525753 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0355a-ef37-42ec-b0ac-7689628aa5b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:52.527112 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a0355a-ef37-42ec-b0ac-7689628aa5b8 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:52.535554 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 643/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 01:01:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:52.541809 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557432b-b8cc-4fd6-a38f-5a29bc2c1766 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:52.616439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:52.650263 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6557432b-b8cc-4fd6-a38f-5a29bc2c1766 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:52.683273 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f12929-e5c4-4054-a44d-bece51e08fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:52.684090 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f12929-e5c4-4054-a44d-bece51e08fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:52.684370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f12929-e5c4-4054-a44d-bece51e08fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:52.684645 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f12929-e5c4-4054-a44d-bece51e08fc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:52.695922 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f12929-e5c4-4054-a44d-bece51e08fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:52.697390 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f12929-e5c4-4054-a44d-bece51e08fc6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:52.714818 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-c2f12929-e5c4-4054-a44d-bece51e08fc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:52.714818 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:52.714818 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:52.714818 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:52.714818 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:52.714818 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:52.714818 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:52.714818 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:52.714818 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:52.714818 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:52.714818 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:52.714818 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:52.714818 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 01:01:52.714818 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 01:01:52.714818 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:52.715889 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:52.716898 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 01:01:52.716898 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:01:52.716898 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:52.716898 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:52.716898 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 622/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:52.722516 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0355a-ef37-42ec-b0ac-7689628aa5b8 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:52.804478 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:52.825179 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0355a-ef37-42ec-b0ac-7689628aa5b8 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:52.859651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeade0c7-8677-41c3-9686-5217bcd4589a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:52.860317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeade0c7-8677-41c3-9686-5217bcd4589a None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:52.860600 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeade0c7-8677-41c3-9686-5217bcd4589a None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:52.860874 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeade0c7-8677-41c3-9686-5217bcd4589a None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:52.861593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeade0c7-8677-41c3-9686-5217bcd4589a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:52.861904 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeade0c7-8677-41c3-9686-5217bcd4589a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:52.863282 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeade0c7-8677-41c3-9686-5217bcd4589a None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:52.875028 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 644/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 01:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:01:52.882902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f12929-e5c4-4054-a44d-bece51e08fc6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:52.989063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f12929-e5c4-4054-a44d-bece51e08fc6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:53.015360 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:53.036333 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec13e9-75a2-4450-9253-73c5bb604705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:53.037129 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec13e9-75a2-4450-9253-73c5bb604705 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:53.037414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec13e9-75a2-4450-9253-73c5bb604705 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:53.037683 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec13e9-75a2-4450-9253-73c5bb604705 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:53.045684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec13e9-75a2-4450-9253-73c5bb604705 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:53.047161 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec13e9-75a2-4450-9253-73c5bb604705 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-9dec13e9-75a2-4450-9253-73c5bb604705 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 01:01:53.061995 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:53.063012 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:53.064548 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:53.064548 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:53.064548 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 01:01:53.064548 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 01:01:53.064548 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 01:01:53.064548 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 01:01:53.064548 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 01:01:53.064548 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 01:01:53.064548 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 01:01:53.064548 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:53.064548 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 623/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:53.069968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeade0c7-8677-41c3-9686-5217bcd4589a None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:53.174062 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeade0c7-8677-41c3-9686-5217bcd4589a None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:53.209747 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33266d-848d-4b72-a243-0aa2e224a4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:53.210405 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33266d-848d-4b72-a243-0aa2e224a4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:53.210687 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33266d-848d-4b72-a243-0aa2e224a4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:53.210960 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b33266d-848d-4b72-a243-0aa2e224a4a0 None admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:53.211822 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33266d-848d-4b72-a243-0aa2e224a4a0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:53.212132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33266d-848d-4b72-a243-0aa2e224a4a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:53.213563 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b33266d-848d-4b72-a243-0aa2e224a4a0 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:53.222092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:53.235668 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 645/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Sun Jul 24 01:01:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:53.242069 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec13e9-75a2-4450-9253-73c5bb604705 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:53.346743 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec13e9-75a2-4450-9253-73c5bb604705 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:53.381316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b97800-f1e7-4532-9282-0d7bc0f11682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:53.382097 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97800-f1e7-4532-9282-0d7bc0f11682 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:53.382378 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97800-f1e7-4532-9282-0d7bc0f11682 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:53.382648 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b97800-f1e7-4532-9282-0d7bc0f11682 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:53.393384 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b97800-f1e7-4532-9282-0d7bc0f11682 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:53.394840 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b97800-f1e7-4532-9282-0d7bc0f11682 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:53.412048 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-86b97800-f1e7-4532-9282-0d7bc0f11682 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:53.412048 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:53.412048 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:53.412048 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:53.412048 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:53.412048 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:53.412048 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:53.412048 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:53.412048 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:53.412048 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:53.412048 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:53.412048 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:53.412048 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 01:01:53.412048 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 01:01:53.412048 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:53.413174 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:53.414121 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 01:01:53.414121 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:01:53.414121 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:53.414121 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:53.414121 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 624/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:53.421428 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33266d-848d-4b72-a243-0aa2e224a4a0 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:53.527832 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b33266d-848d-4b72-a243-0aa2e224a4a0 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:53.571998 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df2fba-b5b6-40cc-961e-2fab778583f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:53.572695 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df2fba-b5b6-40cc-961e-2fab778583f3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:53.572955 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df2fba-b5b6-40cc-961e-2fab778583f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:53.573244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6df2fba-b5b6-40cc-961e-2fab778583f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:53.573978 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df2fba-b5b6-40cc-961e-2fab778583f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:53.574298 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df2fba-b5b6-40cc-961e-2fab778583f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:53.575699 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6df2fba-b5b6-40cc-961e-2fab778583f3 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:53.587188 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 646/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 01:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:53.592998 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b97800-f1e7-4532-9282-0d7bc0f11682 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:53.625063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:53.698891 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b97800-f1e7-4532-9282-0d7bc0f11682 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:53.735252 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba320781-a892-4efc-887e-6c558861d891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:53.736076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba320781-a892-4efc-887e-6c558861d891 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:53.736366 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba320781-a892-4efc-887e-6c558861d891 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:53.736641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba320781-a892-4efc-887e-6c558861d891 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:53.743462 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba320781-a892-4efc-887e-6c558861d891 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:53.744916 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba320781-a892-4efc-887e-6c558861d891 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:53.759228 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ba320781-a892-4efc-887e-6c558861d891 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 01:01:53.759228 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:53.759228 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:53.759228 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:53.759228 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:53.759228 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:53.759228 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:53.759228 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:53.759228 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:53.759228 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:53.759228 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:53.759228 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:53.759228 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 01:01:53.759228 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 01:01:53.759228 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:53.760263 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:53.761269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 01:01:53.761269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 01:01:53.761269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:01:53.761269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:01:53.761269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:01:53.761269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:01:53.761269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 01:01:53.761269 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:53.761269 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 625/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 01:01:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 01:01:53.768313 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df2fba-b5b6-40cc-961e-2fab778583f3 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:53.830349 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:53.873885 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6df2fba-b5b6-40cc-961e-2fab778583f3 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:53.908599 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d9bbe-813b-4b05-a0ac-515b1c471ea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:53.909247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d9bbe-813b-4b05-a0ac-515b1c471ea7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:53.909532 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d9bbe-813b-4b05-a0ac-515b1c471ea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:53.909804 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d9bbe-813b-4b05-a0ac-515b1c471ea7 None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:53.910584 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d9bbe-813b-4b05-a0ac-515b1c471ea7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:53.910891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d9bbe-813b-4b05-a0ac-515b1c471ea7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:53.912382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0d9bbe-813b-4b05-a0ac-515b1c471ea7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:53.924129 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 647/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 01:01:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:01:53.934284 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba320781-a892-4efc-887e-6c558861d891 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:54.038316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:54.049056 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba320781-a892-4efc-887e-6c558861d891 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:54.087392 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4f8e87-f17d-4e55-8a5e-90b24ba56d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:54.088575 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f8e87-f17d-4e55-8a5e-90b24ba56d6c None admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:54.088904 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f8e87-f17d-4e55-8a5e-90b24ba56d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:54.089250 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4f8e87-f17d-4e55-8a5e-90b24ba56d6c None admin] PATH_INFO: `/v3/projects/604801625292482a9fb4b70c416dc438/users/333db0711d0f41fe8066ba5b9d91dacc/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:54.092749 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f8e87-f17d-4e55-8a5e-90b24ba56d6c None admin] RBAC: Authorizing `identity:create_grant(project_id=604801625292482a9fb4b70c416dc438, user_id=333db0711d0f41fe8066ba5b9d91dacc, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:54.095029 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4f8e87-f17d-4e55-8a5e-90b24ba56d6c None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:54.116811 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 626/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Sun Jul 24 01:01:53 2022] PUT /identity/v3/projects/604801625292482a9fb4b70c416dc438/users/333db0711d0f41fe8066ba5b9d91dacc/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:01:56.129140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bddb11-cce4-4876-b88a-bab99029195f None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:56.129993 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bddb11-cce4-4876-b88a-bab99029195f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:56.129993 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bddb11-cce4-4876-b88a-bab99029195f None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:56.132215 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 648/1274] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:01:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:01:56.138572 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb6afb-113e-4f0c-aa8f-9de5fe961318 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:56.139013 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb6afb-113e-4f0c-aa8f-9de5fe961318 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:56.139120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedb6afb-113e-4f0c-aa8f-9de5fe961318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:56.158898 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-aedb6afb-113e-4f0c-aa8f-9de5fe961318 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:01:56.160120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-aedb6afb-113e-4f0c-aa8f-9de5fe961318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:01:56.228083 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 627/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:01:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:01:56.255712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bddb11-cce4-4876-b88a-bab99029195f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:56.370509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bddb11-cce4-4876-b88a-bab99029195f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:56.390864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:56.410371 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40641734-b789-4a3e-8bbd-18d20fd60e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:56.411196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40641734-b789-4a3e-8bbd-18d20fd60e5d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:56.411511 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40641734-b789-4a3e-8bbd-18d20fd60e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:56.411787 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40641734-b789-4a3e-8bbd-18d20fd60e5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:56.422967 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40641734-b789-4a3e-8bbd-18d20fd60e5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-40641734-b789-4a3e-8bbd-18d20fd60e5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 24 01:01:56.430679 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:56.431823 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:56.432820 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:56.432820 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:56.432820 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:56.432820 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:56.432820 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 24 01:01:56.432820 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 24 01:01:56.432820 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 24 01:01:56.432820 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 24 01:01:56.432820 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 24 01:01:56.432820 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 24 01:01:56.432820 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 24 01:01:56.432820 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:01:56.435478 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 649/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Sun Jul 24 01:01:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:56.438487 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb6afb-113e-4f0c-aa8f-9de5fe961318 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:56.531364 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:56.554011 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedb6afb-113e-4f0c-aa8f-9de5fe961318 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:56.592897 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc5bba-3ebd-4d34-a5b4-c1794875723e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:56.593811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc5bba-3ebd-4d34-a5b4-c1794875723e None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:56.594157 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc5bba-3ebd-4d34-a5b4-c1794875723e None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:56.594436 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dc5bba-3ebd-4d34-a5b4-c1794875723e None admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:56.595195 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc5bba-3ebd-4d34-a5b4-c1794875723e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:56.595578 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc5bba-3ebd-4d34-a5b4-c1794875723e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:56.597305 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dc5bba-3ebd-4d34-a5b4-c1794875723e None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:56.607405 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 628/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Sun Jul 24 01:01:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:01:56.614165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40641734-b789-4a3e-8bbd-18d20fd60e5d None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:56.715670 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40641734-b789-4a3e-8bbd-18d20fd60e5d None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:56.749810 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20233fb2-ef38-4dba-87d7-ea3c4eb9240f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:56.750590 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20233fb2-ef38-4dba-87d7-ea3c4eb9240f None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:56.750868 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20233fb2-ef38-4dba-87d7-ea3c4eb9240f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:56.751136 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20233fb2-ef38-4dba-87d7-ea3c4eb9240f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:56.762009 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20233fb2-ef38-4dba-87d7-ea3c4eb9240f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:56.763502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20233fb2-ef38-4dba-87d7-ea3c4eb9240f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:56.780696 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-20233fb2-ef38-4dba-87d7-ea3c4eb9240f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:56.780696 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:56.780696 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:56.780696 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:56.780696 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:56.780696 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:56.780696 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:56.780696 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:56.780696 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:56.780696 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:56.780696 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:56.780696 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:56.780696 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 01:01:56.780696 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 01:01:56.780696 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:56.781706 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:56.782634 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 01:01:56.782634 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:01:56.782634 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:56.782634 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:01:56.782634 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 650/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:56.788457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc5bba-3ebd-4d34-a5b4-c1794875723e None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:56.895876 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dc5bba-3ebd-4d34-a5b4-c1794875723e None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:56.930302 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dfa49-5206-45ce-a812-b4e902c74bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:56.930954 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dfa49-5206-45ce-a812-b4e902c74bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:56.931235 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dfa49-5206-45ce-a812-b4e902c74bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:56.931537 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8dfa49-5206-45ce-a812-b4e902c74bf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:56.932251 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8dfa49-5206-45ce-a812-b4e902c74bf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:56.932529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8dfa49-5206-45ce-a812-b4e902c74bf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:56.933932 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8dfa49-5206-45ce-a812-b4e902c74bf6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:56.945977 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 629/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 01:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:56.951887 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20233fb2-ef38-4dba-87d7-ea3c4eb9240f None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:56.984480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:57.056643 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20233fb2-ef38-4dba-87d7-ea3c4eb9240f None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:57.091194 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e729c08-3adb-4ef9-8d7f-a2ee0da1aabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:57.092477 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729c08-3adb-4ef9-8d7f-a2ee0da1aabc None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:57.092921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729c08-3adb-4ef9-8d7f-a2ee0da1aabc None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:57.093336 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e729c08-3adb-4ef9-8d7f-a2ee0da1aabc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:57.106012 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e729c08-3adb-4ef9-8d7f-a2ee0da1aabc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:57.108446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e729c08-3adb-4ef9-8d7f-a2ee0da1aabc None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-5e729c08-3adb-4ef9-8d7f-a2ee0da1aabc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 24 01:01:57.125186 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:57.126349 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:57.127387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:57.127387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:57.127387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 24 01:01:57.127387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 24 01:01:57.127387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 24 01:01:57.127387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 24 01:01:57.127387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 24 01:01:57.127387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 24 01:01:57.127387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 24 01:01:57.127387 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:01:57.127387 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 651/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:57.132320 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dfa49-5206-45ce-a812-b4e902c74bf6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:57.136462 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:57.234730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8dfa49-5206-45ce-a812-b4e902c74bf6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:57.269451 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2357cd-1e9b-446f-8840-6651e64206c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:57.270114 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2357cd-1e9b-446f-8840-6651e64206c6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:57.270424 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2357cd-1e9b-446f-8840-6651e64206c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:57.270696 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2357cd-1e9b-446f-8840-6651e64206c6 None admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:57.271560 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2357cd-1e9b-446f-8840-6651e64206c6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:57.271877 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2357cd-1e9b-446f-8840-6651e64206c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:57.273324 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2357cd-1e9b-446f-8840-6651e64206c6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:57.290214 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 630/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Sun Jul 24 01:01:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:57.298758 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e729c08-3adb-4ef9-8d7f-a2ee0da1aabc None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:57.394211 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:57.414551 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e729c08-3adb-4ef9-8d7f-a2ee0da1aabc None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:57.452249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6339e58-a6ed-45f4-b4cf-d516e25f4d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:57.452897 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6339e58-a6ed-45f4-b4cf-d516e25f4d16 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:57.453180 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6339e58-a6ed-45f4-b4cf-d516e25f4d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:57.453454 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6339e58-a6ed-45f4-b4cf-d516e25f4d16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:57.526938 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6339e58-a6ed-45f4-b4cf-d516e25f4d16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:57.528366 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6339e58-a6ed-45f4-b4cf-d516e25f4d16 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:57.624832 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:57.637005 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 652/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Sun Jul 24 01:01:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 24 01:01:57.646022 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2357cd-1e9b-446f-8840-6651e64206c6 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:57.709713 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:57.761446 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2357cd-1e9b-446f-8840-6651e64206c6 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:57.798205 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf485ed-0252-49ce-b2a1-072acfe5b92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:57.798927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf485ed-0252-49ce-b2a1-072acfe5b92a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:57.799202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf485ed-0252-49ce-b2a1-072acfe5b92a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:57.799502 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf485ed-0252-49ce-b2a1-072acfe5b92a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:57.810397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf485ed-0252-49ce-b2a1-072acfe5b92a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:57.811947 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf485ed-0252-49ce-b2a1-072acfe5b92a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:57.837927 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-6bf485ed-0252-49ce-b2a1-072acfe5b92a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:57.837927 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:57.837927 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:57.837927 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:57.837927 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:57.837927 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:57.837927 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:57.837927 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:57.837927 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:57.837927 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:57.837927 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:57.837927 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:57.837927 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 24 01:01:57.837927 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 24 01:01:57.837927 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:57.839034 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:57.840070 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 24 01:01:57.840070 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 24 01:01:57.840070 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 24 01:01:57.840070 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:57.840070 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 631/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:01:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:01:57.845057 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6339e58-a6ed-45f4-b4cf-d516e25f4d16 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:57.945543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6339e58-a6ed-45f4-b4cf-d516e25f4d16 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:57.980429 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93122c-c9c5-4e80-99b8-647e25e08c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:57.981078 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93122c-c9c5-4e80-99b8-647e25e08c52 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:57.981361 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93122c-c9c5-4e80-99b8-647e25e08c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:57.981640 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c93122c-c9c5-4e80-99b8-647e25e08c52 None admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:57.982392 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93122c-c9c5-4e80-99b8-647e25e08c52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:57.982696 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93122c-c9c5-4e80-99b8-647e25e08c52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:57.984107 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c93122c-c9c5-4e80-99b8-647e25e08c52 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:57.995276 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 653/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Sun Jul 24 01:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:58.003263 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf485ed-0252-49ce-b2a1-072acfe5b92a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:58.110293 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf485ed-0252-49ce-b2a1-072acfe5b92a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:58.127954 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:58.152305 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b1c08-a22e-44df-b9f3-bb9c4095f6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:58.153104 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b1c08-a22e-44df-b9f3-bb9c4095f6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:58.153410 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b1c08-a22e-44df-b9f3-bb9c4095f6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:58.153684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b1c08-a22e-44df-b9f3-bb9c4095f6f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:58.161184 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b1c08-a22e-44df-b9f3-bb9c4095f6f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:58.162625 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2b1c08-a22e-44df-b9f3-bb9c4095f6f5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:58.176572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application [None req-ba2b1c08-a22e-44df-b9f3-bb9c4095f6f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 01:01:58.176572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:01:58.176572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:01:58.176572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:01:58.176572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:01:58.176572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:01:58.176572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:01:58.176572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:01:58.176572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:01:58.176572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:01:58.176572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:01:58.176572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:01:58.176572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 24 01:01:58.176572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 24 01:01:58.176572 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application with Lock( Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:01:58.177571 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:01:58.178500 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 24 01:01:58.178500 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 24 01:01:58.178500 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 24 01:01:58.178500 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 24 01:01:58.178500 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 24 01:01:58.178500 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 24 01:01:58.178500 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 24 01:01:58.178500 dv-cinder-master-3-smb devstack@keystone.service[80520]: ERROR keystone.server.flask.application Jul 24 01:01:58.178500 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 632/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Sun Jul 24 01:01:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 24 01:01:58.184472 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93122c-c9c5-4e80-99b8-647e25e08c52 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:58.240241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:01:58.292300 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c93122c-c9c5-4e80-99b8-647e25e08c52 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:58.327605 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd44b63-0a01-4765-8361-3853add4b15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:58.328209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44b63-0a01-4765-8361-3853add4b15d None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:58.328527 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44b63-0a01-4765-8361-3853add4b15d None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:58.328802 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd44b63-0a01-4765-8361-3853add4b15d None admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:58.329589 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd44b63-0a01-4765-8361-3853add4b15d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:58.329901 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd44b63-0a01-4765-8361-3853add4b15d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:58.331348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd44b63-0a01-4765-8361-3853add4b15d None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:58.343978 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 654/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Sun Jul 24 01:01:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:01:58.350345 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b1c08-a22e-44df-b9f3-bb9c4095f6f5 None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:01:58.481288 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b1c08-a22e-44df-b9f3-bb9c4095f6f5 None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:01:58.525260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4a14a2-0771-4b3c-a9e7-fd812d1200c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:01:58.525921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a14a2-0771-4b3c-a9e7-fd812d1200c9 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:01:58.526216 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a14a2-0771-4b3c-a9e7-fd812d1200c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:01:58.526491 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4a14a2-0771-4b3c-a9e7-fd812d1200c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:01:58.527330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a14a2-0771-4b3c-a9e7-fd812d1200c9 None admin] RBAC: Adding query filter params (role.id=0033a40b55ea484b840c38e3c8e44529, scope.project.id=604801625292482a9fb4b70c416dc438, user.id=333db0711d0f41fe8066ba5b9d91dacc) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:01:58.527646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a14a2-0771-4b3c-a9e7-fd812d1200c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:01:58.529086 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4a14a2-0771-4b3c-a9e7-fd812d1200c9 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:01:58.535049 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 633/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Sun Jul 24 01:01:58 2022] GET /identity/v3/role_assignments?user.id=333db0711d0f41fe8066ba5b9d91dacc&scope.project.id=604801625292482a9fb4b70c416dc438&role.id=0033a40b55ea484b840c38e3c8e44529 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:02:00.548070 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936d866-c9ab-4abb-bc51-3cb7872c8987 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:00.548757 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936d866-c9ab-4abb-bc51-3cb7872c8987 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:00.548757 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a936d866-c9ab-4abb-bc51-3cb7872c8987 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:00.550020 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 655/1288] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:02:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:02:00.556780 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d7a5d-2329-43b9-904a-ca04ae31588b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:00.559402 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d7a5d-2329-43b9-904a-ca04ae31588b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:00.559814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d7a5d-2329-43b9-904a-ca04ae31588b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:00.580162 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4a0d7a5d-2329-43b9-904a-ca04ae31588b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:02:00.581382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4a0d7a5d-2329-43b9-904a-ca04ae31588b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:00.615117 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:00.664088 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 634/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:02:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:02:00.686479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936d866-c9ab-4abb-bc51-3cb7872c8987 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:00.794443 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a936d866-c9ab-4abb-bc51-3cb7872c8987 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:00.805244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:00.831886 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8185b8-d76d-4c2a-b735-ce1e10fe2fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:00.832699 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8185b8-d76d-4c2a-b735-ce1e10fe2fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:00.833061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8185b8-d76d-4c2a-b735-ce1e10fe2fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:00.833334 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8185b8-d76d-4c2a-b735-ce1e10fe2fe3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:00.833989 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8185b8-d76d-4c2a-b735-ce1e10fe2fe3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:00.835531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8185b8-d76d-4c2a-b735-ce1e10fe2fe3 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-fa8185b8-d76d-4c2a-b735-ce1e10fe2fe3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:02:00.847527 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:02:00.848725 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:02:00.849768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:02:00.849768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:02:00.849768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:02:00.849768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:02:00.849768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:02:00.849768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:02:00.849768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:02:00.849768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:02:00.849768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:02:00.849768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:02:00.849768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 01:02:00.849768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 01:02:00.849768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 01:02:00.849768 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:02:00.849768 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 656/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Jul 24 01:02:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:02:00.854823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d7a5d-2329-43b9-904a-ca04ae31588b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:00.954891 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d7a5d-2329-43b9-904a-ca04ae31588b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:00.990180 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f485b-6bab-4fd8-bdb5-60fced5e8ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:00.990818 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f485b-6bab-4fd8-bdb5-60fced5e8ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:00.991095 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f485b-6bab-4fd8-bdb5-60fced5e8ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:00.991394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f485b-6bab-4fd8-bdb5-60fced5e8ad5 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:00.992097 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f485b-6bab-4fd8-bdb5-60fced5e8ad5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:02:00.992399 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f485b-6bab-4fd8-bdb5-60fced5e8ad5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:00.993778 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f485b-6bab-4fd8-bdb5-60fced5e8ad5 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:00.998661 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 635/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Sun Jul 24 01:02:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:02:01.004985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8185b8-d76d-4c2a-b735-ce1e10fe2fe3 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:01.111213 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8185b8-d76d-4c2a-b735-ce1e10fe2fe3 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:01.145170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0f606-4472-4f58-88d0-f78a328af040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:01.145848 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0f606-4472-4f58-88d0-f78a328af040 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:01.146132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0f606-4472-4f58-88d0-f78a328af040 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:01.146411 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0f606-4472-4f58-88d0-f78a328af040 None admin] PATH_INFO: `/v3/services` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:01.147127 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0f606-4472-4f58-88d0-f78a328af040 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:02:01.147479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0f606-4472-4f58-88d0-f78a328af040 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:01.148872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0f606-4472-4f58-88d0-f78a328af040 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:01.153446 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 657/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Sun Jul 24 01:02:01 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:02:03.139732 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c98f4-5642-4ea2-b627-300b625f7ba5 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:03.140610 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c98f4-5642-4ea2-b627-300b625f7ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:03.140610 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c98f4-5642-4ea2-b627-300b625f7ba5 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:03.142660 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 636/1293] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:02:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:02:03.151856 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b343cb-2bfc-4d43-8c57-e337c9f375df None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:03.152363 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b343cb-2bfc-4d43-8c57-e337c9f375df None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:03.152847 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b343cb-2bfc-4d43-8c57-e337c9f375df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:03.177538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-69b343cb-2bfc-4d43-8c57-e337c9f375df None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:02:03.178821 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-69b343cb-2bfc-4d43-8c57-e337c9f375df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:03.211162 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:03.262656 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 658/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:02:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:02:03.294900 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c98f4-5642-4ea2-b627-300b625f7ba5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:03.331515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:03.404225 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c98f4-5642-4ea2-b627-300b625f7ba5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:03.439950 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540db455-4d08-45ac-b513-ffba425dc4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:03.440607 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db455-4d08-45ac-b513-ffba425dc4b7 None admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:03.440885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db455-4d08-45ac-b513-ffba425dc4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:03.441167 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540db455-4d08-45ac-b513-ffba425dc4b7 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:03.441878 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540db455-4d08-45ac-b513-ffba425dc4b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:03.443342 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540db455-4d08-45ac-b513-ffba425dc4b7 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:03.461434 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 637/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Sun Jul 24 01:02:03 2022] POST /identity/v3/services => generated 246 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:02:05.493958 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cbb31-1ca4-4bf8-a200-04662820823d None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:05.494526 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cbb31-1ca4-4bf8-a200-04662820823d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:05.494526 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cbb31-1ca4-4bf8-a200-04662820823d None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:05.495935 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 659/1296] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:02:05.502353 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c857cef-d1f5-4180-a490-fce8e29b6989 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:05.503068 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c857cef-d1f5-4180-a490-fce8e29b6989 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:05.503332 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c857cef-d1f5-4180-a490-fce8e29b6989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:05.522748 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0c857cef-d1f5-4180-a490-fce8e29b6989 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:02:05.523973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0c857cef-d1f5-4180-a490-fce8e29b6989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:05.622158 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 638/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:02:05 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:02:05.647503 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cbb31-1ca4-4bf8-a200-04662820823d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:05.756017 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cbb31-1ca4-4bf8-a200-04662820823d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:05.791421 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efaeaa-da95-4d9c-a664-eaa369394b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:05.792227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efaeaa-da95-4d9c-a664-eaa369394b88 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:05.792511 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efaeaa-da95-4d9c-a664-eaa369394b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:05.792785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efaeaa-da95-4d9c-a664-eaa369394b88 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:05.793442 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efaeaa-da95-4d9c-a664-eaa369394b88 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:05.794830 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efaeaa-da95-4d9c-a664-eaa369394b88 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-e1efaeaa-da95-4d9c-a664-eaa369394b88 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:02:05.807513 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:02:05.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:02:05.809501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:02:05.809501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:02:05.809501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:02:05.809501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:02:05.809501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:02:05.809501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:02:05.809501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:02:05.809501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:02:05.809501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:02:05.809501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:02:05.809501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 01:02:05.809501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 01:02:05.809501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 01:02:05.809501 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:02:05.809501 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 660/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Jul 24 01:02:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:02:05.816075 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c857cef-d1f5-4180-a490-fce8e29b6989 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:05.836080 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:05.922517 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c857cef-d1f5-4180-a490-fce8e29b6989 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:05.962482 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e96a6e-a046-43dd-9a35-a7f42237102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:05.963144 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e96a6e-a046-43dd-9a35-a7f42237102a None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:05.963454 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e96a6e-a046-43dd-9a35-a7f42237102a None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:05.963735 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e96a6e-a046-43dd-9a35-a7f42237102a None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:05.964450 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e96a6e-a046-43dd-9a35-a7f42237102a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:02:05.964760 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e96a6e-a046-43dd-9a35-a7f42237102a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:05.966163 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e96a6e-a046-43dd-9a35-a7f42237102a None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:05.971487 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 639/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Sun Jul 24 01:02:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:02:05.977854 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efaeaa-da95-4d9c-a664-eaa369394b88 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:06.015730 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:06.084569 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efaeaa-da95-4d9c-a664-eaa369394b88 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:06.119521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d46d0a-e019-4852-bc49-929e13e8c966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:06.120167 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d46d0a-e019-4852-bc49-929e13e8c966 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:06.120450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d46d0a-e019-4852-bc49-929e13e8c966 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:06.120722 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d46d0a-e019-4852-bc49-929e13e8c966 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:06.121519 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d46d0a-e019-4852-bc49-929e13e8c966 None admin] RBAC: Adding query filter params (interface=public, service_id=0df47b9a06014e65afbee9cff27f4b42, region_id=RegionOne) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:02:06.121835 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d46d0a-e019-4852-bc49-929e13e8c966 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:06.123222 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d46d0a-e019-4852-bc49-929e13e8c966 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:06.128885 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 661/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Sun Jul 24 01:02:05 2022] GET /identity/v3/endpoints?service_id=0df47b9a06014e65afbee9cff27f4b42&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:02:06.135497 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e96a6e-a046-43dd-9a35-a7f42237102a None admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:06.222115 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:06.240647 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e96a6e-a046-43dd-9a35-a7f42237102a None admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:06.276511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845f129-223f-438f-9c83-29d9257882a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:06.277108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845f129-223f-438f-9c83-29d9257882a6 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:06.277392 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845f129-223f-438f-9c83-29d9257882a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:06.277680 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845f129-223f-438f-9c83-29d9257882a6 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:06.278368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845f129-223f-438f-9c83-29d9257882a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:06.279789 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a845f129-223f-438f-9c83-29d9257882a6 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:06.287243 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 640/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Sun Jul 24 01:02:06 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:02:08.292569 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a40b-522b-4148-9f37-4b5e9c066ecf None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:08.293459 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a40b-522b-4148-9f37-4b5e9c066ecf None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:08.293459 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454a40b-522b-4148-9f37-4b5e9c066ecf None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:08.295665 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 662/1302] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:02:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:02:08.301155 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a18a6-10e4-40c1-9b6d-e9520cd58162 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:08.301721 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a18a6-10e4-40c1-9b6d-e9520cd58162 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:08.301816 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a18a6-10e4-40c1-9b6d-e9520cd58162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:08.320711 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bf5a18a6-10e4-40c1-9b6d-e9520cd58162 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:02:08.321907 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bf5a18a6-10e4-40c1-9b6d-e9520cd58162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:02:08.390811 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 641/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:02:08 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 24 01:02:08.414440 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454a40b-522b-4148-9f37-4b5e9c066ecf None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:08.520479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:08.528651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454a40b-522b-4148-9f37-4b5e9c066ecf None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:08.570357 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db99d8d-f44e-4e97-827d-c7369ffcedb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:08.571095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db99d8d-f44e-4e97-827d-c7369ffcedb7 None admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:08.571417 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db99d8d-f44e-4e97-827d-c7369ffcedb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:08.571693 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db99d8d-f44e-4e97-827d-c7369ffcedb7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:08.572343 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db99d8d-f44e-4e97-827d-c7369ffcedb7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:08.573747 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db99d8d-f44e-4e97-827d-c7369ffcedb7 None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application [None req-6db99d8d-f44e-4e97-827d-c7369ffcedb7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 24 01:02:08.585951 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 24 01:02:08.587118 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.get_or_create( Jul 24 01:02:08.588223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 24 01:02:08.588223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application with Lock( Jul 24 01:02:08.588223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 24 01:02:08.588223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self._enter() Jul 24 01:02:08.588223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 24 01:02:08.588223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 24 01:02:08.588223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 24 01:02:08.588223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application return self.creator() Jul 24 01:02:08.588223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 24 01:02:08.588223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application created_value = creator( Jul 24 01:02:08.588223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 24 01:02:08.588223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 24 01:02:08.588223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 24 01:02:08.588223 dv-cinder-master-3-smb devstack@keystone.service[80519]: ERROR keystone.server.flask.application Jul 24 01:02:08.591465 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 663/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Sun Jul 24 01:02:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 24 01:02:08.593357 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a18a6-10e4-40c1-9b6d-e9520cd58162 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:08.673227 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:08.699708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a18a6-10e4-40c1-9b6d-e9520cd58162 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:08.735876 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493766bc-7944-4659-a252-897e0888e4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:08.736542 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493766bc-7944-4659-a252-897e0888e4d3 None admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:08.736826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493766bc-7944-4659-a252-897e0888e4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:08.737106 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493766bc-7944-4659-a252-897e0888e4d3 None admin] PATH_INFO: `/v3/services` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:08.737817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493766bc-7944-4659-a252-897e0888e4d3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:02:08.738127 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493766bc-7944-4659-a252-897e0888e4d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:08.739545 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493766bc-7944-4659-a252-897e0888e4d3 None admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:08.745015 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 642/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Sun Jul 24 01:02:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:02:08.754210 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db99d8d-f44e-4e97-827d-c7369ffcedb7 None admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:02:08.870159 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db99d8d-f44e-4e97-827d-c7369ffcedb7 None admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:02:08.904672 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef6c091-9cc6-462f-a4a4-747bff4cc22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:02:08.905319 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6c091-9cc6-462f-a4a4-747bff4cc22f None admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:02:08.905598 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6c091-9cc6-462f-a4a4-747bff4cc22f None admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:02:08.905872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef6c091-9cc6-462f-a4a4-747bff4cc22f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:02:08.906605 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6c091-9cc6-462f-a4a4-747bff4cc22f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:02:08.908012 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef6c091-9cc6-462f-a4a4-747bff4cc22f None admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:02:08.931236 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 664/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Sun Jul 24 01:02:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:02:18.741871 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=30 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:02:18.926630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:11.652436 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de566a0-5614-467f-84b0-1ae884cbf0bb None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:11.652914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de566a0-5614-467f-84b0-1ae884cbf0bb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:11.653000 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de566a0-5614-467f-84b0-1ae884cbf0bb None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:11.658315 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 643/1307] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:03:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:11.659918 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ab34f-48bc-4758-aa46-2a624e017ee9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:11.660382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ab34f-48bc-4758-aa46-2a624e017ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:11.660586 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ab34f-48bc-4758-aa46-2a624e017ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:11.764455 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-169ab34f-48bc-4758-aa46-2a624e017ee9 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:11.765683 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-169ab34f-48bc-4758-aa46-2a624e017ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:11.875180 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 665/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:03:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:03:11.923496 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e968c88-e653-40f1-952e-e80a7963f30a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:11.924260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e968c88-e653-40f1-952e-e80a7963f30a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:11.924747 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e968c88-e653-40f1-952e-e80a7963f30a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:11.926692 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 644/1309] 10.222.0.42 () {54 vars in 965 bytes} [Sun Jul 24 01:03:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:11.932479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba39f24-61f3-4d19-83c2-effc87673818 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:11.932775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba39f24-61f3-4d19-83c2-effc87673818 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:11.933059 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba39f24-61f3-4d19-83c2-effc87673818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:12.020181 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9ba39f24-61f3-4d19-83c2-effc87673818 None None] MFA Rules not processed for user `a3efd3928e334e78b4c87bb695718299`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:12.021364 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9ba39f24-61f3-4d19-83c2-effc87673818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:12.042428 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:12.122451 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 666/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Sun Jul 24 01:03:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:12.123200 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e968c88-e653-40f1-952e-e80a7963f30a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:12.125092 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5e968c88-e653-40f1-952e-e80a7963f30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:12.285525 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e968c88-e653-40f1-952e-e80a7963f30a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:12.370921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f2195c-1a6e-462a-b43f-0f5100de1a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:12.371619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2195c-1a6e-462a-b43f-0f5100de1a95 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:12.371905 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2195c-1a6e-462a-b43f-0f5100de1a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:12.372183 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f2195c-1a6e-462a-b43f-0f5100de1a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:12.373845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e1f2195c-1a6e-462a-b43f-0f5100de1a95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:12.431434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:12.488982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2195c-1a6e-462a-b43f-0f5100de1a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:12.490639 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f2195c-1a6e-462a-b43f-0f5100de1a95 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:12.510130 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 645/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:14.817310 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e481226-c545-46b7-b9e1-237239434b17 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:14.817829 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e481226-c545-46b7-b9e1-237239434b17 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:14.817935 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e481226-c545-46b7-b9e1-237239434b17 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:14.819547 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 667/1312] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:14.824848 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2921-0261-4036-9bff-6edc18617a9c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:14.825288 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2921-0261-4036-9bff-6edc18617a9c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:14.825482 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f2921-0261-4036-9bff-6edc18617a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:14.899918 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1c2f2921-0261-4036-9bff-6edc18617a9c None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:14.901133 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1c2f2921-0261-4036-9bff-6edc18617a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:15.003021 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 646/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:03:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:15.041796 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e481226-c545-46b7-b9e1-237239434b17 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:15.043863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8e481226-c545-46b7-b9e1-237239434b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:15.155781 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e481226-c545-46b7-b9e1-237239434b17 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:15.236567 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:15.239924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b2709c-9483-430e-8bfe-b08c5500563a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:15.240897 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2709c-9483-430e-8bfe-b08c5500563a service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:15.241287 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2709c-9483-430e-8bfe-b08c5500563a service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:15.241689 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b2709c-9483-430e-8bfe-b08c5500563a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:15.244126 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-17b2709c-9483-430e-8bfe-b08c5500563a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:15.382945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2709c-9483-430e-8bfe-b08c5500563a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:15.384503 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b2709c-9483-430e-8bfe-b08c5500563a service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:15.408962 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 668/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:17.753546 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603be3c2-a3b8-4ce2-a236-8b2f12bf264e None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:17.754078 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603be3c2-a3b8-4ce2-a236-8b2f12bf264e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:17.754078 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603be3c2-a3b8-4ce2-a236-8b2f12bf264e None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:17.755657 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 647/1315] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:17.761824 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a4a8f-1618-49c7-9132-fa296bf461d4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:17.762281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a4a8f-1618-49c7-9132-fa296bf461d4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:17.762410 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292a4a8f-1618-49c7-9132-fa296bf461d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:17.834695 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-292a4a8f-1618-49c7-9132-fa296bf461d4 None None] MFA Rules not processed for user `30e9db5e0da449078023b57bb514a0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:17.835933 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-292a4a8f-1618-49c7-9132-fa296bf461d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:17.896357 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:17.954718 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 669/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:03:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:17.995190 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603be3c2-a3b8-4ce2-a236-8b2f12bf264e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:17.997684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-603be3c2-a3b8-4ce2-a236-8b2f12bf264e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:18.013624 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:18.114938 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603be3c2-a3b8-4ce2-a236-8b2f12bf264e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:18.189593 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fd1a1-f68a-4aa3-b476-387f6aab68e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:18.190169 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fd1a1-f68a-4aa3-b476-387f6aab68e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:18.190451 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fd1a1-f68a-4aa3-b476-387f6aab68e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:18.190738 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fd1a1-f68a-4aa3-b476-387f6aab68e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:18.192406 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-073fd1a1-f68a-4aa3-b476-387f6aab68e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:18.254485 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:18.303270 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fd1a1-f68a-4aa3-b476-387f6aab68e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:18.304741 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fd1a1-f68a-4aa3-b476-387f6aab68e9 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:18.325361 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 648/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:20.986779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f4eea-9d22-4c87-a9f6-c683315ee4f9 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:20.987676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f4eea-9d22-4c87-a9f6-c683315ee4f9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:20.987835 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f4eea-9d22-4c87-a9f6-c683315ee4f9 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:20.989847 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 670/1318] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:03:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:20.996150 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2922905-22a8-4d6b-a24b-4d2cd2372ddf None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:20.996568 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2922905-22a8-4d6b-a24b-4d2cd2372ddf None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:20.996764 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2922905-22a8-4d6b-a24b-4d2cd2372ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:21.070824 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e2922905-22a8-4d6b-a24b-4d2cd2372ddf None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:21.071980 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e2922905-22a8-4d6b-a24b-4d2cd2372ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:21.174611 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 649/1319] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:03:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:21.217689 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f4eea-9d22-4c87-a9f6-c683315ee4f9 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:21.220169 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2d2f4eea-9d22-4c87-a9f6-c683315ee4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:21.328920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f4eea-9d22-4c87-a9f6-c683315ee4f9 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:21.401763 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f9c4d-b47d-4833-b943-3b038aeb079d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:21.402405 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f9c4d-b47d-4833-b943-3b038aeb079d service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:21.402690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f9c4d-b47d-4833-b943-3b038aeb079d service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:21.402961 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f9c4d-b47d-4833-b943-3b038aeb079d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:21.404604 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8e5f9c4d-b47d-4833-b943-3b038aeb079d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:21.412016 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:21.521123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f9c4d-b47d-4833-b943-3b038aeb079d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:21.522561 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f9c4d-b47d-4833-b943-3b038aeb079d service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:21.540975 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 671/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:24.265841 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd64b8-4ffe-40ff-a3fd-b299f91739d2 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:24.266398 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd64b8-4ffe-40ff-a3fd-b299f91739d2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:24.266398 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcd64b8-4ffe-40ff-a3fd-b299f91739d2 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:24.267981 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 650/1321] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:24.273451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84b4fe-ecc5-477b-9422-6bfbd8728406 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:24.273898 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84b4fe-ecc5-477b-9422-6bfbd8728406 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:24.274004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a84b4fe-ecc5-477b-9422-6bfbd8728406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:24.342903 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6a84b4fe-ecc5-477b-9422-6bfbd8728406 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:24.344178 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6a84b4fe-ecc5-477b-9422-6bfbd8728406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:24.407867 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:24.454427 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 672/1322] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:03:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:24.506094 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b937a-d7ae-4208-8fd1-71bb8938d139 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:24.506348 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b937a-d7ae-4208-8fd1-71bb8938d139 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:24.506680 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b937a-d7ae-4208-8fd1-71bb8938d139 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:24.508133 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 651/1323] 10.222.0.42 () {54 vars in 965 bytes} [Sun Jul 24 01:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:24.514945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b678a-54a6-4af4-b568-017770babf46 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:24.515236 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b678a-54a6-4af4-b568-017770babf46 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:24.515550 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b678a-54a6-4af4-b568-017770babf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:24.596703 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-692b678a-54a6-4af4-b568-017770babf46 None None] MFA Rules not processed for user `a3efd3928e334e78b4c87bb695718299`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:24.597898 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-692b678a-54a6-4af4-b568-017770babf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:24.674143 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 673/1324] 10.222.0.42 () {58 vars in 1062 bytes} [Sun Jul 24 01:03:24 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:24.683059 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b937a-d7ae-4208-8fd1-71bb8938d139 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:24.684641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fc7b937a-d7ae-4208-8fd1-71bb8938d139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:24.704944 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:24.792731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b937a-d7ae-4208-8fd1-71bb8938d139 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:24.875080 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2c95be-db0e-45a7-8ae5-bf41575eb120 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:24.875765 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c95be-db0e-45a7-8ae5-bf41575eb120 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:24.876049 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c95be-db0e-45a7-8ae5-bf41575eb120 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:24.876323 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2c95be-db0e-45a7-8ae5-bf41575eb120 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:24.877972 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ea2c95be-db0e-45a7-8ae5-bf41575eb120 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:24.953247 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:24.991571 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c95be-db0e-45a7-8ae5-bf41575eb120 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:24.993075 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2c95be-db0e-45a7-8ae5-bf41575eb120 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:25.011687 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 652/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:27.289244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94235b96-9565-4a9c-a546-3cb7824db189 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:27.289831 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94235b96-9565-4a9c-a546-3cb7824db189 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:27.289831 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94235b96-9565-4a9c-a546-3cb7824db189 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:27.291178 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 674/1326] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:27.296686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041275-c187-448f-ab47-93b1c1498333 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:27.297087 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041275-c187-448f-ab47-93b1c1498333 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:27.297278 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88041275-c187-448f-ab47-93b1c1498333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:27.364559 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-88041275-c187-448f-ab47-93b1c1498333 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:27.365763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-88041275-c187-448f-ab47-93b1c1498333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:27.472983 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 653/1327] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:03:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:27.509162 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94235b96-9565-4a9c-a546-3cb7824db189 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:27.510764 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-94235b96-9565-4a9c-a546-3cb7824db189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:27.577035 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:27.624177 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94235b96-9565-4a9c-a546-3cb7824db189 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:27.698243 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8c20c-c46e-404b-9368-3fa01b1a5703 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:27.698901 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8c20c-c46e-404b-9368-3fa01b1a5703 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:27.699178 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8c20c-c46e-404b-9368-3fa01b1a5703 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:27.699492 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8c20c-c46e-404b-9368-3fa01b1a5703 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:27.701131 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4cd8c20c-c46e-404b-9368-3fa01b1a5703 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:27.814883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:27.817135 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8c20c-c46e-404b-9368-3fa01b1a5703 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:27.819004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8c20c-c46e-404b-9368-3fa01b1a5703 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:27.838199 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 675/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:29.919638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42862c-f3d4-41d3-80e3-a881d145a22e None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:29.919638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42862c-f3d4-41d3-80e3-a881d145a22e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:29.919638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe42862c-f3d4-41d3-80e3-a881d145a22e None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:29.919638 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 654/1329] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:03:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:29.926106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17884c-5725-4249-b443-912f6e33919b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:29.926106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17884c-5725-4249-b443-912f6e33919b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:29.926106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17884c-5725-4249-b443-912f6e33919b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:30.007240 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fb17884c-5725-4249-b443-912f6e33919b None None] MFA Rules not processed for user `30e9db5e0da449078023b57bb514a0b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:30.008431 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fb17884c-5725-4249-b443-912f6e33919b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:30.106099 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 676/1330] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:03:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:30.147704 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42862c-f3d4-41d3-80e3-a881d145a22e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:30.150101 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fe42862c-f3d4-41d3-80e3-a881d145a22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:30.188536 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:30.267371 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe42862c-f3d4-41d3-80e3-a881d145a22e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:30.348400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9051d239-e409-414d-8a0d-e593b8802af6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:30.349133 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051d239-e409-414d-8a0d-e593b8802af6 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:30.349414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051d239-e409-414d-8a0d-e593b8802af6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:30.349688 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051d239-e409-414d-8a0d-e593b8802af6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:30.351396 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9051d239-e409-414d-8a0d-e593b8802af6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:30.433999 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:30.467877 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051d239-e409-414d-8a0d-e593b8802af6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:30.469333 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9051d239-e409-414d-8a0d-e593b8802af6 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:30.488534 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 655/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:32.925923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8eb01-da0d-4fb5-a7dd-73674dc800f3 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:32.926862 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8eb01-da0d-4fb5-a7dd-73674dc800f3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:32.926862 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8eb01-da0d-4fb5-a7dd-73674dc800f3 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:32.928342 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 677/1332] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:03:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:32.934714 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c14615-aa72-46fc-971f-a983efd48495 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:32.935152 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c14615-aa72-46fc-971f-a983efd48495 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:32.935289 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c14615-aa72-46fc-971f-a983efd48495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:33.010758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-44c14615-aa72-46fc-971f-a983efd48495 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:33.011991 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-44c14615-aa72-46fc-971f-a983efd48495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:33.125539 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 656/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:33.161790 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8eb01-da0d-4fb5-a7dd-73674dc800f3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:33.163420 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cfd8eb01-da0d-4fb5-a7dd-73674dc800f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:33.244464 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:33.280412 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8eb01-da0d-4fb5-a7dd-73674dc800f3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:33.353382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64940680-fcd6-483b-ba14-071a6ffa540b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:33.354026 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64940680-fcd6-483b-ba14-071a6ffa540b service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:33.354300 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64940680-fcd6-483b-ba14-071a6ffa540b service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:33.354568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64940680-fcd6-483b-ba14-071a6ffa540b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:33.356223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-64940680-fcd6-483b-ba14-071a6ffa540b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:33.464364 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64940680-fcd6-483b-ba14-071a6ffa540b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:33.465802 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64940680-fcd6-483b-ba14-071a6ffa540b service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:33.475914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:33.487092 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 678/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:35.548853 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abadab8-f0c1-4f89-be2e-6343bcc16884 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:35.549450 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abadab8-f0c1-4f89-be2e-6343bcc16884 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:35.549450 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abadab8-f0c1-4f89-be2e-6343bcc16884 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:35.550813 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 657/1335] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:35.557277 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b718a3-51c2-4964-8a4a-76fb101943d4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:35.557990 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b718a3-51c2-4964-8a4a-76fb101943d4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:35.558224 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b718a3-51c2-4964-8a4a-76fb101943d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:35.636009 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-42b718a3-51c2-4964-8a4a-76fb101943d4 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:35.637255 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-42b718a3-51c2-4964-8a4a-76fb101943d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:35.744606 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 679/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:03:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:35.788119 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abadab8-f0c1-4f89-be2e-6343bcc16884 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:35.789656 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0abadab8-f0c1-4f89-be2e-6343bcc16884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:35.835815 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:35.912254 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abadab8-f0c1-4f89-be2e-6343bcc16884 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:36.001665 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc94e94-1a6e-4835-90b8-a4c5f037f851 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:36.002324 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc94e94-1a6e-4835-90b8-a4c5f037f851 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:36.002608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc94e94-1a6e-4835-90b8-a4c5f037f851 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:36.002885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc94e94-1a6e-4835-90b8-a4c5f037f851 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:36.004608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7bc94e94-1a6e-4835-90b8-a4c5f037f851 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:36.093464 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:36.118841 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc94e94-1a6e-4835-90b8-a4c5f037f851 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:36.120391 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc94e94-1a6e-4835-90b8-a4c5f037f851 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:36.138326 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 658/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:03:38.489945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3944f2-bd26-4585-acf1-d7342e1accd8 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:38.490518 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3944f2-bd26-4585-acf1-d7342e1accd8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:38.490518 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3944f2-bd26-4585-acf1-d7342e1accd8 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:38.491954 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 680/1338] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:03:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:38.498185 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e33822-30a3-410a-9363-5f3de434ec10 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:38.498615 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e33822-30a3-410a-9363-5f3de434ec10 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:38.498770 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e33822-30a3-410a-9363-5f3de434ec10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:38.568657 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-90e33822-30a3-410a-9363-5f3de434ec10 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:38.569874 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-90e33822-30a3-410a-9363-5f3de434ec10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:38.668477 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 659/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:03:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:38.709450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3944f2-bd26-4585-acf1-d7342e1accd8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:38.711063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6b3944f2-bd26-4585-acf1-d7342e1accd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:38.789074 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:38.819634 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3944f2-bd26-4585-acf1-d7342e1accd8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:38.898937 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa78cd0-7894-43d6-a002-4f53d1a1f589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:38.899624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa78cd0-7894-43d6-a002-4f53d1a1f589 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:38.899910 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa78cd0-7894-43d6-a002-4f53d1a1f589 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:38.900184 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa78cd0-7894-43d6-a002-4f53d1a1f589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:38.901834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3aa78cd0-7894-43d6-a002-4f53d1a1f589 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:39.031326 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa78cd0-7894-43d6-a002-4f53d1a1f589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:39.032805 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa78cd0-7894-43d6-a002-4f53d1a1f589 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:39.052906 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 681/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:03:43.171821 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da488b-563d-4492-915d-717f90f80411 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:43.172399 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da488b-563d-4492-915d-717f90f80411 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:43.172399 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25da488b-563d-4492-915d-717f90f80411 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:43.173781 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 660/1341] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:43.179340 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5df769-fa94-4d0d-a256-922510f319a5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:43.179800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5df769-fa94-4d0d-a256-922510f319a5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:43.179883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5df769-fa94-4d0d-a256-922510f319a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:43.184668 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:43.249196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2f5df769-fa94-4d0d-a256-922510f319a5 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:43.250425 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2f5df769-fa94-4d0d-a256-922510f319a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:43.352143 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 682/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:43.393576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da488b-563d-4492-915d-717f90f80411 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:43.395143 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-25da488b-563d-4492-915d-717f90f80411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:43.446642 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:43.505748 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25da488b-563d-4492-915d-717f90f80411 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:43.584384 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215f18b-931f-42cc-a931-acbe8f9dee08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:43.585047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215f18b-931f-42cc-a931-acbe8f9dee08 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:43.585332 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215f18b-931f-42cc-a931-acbe8f9dee08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:43.585611 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215f18b-931f-42cc-a931-acbe8f9dee08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:43.587312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5215f18b-931f-42cc-a931-acbe8f9dee08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:43.684420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:43.701522 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215f18b-931f-42cc-a931-acbe8f9dee08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:43.702983 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215f18b-931f-42cc-a931-acbe8f9dee08 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:43.721023 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 661/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:46.346166 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de90b8a-c2cc-47f3-8e2f-2b613ce8725c None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:46.346804 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de90b8a-c2cc-47f3-8e2f-2b613ce8725c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:46.346804 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de90b8a-c2cc-47f3-8e2f-2b613ce8725c None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:46.348193 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 683/1344] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:46.354010 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c8e13-af0d-433a-8caf-a1bb22d6754f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:46.354515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c8e13-af0d-433a-8caf-a1bb22d6754f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:46.354677 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299c8e13-af0d-433a-8caf-a1bb22d6754f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:46.429409 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-299c8e13-af0d-433a-8caf-a1bb22d6754f None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:46.430659 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-299c8e13-af0d-433a-8caf-a1bb22d6754f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:46.536319 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 662/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:03:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:46.575369 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de90b8a-c2cc-47f3-8e2f-2b613ce8725c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:46.576943 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3de90b8a-c2cc-47f3-8e2f-2b613ce8725c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:46.664244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:46.680915 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de90b8a-c2cc-47f3-8e2f-2b613ce8725c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:46.755029 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f60f19-6022-496b-809c-7d098f796915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:46.755713 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f60f19-6022-496b-809c-7d098f796915 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:46.756001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f60f19-6022-496b-809c-7d098f796915 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:46.756263 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f60f19-6022-496b-809c-7d098f796915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:46.757954 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-88f60f19-6022-496b-809c-7d098f796915 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:46.877246 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f60f19-6022-496b-809c-7d098f796915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:46.878716 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f60f19-6022-496b-809c-7d098f796915 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:46.898455 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 684/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:50.823885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f61d14-6ae0-4b83-97c3-bab087d5e5f2 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:50.824457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f61d14-6ae0-4b83-97c3-bab087d5e5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:50.824457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f61d14-6ae0-4b83-97c3-bab087d5e5f2 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:50.826001 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 663/1347] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:50.831217 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf85f4d-98b4-480e-a87e-420933667d04 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:50.831684 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf85f4d-98b4-480e-a87e-420933667d04 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:50.831816 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf85f4d-98b4-480e-a87e-420933667d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:50.846564 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:50.899049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1cf85f4d-98b4-480e-a87e-420933667d04 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:50.900763 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1cf85f4d-98b4-480e-a87e-420933667d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:51.009326 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 685/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:03:51.049271 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f61d14-6ae0-4b83-97c3-bab087d5e5f2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:03:51.050856 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-93f61d14-6ae0-4b83-97c3-bab087d5e5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:51.115442 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:51.167110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f61d14-6ae0-4b83-97c3-bab087d5e5f2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:03:51.242992 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365a23c-034c-4670-b006-705fa7fe96da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:03:51.243615 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365a23c-034c-4670-b006-705fa7fe96da service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:51.243898 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365a23c-034c-4670-b006-705fa7fe96da service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:51.244175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365a23c-034c-4670-b006-705fa7fe96da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:51.245855 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e365a23c-034c-4670-b006-705fa7fe96da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:51.357176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:03:51.361006 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365a23c-034c-4670-b006-705fa7fe96da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:03:51.362979 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365a23c-034c-4670-b006-705fa7fe96da service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:03:51.382199 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 664/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:03:56.374808 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83c02c-3594-488e-9db9-a7174dead61a None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:56.375977 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83c02c-3594-488e-9db9-a7174dead61a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:56.376462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a83c02c-3594-488e-9db9-a7174dead61a None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:56.378369 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 686/1350] 10.222.0.42 () {54 vars in 921 bytes} [Sun Jul 24 01:03:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:03:56.384022 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa72a89-c45b-4572-8331-a401a391523d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:03:56.384441 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa72a89-c45b-4572-8331-a401a391523d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:03:56.384534 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa72a89-c45b-4572-8331-a401a391523d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:03:56.462350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9fa72a89-c45b-4572-8331-a401a391523d None None] MFA Rules not processed for user `333db0711d0f41fe8066ba5b9d91dacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:03:56.463727 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9fa72a89-c45b-4572-8331-a401a391523d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:03:56.588957 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 665/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Jul 24 01:03:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:00.548658 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388da1f-f20f-426e-843d-df5f9c1673d4 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:00.550137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388da1f-f20f-426e-843d-df5f9c1673d4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:00.550455 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388da1f-f20f-426e-843d-df5f9c1673d4 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:00.552736 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 687/1352] 10.222.0.42 () {54 vars in 921 bytes} [Sun Jul 24 01:04:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:00.558214 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e5a31-bbed-4e7d-bb92-2f8b7e4c4907 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:00.558669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e5a31-bbed-4e7d-bb92-2f8b7e4c4907 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:00.558960 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7e5a31-bbed-4e7d-bb92-2f8b7e4c4907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:00.614716 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:00.639153 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3d7e5a31-bbed-4e7d-bb92-2f8b7e4c4907 None None] MFA Rules not processed for user `333db0711d0f41fe8066ba5b9d91dacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:00.640651 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3d7e5a31-bbed-4e7d-bb92-2f8b7e4c4907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:00.751796 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 666/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Jul 24 01:04:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:01.004596 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=59 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:02.128109 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c01006-424f-4c24-92f3-48016ff0e897 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:02.128806 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c01006-424f-4c24-92f3-48016ff0e897 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:02.128806 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c01006-424f-4c24-92f3-48016ff0e897 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:02.130276 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 688/1354] 10.222.0.42 () {54 vars in 921 bytes} [Sun Jul 24 01:04:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:02.135602 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3f082-a1e5-44d1-8ec1-3e3745766c97 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:02.136036 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3f082-a1e5-44d1-8ec1-3e3745766c97 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:02.136298 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e3f082-a1e5-44d1-8ec1-3e3745766c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:02.216758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-93e3f082-a1e5-44d1-8ec1-3e3745766c97 None None] MFA Rules not processed for user `333db0711d0f41fe8066ba5b9d91dacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:02.217967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-93e3f082-a1e5-44d1-8ec1-3e3745766c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:02.263149 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:02.333117 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 667/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Jul 24 01:04:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:05.815489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b924c53-9e0c-4e49-ad57-876b9cadd3f3 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:05.816362 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b924c53-9e0c-4e49-ad57-876b9cadd3f3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:05.817848 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b924c53-9e0c-4e49-ad57-876b9cadd3f3 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:05.820636 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 689/1356] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:04:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:05.826384 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deab37-ec21-4152-9379-d312b8b41d7d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:05.827194 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deab37-ec21-4152-9379-d312b8b41d7d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:05.827678 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70deab37-ec21-4152-9379-d312b8b41d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:05.909406 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-70deab37-ec21-4152-9379-d312b8b41d7d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:05.910660 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-70deab37-ec21-4152-9379-d312b8b41d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:06.016250 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 668/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:04:06.072366 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd113bb-9d42-40d5-9d7f-58bff674a079 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:06.073541 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd113bb-9d42-40d5-9d7f-58bff674a079 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:06.074330 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd113bb-9d42-40d5-9d7f-58bff674a079 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:06.078329 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 690/1358] 10.222.0.42 () {54 vars in 962 bytes} [Sun Jul 24 01:04:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:06.085862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf590521-febf-4128-a0ff-e85825f896a4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:06.086079 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf590521-febf-4128-a0ff-e85825f896a4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:06.086414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf590521-febf-4128-a0ff-e85825f896a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:06.102099 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:06.171035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bf590521-febf-4128-a0ff-e85825f896a4 None None] MFA Rules not processed for user `6c32c443ee1a421e98e7656e8e86e27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:06.172300 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bf590521-febf-4128-a0ff-e85825f896a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:06.307434 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 669/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Sun Jul 24 01:04:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:06.316226 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd113bb-9d42-40d5-9d7f-58bff674a079 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:06.318050 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0cd113bb-9d42-40d5-9d7f-58bff674a079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:06.466128 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd113bb-9d42-40d5-9d7f-58bff674a079 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:06.540830 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:06.584495 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f7a555-94d2-474b-a38c-b7d8633f945e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:06.585066 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7a555-94d2-474b-a38c-b7d8633f945e service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:06.585353 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7a555-94d2-474b-a38c-b7d8633f945e service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:06.585635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f7a555-94d2-474b-a38c-b7d8633f945e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:06.587276 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b5f7a555-94d2-474b-a38c-b7d8633f945e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:06.690630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7a555-94d2-474b-a38c-b7d8633f945e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:06.692348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f7a555-94d2-474b-a38c-b7d8633f945e service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:06.711064 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 691/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:04:08.947260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33ba9d-b571-4a1d-bed9-ce3474c02709 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:08.947880 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33ba9d-b571-4a1d-bed9-ce3474c02709 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:08.947880 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33ba9d-b571-4a1d-bed9-ce3474c02709 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:08.949468 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 670/1361] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:08.954892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2765ee-f4b0-4070-ade3-93c67e5309b8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:08.955742 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2765ee-f4b0-4070-ade3-93c67e5309b8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:08.956005 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2765ee-f4b0-4070-ade3-93c67e5309b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:09.029063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3a2765ee-f4b0-4070-ade3-93c67e5309b8 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:09.030550 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3a2765ee-f4b0-4070-ade3-93c67e5309b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:09.072970 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:09.139464 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 692/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:09.181486 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33ba9d-b571-4a1d-bed9-ce3474c02709 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:09.183054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dc33ba9d-b571-4a1d-bed9-ce3474c02709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:09.254475 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:09.342711 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33ba9d-b571-4a1d-bed9-ce3474c02709 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:09.501850 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b68019b-ea2f-435d-9707-405a10af03d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:09.502546 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68019b-ea2f-435d-9707-405a10af03d7 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:09.502834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68019b-ea2f-435d-9707-405a10af03d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:09.503116 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b68019b-ea2f-435d-9707-405a10af03d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:09.504923 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4b68019b-ea2f-435d-9707-405a10af03d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:09.528648 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:09.606126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68019b-ea2f-435d-9707-405a10af03d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:09.607777 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b68019b-ea2f-435d-9707-405a10af03d7 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:09.626833 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 671/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:04:12.009676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0bd5-b11d-46b4-85ff-4bfc0cdbfa61 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:12.010210 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0bd5-b11d-46b4-85ff-4bfc0cdbfa61 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:12.010296 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb0bd5-b11d-46b4-85ff-4bfc0cdbfa61 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:12.011838 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 693/1364] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:12.017126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e2031-e773-436b-b23d-a965dcb60953 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:12.017576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e2031-e773-436b-b23d-a965dcb60953 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:12.017684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612e2031-e773-436b-b23d-a965dcb60953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:12.099054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-612e2031-e773-436b-b23d-a965dcb60953 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:12.100438 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-612e2031-e773-436b-b23d-a965dcb60953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:12.203479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:12.211432 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 672/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:04:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:12.252878 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407c1b-fc98-48a0-a3b7-cac13a788624 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:12.253470 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407c1b-fc98-48a0-a3b7-cac13a788624 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:12.253762 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec407c1b-fc98-48a0-a3b7-cac13a788624 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:12.255271 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 694/1366] 10.222.0.42 () {54 vars in 962 bytes} [Sun Jul 24 01:04:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:12.261062 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c00bb-dde0-4d9c-b02f-1bbf67672f95 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:12.261468 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c00bb-dde0-4d9c-b02f-1bbf67672f95 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:12.261758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c00bb-dde0-4d9c-b02f-1bbf67672f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:12.348222 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-278c00bb-dde0-4d9c-b02f-1bbf67672f95 None None] MFA Rules not processed for user `6c32c443ee1a421e98e7656e8e86e27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:12.349527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-278c00bb-dde0-4d9c-b02f-1bbf67672f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:12.469338 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 673/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Sun Jul 24 01:04:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:12.477481 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec407c1b-fc98-48a0-a3b7-cac13a788624 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:12.479059 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ec407c1b-fc98-48a0-a3b7-cac13a788624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:12.639522 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec407c1b-fc98-48a0-a3b7-cac13a788624 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:12.660397 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:12.757330 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb2ef07-7b98-42df-971c-1ecce49cffca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:12.757991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2ef07-7b98-42df-971c-1ecce49cffca service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:12.758275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2ef07-7b98-42df-971c-1ecce49cffca service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:12.758550 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb2ef07-7b98-42df-971c-1ecce49cffca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:12.760223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7bb2ef07-7b98-42df-971c-1ecce49cffca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:12.857892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2ef07-7b98-42df-971c-1ecce49cffca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:12.859549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb2ef07-7b98-42df-971c-1ecce49cffca service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:12.878055 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 695/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:04:13.888959 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3948e4-fbcc-417f-bb49-c72869fd923c None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:13.889508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3948e4-fbcc-417f-bb49-c72869fd923c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:13.889508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3948e4-fbcc-417f-bb49-c72869fd923c None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:13.891218 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 674/1369] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:13.896350 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595b484-6ca8-4617-a2fd-f3913fdd0983 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:13.896821 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595b484-6ca8-4617-a2fd-f3913fdd0983 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:13.896923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595b484-6ca8-4617-a2fd-f3913fdd0983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:13.929549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:13.969060 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0595b484-6ca8-4617-a2fd-f3913fdd0983 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:13.970372 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0595b484-6ca8-4617-a2fd-f3913fdd0983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:14.084649 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 696/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:14.431768 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fd095-cbf1-4d03-800b-369f609398a8 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:14.431768 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fd095-cbf1-4d03-800b-369f609398a8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:14.431768 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fd095-cbf1-4d03-800b-369f609398a8 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:14.431768 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 675/1371] 10.222.0.42 () {54 vars in 964 bytes} [Sun Jul 24 01:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:14.435815 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee7cef-b38c-45ce-8bb9-f3c71be78d3b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:14.436110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee7cef-b38c-45ce-8bb9-f3c71be78d3b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:14.436749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ee7cef-b38c-45ce-8bb9-f3c71be78d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:14.514375 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a0ee7cef-b38c-45ce-8bb9-f3c71be78d3b None None] MFA Rules not processed for user `fa52d40556494110bf6962e09addfc15`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:14.517639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a0ee7cef-b38c-45ce-8bb9-f3c71be78d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:14.570912 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:14.606642 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 697/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Sun Jul 24 01:04:14 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:14.609988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fd095-cbf1-4d03-800b-369f609398a8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:14.611643 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-080fd095-cbf1-4d03-800b-369f609398a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:14.667059 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:14.727563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fd095-cbf1-4d03-800b-369f609398a8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:14.808517 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff602703-85c9-4841-b018-8969fefdefd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:14.812784 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff602703-85c9-4841-b018-8969fefdefd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:14.812784 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff602703-85c9-4841-b018-8969fefdefd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:14.812784 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff602703-85c9-4841-b018-8969fefdefd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:14.812784 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ff602703-85c9-4841-b018-8969fefdefd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:14.914636 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:14.930036 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff602703-85c9-4841-b018-8969fefdefd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:14.931430 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff602703-85c9-4841-b018-8969fefdefd9 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:14.950793 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 676/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:04:14.963924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a8cb1-f957-4a21-be29-77388f3da74a None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:14.964410 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a8cb1-f957-4a21-be29-77388f3da74a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:14.964610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a8cb1-f957-4a21-be29-77388f3da74a None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:14.965886 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 698/1374] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:14.971209 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8b9dd-6674-4c1c-972a-93132191defc None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:14.971547 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8b9dd-6674-4c1c-972a-93132191defc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:14.971889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8b9dd-6674-4c1c-972a-93132191defc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:15.041989 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-45f8b9dd-6674-4c1c-972a-93132191defc None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:15.043186 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-45f8b9dd-6674-4c1c-972a-93132191defc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:15.155582 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 677/1375] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:04:15.198962 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a8cb1-f957-4a21-be29-77388f3da74a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:15.200506 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6a6a8cb1-f957-4a21-be29-77388f3da74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:15.362067 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a8cb1-f957-4a21-be29-77388f3da74a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:15.412564 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:15.473530 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f496a980-b2ca-40b0-9824-eb1c1fe43c19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:15.474190 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496a980-b2ca-40b0-9824-eb1c1fe43c19 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:15.474467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496a980-b2ca-40b0-9824-eb1c1fe43c19 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:15.474731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496a980-b2ca-40b0-9824-eb1c1fe43c19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:15.476397 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f496a980-b2ca-40b0-9824-eb1c1fe43c19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:15.566627 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496a980-b2ca-40b0-9824-eb1c1fe43c19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:15.568279 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f496a980-b2ca-40b0-9824-eb1c1fe43c19 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:15.586688 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 699/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:04:17.662756 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7ac2f-ba66-49a8-aa8a-4172cce7d5d9 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:17.662756 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7ac2f-ba66-49a8-aa8a-4172cce7d5d9 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:17.662756 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d7ac2f-ba66-49a8-aa8a-4172cce7d5d9 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:17.662756 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 678/1377] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:17.664814 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462d3cc-1cca-4b14-8f9f-4ae73263cd5e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:17.665227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462d3cc-1cca-4b14-8f9f-4ae73263cd5e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:17.665332 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462d3cc-1cca-4b14-8f9f-4ae73263cd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:17.736147 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f462d3cc-1cca-4b14-8f9f-4ae73263cd5e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:17.737423 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f462d3cc-1cca-4b14-8f9f-4ae73263cd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:17.744583 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:17.846378 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 700/1378] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:17.890843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7ac2f-ba66-49a8-aa8a-4172cce7d5d9 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:17.892546 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-16d7ac2f-ba66-49a8-aa8a-4172cce7d5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:17.960624 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:18.069505 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d7ac2f-ba66-49a8-aa8a-4172cce7d5d9 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:18.187542 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700b437-8fda-4fd9-b96c-985c3f35bde8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:18.188195 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700b437-8fda-4fd9-b96c-985c3f35bde8 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:18.188474 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700b437-8fda-4fd9-b96c-985c3f35bde8 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:18.188746 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700b437-8fda-4fd9-b96c-985c3f35bde8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:18.190416 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4700b437-8fda-4fd9-b96c-985c3f35bde8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:18.209310 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:18.285835 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700b437-8fda-4fd9-b96c-985c3f35bde8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:18.287436 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700b437-8fda-4fd9-b96c-985c3f35bde8 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:18.326825 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 679/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:04:20.420707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ff6c0-44cb-436f-9be5-14c8b2b659c6 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:20.421252 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ff6c0-44cb-436f-9be5-14c8b2b659c6 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:20.421252 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ff6c0-44cb-436f-9be5-14c8b2b659c6 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:20.422573 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 701/1380] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:20.428063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21948542-cc35-4508-a3f2-0d9d34de07a5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:20.428513 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21948542-cc35-4508-a3f2-0d9d34de07a5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:20.428852 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21948542-cc35-4508-a3f2-0d9d34de07a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:20.507397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-21948542-cc35-4508-a3f2-0d9d34de07a5 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:20.508791 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-21948542-cc35-4508-a3f2-0d9d34de07a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:20.606197 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:20.613762 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 680/1381] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:20.657632 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ff6c0-44cb-436f-9be5-14c8b2b659c6 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:20.659468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-129ff6c0-44cb-436f-9be5-14c8b2b659c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:20.826956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:20.838936 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ff6c0-44cb-436f-9be5-14c8b2b659c6 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:20.960133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bdc2bc-0fa1-405b-90db-f90952fb1e9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:20.960868 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdc2bc-0fa1-405b-90db-f90952fb1e9a service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:20.961321 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdc2bc-0fa1-405b-90db-f90952fb1e9a service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:20.961690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bdc2bc-0fa1-405b-90db-f90952fb1e9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:20.963774 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b1bdc2bc-0fa1-405b-90db-f90952fb1e9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:21.061748 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdc2bc-0fa1-405b-90db-f90952fb1e9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:21.063693 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bdc2bc-0fa1-405b-90db-f90952fb1e9a service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:21.074789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:21.085541 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 702/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:04:23.185870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b679d-cd9c-46fd-995e-610543b0b086 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:23.186766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b679d-cd9c-46fd-995e-610543b0b086 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:23.186869 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262b679d-cd9c-46fd-995e-610543b0b086 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:23.188841 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 681/1383] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:04:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:23.195941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394b500-ee14-4812-9a02-cbab12a090e6 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:23.196380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394b500-ee14-4812-9a02-cbab12a090e6 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:23.196743 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394b500-ee14-4812-9a02-cbab12a090e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:23.281201 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3394b500-ee14-4812-9a02-cbab12a090e6 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:23.282506 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3394b500-ee14-4812-9a02-cbab12a090e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:23.396674 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 703/1384] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:23.445495 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b679d-cd9c-46fd-995e-610543b0b086 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:23.447225 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-262b679d-cd9c-46fd-995e-610543b0b086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:23.606239 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262b679d-cd9c-46fd-995e-610543b0b086 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:23.676083 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:23.728493 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b671b66b-96df-45fe-b27c-2e3c64e978bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:23.729342 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671b66b-96df-45fe-b27c-2e3c64e978bb service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:23.729725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671b66b-96df-45fe-b27c-2e3c64e978bb service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:23.730086 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b671b66b-96df-45fe-b27c-2e3c64e978bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:23.732556 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b671b66b-96df-45fe-b27c-2e3c64e978bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:23.840584 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671b66b-96df-45fe-b27c-2e3c64e978bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:23.843163 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b671b66b-96df-45fe-b27c-2e3c64e978bb service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:23.867645 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 682/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:04:26.362932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e1007-54af-4da6-a686-f3046016a8b0 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:26.363731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e1007-54af-4da6-a686-f3046016a8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:26.363858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e1007-54af-4da6-a686-f3046016a8b0 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:26.365916 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 704/1386] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:04:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:26.371862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2e788-8711-4b71-bcc8-f9fd5eb1d5e1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:26.372331 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2e788-8711-4b71-bcc8-f9fd5eb1d5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:26.372511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c2e788-8711-4b71-bcc8-f9fd5eb1d5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:26.450678 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-46c2e788-8711-4b71-bcc8-f9fd5eb1d5e1 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:26.452096 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-46c2e788-8711-4b71-bcc8-f9fd5eb1d5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:26.486494 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:26.557664 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 683/1387] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:26.605577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e1007-54af-4da6-a686-f3046016a8b0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:26.607521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-588e1007-54af-4da6-a686-f3046016a8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:26.829884 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:26.902900 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e1007-54af-4da6-a686-f3046016a8b0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:27.023734 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58c84c-ac1e-4fe9-a5a8-8297a1904482 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:27.024438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58c84c-ac1e-4fe9-a5a8-8297a1904482 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:27.024730 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58c84c-ac1e-4fe9-a5a8-8297a1904482 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:27.025025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58c84c-ac1e-4fe9-a5a8-8297a1904482 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:27.026765 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9e58c84c-ac1e-4fe9-a5a8-8297a1904482 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:27.066462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:27.119441 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58c84c-ac1e-4fe9-a5a8-8297a1904482 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:27.121178 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58c84c-ac1e-4fe9-a5a8-8297a1904482 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:27.141342 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 705/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:04:29.358511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb7643-0cb7-4059-87ab-edbb713526e6 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:29.359142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb7643-0cb7-4059-87ab-edbb713526e6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:29.359142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbb7643-0cb7-4059-87ab-edbb713526e6 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:29.360593 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 684/1389] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:29.366064 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffdfa9-f46d-4b22-872e-7e6b91823b6d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:29.366507 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffdfa9-f46d-4b22-872e-7e6b91823b6d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:29.366613 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffdfa9-f46d-4b22-872e-7e6b91823b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:29.431859 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-23ffdfa9-f46d-4b22-872e-7e6b91823b6d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:29.433057 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-23ffdfa9-f46d-4b22-872e-7e6b91823b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:29.532818 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 706/1390] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:29.578559 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb7643-0cb7-4059-87ab-edbb713526e6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:29.580148 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ddbb7643-0cb7-4059-87ab-edbb713526e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:29.733192 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbb7643-0cb7-4059-87ab-edbb713526e6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:29.752530 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:29.858920 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce56ad-9ea1-4053-ada8-53fe3ae6e87d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:29.859606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce56ad-9ea1-4053-ada8-53fe3ae6e87d service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:29.859892 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce56ad-9ea1-4053-ada8-53fe3ae6e87d service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:29.860151 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce56ad-9ea1-4053-ada8-53fe3ae6e87d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:29.861803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d3ce56ad-9ea1-4053-ada8-53fe3ae6e87d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:29.949831 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453d1e0-9e76-4359-a51d-d0e1e2a832f7 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:29.950054 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453d1e0-9e76-4359-a51d-d0e1e2a832f7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:29.950294 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453d1e0-9e76-4359-a51d-d0e1e2a832f7 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:29.951733 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 707/1391] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:29.952024 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce56ad-9ea1-4053-ada8-53fe3ae6e87d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:29.953680 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce56ad-9ea1-4053-ada8-53fe3ae6e87d service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:29.956668 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4c867-4898-40b1-910b-2c6bf4746fb5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:29.957058 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4c867-4898-40b1-910b-2c6bf4746fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:29.957345 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4c867-4898-40b1-910b-2c6bf4746fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:29.971531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:29.972881 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 685/1392] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:04:30.025198 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-40f4c867-4898-40b1-910b-2c6bf4746fb5 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:30.026534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-40f4c867-4898-40b1-910b-2c6bf4746fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:30.140114 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 708/1393] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:30.197793 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2b359-6bdf-4578-8a4d-f040111b9b7f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:30.198168 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2b359-6bdf-4578-8a4d-f040111b9b7f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:30.198621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb2b359-6bdf-4578-8a4d-f040111b9b7f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:30.200232 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 686/1394] 10.222.0.42 () {54 vars in 966 bytes} [Sun Jul 24 01:04:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:30.205351 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec9259-3fbd-403f-a1dc-35ef8b0a67d6 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:30.205642 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec9259-3fbd-403f-a1dc-35ef8b0a67d6 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:30.205934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec9259-3fbd-403f-a1dc-35ef8b0a67d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:30.279966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-44ec9259-3fbd-403f-a1dc-35ef8b0a67d6 None None] MFA Rules not processed for user `adbdf910e67d4185a0ae14edf34ee3b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:30.281177 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-44ec9259-3fbd-403f-a1dc-35ef8b0a67d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:30.316349 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:30.359759 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 709/1395] 10.222.0.42 () {58 vars in 1063 bytes} [Sun Jul 24 01:04:30 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:30.367530 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2b359-6bdf-4578-8a4d-f040111b9b7f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:30.369164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0eb2b359-6bdf-4578-8a4d-f040111b9b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:30.392885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:30.477054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb2b359-6bdf-4578-8a4d-f040111b9b7f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:30.554837 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1122da5-431e-4d0c-8f70-b1d97dcd933b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbdf910e67d4185a0ae14edf34ee3b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:30.555650 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1122da5-431e-4d0c-8f70-b1d97dcd933b service glance] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:30.555935 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1122da5-431e-4d0c-8f70-b1d97dcd933b service glance] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:30.556211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1122da5-431e-4d0c-8f70-b1d97dcd933b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:30.557884 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b1122da5-431e-4d0c-8f70-b1d97dcd933b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:30.632037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:30.666897 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1122da5-431e-4d0c-8f70-b1d97dcd933b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:30.668373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1122da5-431e-4d0c-8f70-b1d97dcd933b service glance] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:30.687149 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 687/1396] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:04:31.420514 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba73fc-49cc-4bdf-ad6c-efab28a64dc9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:31.421019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba73fc-49cc-4bdf-ad6c-efab28a64dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:31.421122 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba73fc-49cc-4bdf-ad6c-efab28a64dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:31.489934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ebba73fc-49cc-4bdf-ad6c-efab28a64dc9 None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:31.491148 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ebba73fc-49cc-4bdf-ad6c-efab28a64dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:31.579763 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 710/1397] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:04:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:31.626858 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31455c2e-c788-4c70-8c74-58388233845a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:31.626858 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31455c2e-c788-4c70-8c74-58388233845a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:31.627462 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31455c2e-c788-4c70-8c74-58388233845a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:31.628570 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 688/1398] 10.222.0.42 () {54 vars in 943 bytes} [Sun Jul 24 01:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:31.635064 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10d4f3-047d-4148-8390-1563634e9254 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:31.635446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10d4f3-047d-4148-8390-1563634e9254 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:31.635725 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10d4f3-047d-4148-8390-1563634e9254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:31.694690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:31.713818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1e10d4f3-047d-4148-8390-1563634e9254 None None] MFA Rules not processed for user `dea37db9b0f3432093e8fe89d5fcc687`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:31.715022 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1e10d4f3-047d-4148-8390-1563634e9254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:31.825665 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 711/1399] 10.222.0.42 () {58 vars in 1040 bytes} [Sun Jul 24 01:04:31 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:31.835327 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31455c2e-c788-4c70-8c74-58388233845a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:31.836931 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-31455c2e-c788-4c70-8c74-58388233845a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:31.977844 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31455c2e-c788-4c70-8c74-58388233845a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:32.013772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcea63-8d95-4c67-8e7e-2a9c26666b98 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:32.014067 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcea63-8d95-4c67-8e7e-2a9c26666b98 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:32.014346 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dcea63-8d95-4c67-8e7e-2a9c26666b98 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:32.015857 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 712/1400] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:32.020700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:32.020894 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b35d6-29d8-4abb-8b0a-a80e8eb376ef None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:32.021196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b35d6-29d8-4abb-8b0a-a80e8eb376ef None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:32.021480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b35d6-29d8-4abb-8b0a-a80e8eb376ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:32.087670 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-329b35d6-29d8-4abb-8b0a-a80e8eb376ef None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:32.088939 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-329b35d6-29d8-4abb-8b0a-a80e8eb376ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:32.092100 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53130c0-0f67-4b64-838d-a9cf63811998 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:32.092784 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53130c0-0f67-4b64-838d-a9cf63811998 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:32.093073 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53130c0-0f67-4b64-838d-a9cf63811998 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:32.093331 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53130c0-0f67-4b64-838d-a9cf63811998 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:32.095066 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e53130c0-0f67-4b64-838d-a9cf63811998 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:32.147688 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:32.179684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53130c0-0f67-4b64-838d-a9cf63811998 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:32.181306 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53130c0-0f67-4b64-838d-a9cf63811998 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:32.189754 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 689/1401] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:04:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:04:32.191334 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 713/1402] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:04:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:04:32.234504 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53130c0-0f67-4b64-838d-a9cf63811998 service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:32.235758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e53130c0-0f67-4b64-838d-a9cf63811998 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:32.326318 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:32.353809 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53130c0-0f67-4b64-838d-a9cf63811998 service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:32.478671 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55767e50-8636-4272-9650-c53d74d89cd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:32.479766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55767e50-8636-4272-9650-c53d74d89cd4 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:32.480188 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55767e50-8636-4272-9650-c53d74d89cd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:32.480589 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55767e50-8636-4272-9650-c53d74d89cd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:32.482553 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-55767e50-8636-4272-9650-c53d74d89cd4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:32.590477 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55767e50-8636-4272-9650-c53d74d89cd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:32.592365 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55767e50-8636-4272-9650-c53d74d89cd4 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:32.597682 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:32.613582 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 690/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:04:34.766674 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47a2de-ae5c-43ec-a6c5-e270430f90c7 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:34.767248 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47a2de-ae5c-43ec-a6c5-e270430f90c7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:34.767248 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47a2de-ae5c-43ec-a6c5-e270430f90c7 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:34.768715 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 714/1404] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:04:34.773852 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754f13b-002a-4dc5-97ed-c8e5bb107984 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:34.774277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754f13b-002a-4dc5-97ed-c8e5bb107984 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:34.774458 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754f13b-002a-4dc5-97ed-c8e5bb107984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:34.844626 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7754f13b-002a-4dc5-97ed-c8e5bb107984 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:34.845899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7754f13b-002a-4dc5-97ed-c8e5bb107984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:34.947806 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 691/1405] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:34.996671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47a2de-ae5c-43ec-a6c5-e270430f90c7 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:34.998284 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8b47a2de-ae5c-43ec-a6c5-e270430f90c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:35.157163 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47a2de-ae5c-43ec-a6c5-e270430f90c7 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:35.203218 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:35.278834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d7d93f-431a-42d9-afeb-662d0f2035b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:35.279629 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7d93f-431a-42d9-afeb-662d0f2035b0 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:35.280005 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7d93f-431a-42d9-afeb-662d0f2035b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:35.280354 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d7d93f-431a-42d9-afeb-662d0f2035b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:35.284061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-01d7d93f-431a-42d9-afeb-662d0f2035b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:35.382702 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7d93f-431a-42d9-afeb-662d0f2035b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:35.384972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d7d93f-431a-42d9-afeb-662d0f2035b0 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:35.404162 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 715/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:04:37.504445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716180c-1da0-4f20-9011-1495517aaeb8 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:37.505044 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716180c-1da0-4f20-9011-1495517aaeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:37.505518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f716180c-1da0-4f20-9011-1495517aaeb8 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:37.507532 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 692/1407] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:04:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:37.512277 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b2d54-6d62-4dd4-8f5b-427f58f3bc79 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:37.512700 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b2d54-6d62-4dd4-8f5b-427f58f3bc79 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:37.512889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438b2d54-6d62-4dd4-8f5b-427f58f3bc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:37.577161 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:37.585005 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-438b2d54-6d62-4dd4-8f5b-427f58f3bc79 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:37.586227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-438b2d54-6d62-4dd4-8f5b-427f58f3bc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:37.708801 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 716/1408] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:37.762240 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716180c-1da0-4f20-9011-1495517aaeb8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:37.763882 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f716180c-1da0-4f20-9011-1495517aaeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:37.882487 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:37.997742 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f716180c-1da0-4f20-9011-1495517aaeb8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:38.130001 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce454d-b481-43fd-9cc9-fe02eec94d22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:38.130595 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce454d-b481-43fd-9cc9-fe02eec94d22 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:38.130887 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce454d-b481-43fd-9cc9-fe02eec94d22 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:38.131176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce454d-b481-43fd-9cc9-fe02eec94d22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:38.132906 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-59ce454d-b481-43fd-9cc9-fe02eec94d22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:38.174532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:38.238220 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce454d-b481-43fd-9cc9-fe02eec94d22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:38.239945 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce454d-b481-43fd-9cc9-fe02eec94d22 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:38.260209 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 693/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:04:47.698196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=44 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:48.255816 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=31 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:54.032557 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be74250-f1cd-4dfd-91bd-aad96954e60f None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:54.033123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be74250-f1cd-4dfd-91bd-aad96954e60f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:54.033243 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be74250-f1cd-4dfd-91bd-aad96954e60f None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:54.035323 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 717/1410] 10.222.0.42 () {54 vars in 918 bytes} [Sun Jul 24 01:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:54.042321 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c19d12-7c44-4217-a41c-752f9c702770 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:54.042790 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c19d12-7c44-4217-a41c-752f9c702770 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:54.042897 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c19d12-7c44-4217-a41c-752f9c702770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:54.118010 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-51c19d12-7c44-4217-a41c-752f9c702770 None None] MFA Rules not processed for user `333db0711d0f41fe8066ba5b9d91dacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:54.119213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-51c19d12-7c44-4217-a41c-752f9c702770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:54.238427 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 694/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Sun Jul 24 01:04:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:54.252776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c86c2c-77b7-474e-ab2d-a39dcf3ab539 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:54.253068 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c86c2c-77b7-474e-ab2d-a39dcf3ab539 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:54.253345 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c86c2c-77b7-474e-ab2d-a39dcf3ab539 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:54.254743 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 718/1412] 10.222.0.42 () {54 vars in 918 bytes} [Sun Jul 24 01:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:54.259406 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c7ff7-ebab-43a8-b142-ff4e891f7d38 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:54.259705 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c7ff7-ebab-43a8-b142-ff4e891f7d38 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:54.259973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c7ff7-ebab-43a8-b142-ff4e891f7d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:54.331397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:54.334977 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-210c7ff7-ebab-43a8-b142-ff4e891f7d38 None None] MFA Rules not processed for user `6c32c443ee1a421e98e7656e8e86e27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:54.337048 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-210c7ff7-ebab-43a8-b142-ff4e891f7d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:54.458797 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 695/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Sun Jul 24 01:04:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:56.964103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76655d-11cb-4e9b-8179-1ecc3a1d32ec None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:56.964671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76655d-11cb-4e9b-8179-1ecc3a1d32ec None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:56.964671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af76655d-11cb-4e9b-8179-1ecc3a1d32ec None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:56.966696 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 719/1414] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:56.975437 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ffa6d-7ed4-4883-8adc-b763e580b009 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:56.975898 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ffa6d-7ed4-4883-8adc-b763e580b009 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:56.975998 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ffa6d-7ed4-4883-8adc-b763e580b009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:57.049869 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f52ffa6d-7ed4-4883-8adc-b763e580b009 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:57.051110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f52ffa6d-7ed4-4883-8adc-b763e580b009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:57.112479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:57.158463 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 696/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:57.213183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76655d-11cb-4e9b-8179-1ecc3a1d32ec None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:57.214754 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-af76655d-11cb-4e9b-8179-1ecc3a1d32ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:57.371115 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af76655d-11cb-4e9b-8179-1ecc3a1d32ec None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:57.459715 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:57.501398 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfefe2-47dd-4370-bf08-689df23baa2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:57.502090 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfefe2-47dd-4370-bf08-689df23baa2f service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:57.502364 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfefe2-47dd-4370-bf08-689df23baa2f service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:57.502640 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfefe2-47dd-4370-bf08-689df23baa2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:57.504511 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2dbfefe2-47dd-4370-bf08-689df23baa2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:57.600440 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfefe2-47dd-4370-bf08-689df23baa2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:57.602120 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfefe2-47dd-4370-bf08-689df23baa2f service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:57.620465 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 720/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:04:58.526040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f2c86-6164-4457-a11f-ebb713071341 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:58.526563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f2c86-6164-4457-a11f-ebb713071341 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:58.526563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f2c86-6164-4457-a11f-ebb713071341 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:58.528020 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 697/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:04:58.533550 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d360ec-25f9-42b4-9da8-366eca9c8a7c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:58.534015 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d360ec-25f9-42b4-9da8-366eca9c8a7c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:58.534111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d360ec-25f9-42b4-9da8-366eca9c8a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:58.626851 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-92d360ec-25f9-42b4-9da8-366eca9c8a7c None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:04:58.628096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-92d360ec-25f9-42b4-9da8-366eca9c8a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:58.656511 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:58.736103 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 721/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:04:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:04:58.892106 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f2c86-6164-4457-a11f-ebb713071341 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:04:58.894643 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-926f2c86-6164-4457-a11f-ebb713071341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:59.071908 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f2c86-6164-4457-a11f-ebb713071341 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:04:59.110946 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:04:59.190175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0507e-41b9-4a45-aa59-3d72d9698af9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:04:59.190811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0507e-41b9-4a45-aa59-3d72d9698af9 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:04:59.191088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0507e-41b9-4a45-aa59-3d72d9698af9 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:04:59.191404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0507e-41b9-4a45-aa59-3d72d9698af9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:04:59.193041 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-75d0507e-41b9-4a45-aa59-3d72d9698af9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:04:59.284558 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0507e-41b9-4a45-aa59-3d72d9698af9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:04:59.286313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0507e-41b9-4a45-aa59-3d72d9698af9 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:04:59.305998 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 698/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:04:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:00.208372 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89809571-7106-43af-9608-b31ed5b7d81c None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:00.208929 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89809571-7106-43af-9608-b31ed5b7d81c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:00.208929 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89809571-7106-43af-9608-b31ed5b7d81c None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:00.210352 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 722/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:00.215567 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b26985-f9d5-4d85-85f8-725c8da268d2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:00.215984 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b26985-f9d5-4d85-85f8-725c8da268d2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:00.216105 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b26985-f9d5-4d85-85f8-725c8da268d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:00.269605 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:00.293489 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-50b26985-f9d5-4d85-85f8-725c8da268d2 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:00.294703 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-50b26985-f9d5-4d85-85f8-725c8da268d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:00.395130 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 699/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:05:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:00.543275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89809571-7106-43af-9608-b31ed5b7d81c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:00.545399 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-89809571-7106-43af-9608-b31ed5b7d81c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:00.704027 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89809571-7106-43af-9608-b31ed5b7d81c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:00.717830 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:00.833063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ca00b2-d974-4910-bb50-3927c57452c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:00.833728 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca00b2-d974-4910-bb50-3927c57452c2 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:00.834005 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca00b2-d974-4910-bb50-3927c57452c2 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:00.834274 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ca00b2-d974-4910-bb50-3927c57452c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:00.835931 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-78ca00b2-d974-4910-bb50-3927c57452c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:00.929677 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca00b2-d974-4910-bb50-3927c57452c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:00.931327 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ca00b2-d974-4910-bb50-3927c57452c2 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:00.950613 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 723/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:01.800659 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ce269-d109-49d2-9e01-866afa68cc58 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:01.801238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ce269-d109-49d2-9e01-866afa68cc58 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:01.801238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ce269-d109-49d2-9e01-866afa68cc58 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:01.802660 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 700/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:01.811410 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22937d-50ef-45c2-a09b-583f02ec0ac8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:01.811882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22937d-50ef-45c2-a09b-583f02ec0ac8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:01.812041 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22937d-50ef-45c2-a09b-583f02ec0ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:01.832744 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:01.890292 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2d22937d-50ef-45c2-a09b-583f02ec0ac8 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:01.891544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2d22937d-50ef-45c2-a09b-583f02ec0ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:01.997146 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 724/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:05:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:02.158725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ce269-d109-49d2-9e01-866afa68cc58 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:02.160288 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3a4ce269-d109-49d2-9e01-866afa68cc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:02.276302 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:02.315128 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ce269-d109-49d2-9e01-866afa68cc58 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:02.442824 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4460ac6-d335-44a6-b366-6aa460047a1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:02.443518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4460ac6-d335-44a6-b366-6aa460047a1c service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:02.443809 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4460ac6-d335-44a6-b366-6aa460047a1c service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:02.444089 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4460ac6-d335-44a6-b366-6aa460047a1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:02.445747 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b4460ac6-d335-44a6-b366-6aa460047a1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:02.525444 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:02.540952 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4460ac6-d335-44a6-b366-6aa460047a1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:02.542528 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4460ac6-d335-44a6-b366-6aa460047a1c service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:02.562744 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 701/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:03.426068 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66797a-055d-414f-bc98-a40c104a8827 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:03.426726 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66797a-055d-414f-bc98-a40c104a8827 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:03.426726 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef66797a-055d-414f-bc98-a40c104a8827 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:03.428112 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 725/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:03.434162 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3880f-14f3-486b-9268-56648dce46ef None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:03.434898 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3880f-14f3-486b-9268-56648dce46ef None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:03.435202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3880f-14f3-486b-9268-56648dce46ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:03.513779 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-09a3880f-14f3-486b-9268-56648dce46ef None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:03.514999 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-09a3880f-14f3-486b-9268-56648dce46ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:03.614317 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 702/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:05:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:03.766001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66797a-055d-414f-bc98-a40c104a8827 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:03.768439 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ef66797a-055d-414f-bc98-a40c104a8827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:03.866506 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:03.932524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef66797a-055d-414f-bc98-a40c104a8827 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:04.048409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f154e-a8dc-4440-a027-f7e8c3e7513f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:04.048982 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f154e-a8dc-4440-a027-f7e8c3e7513f service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:04.049262 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f154e-a8dc-4440-a027-f7e8c3e7513f service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:04.049534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f154e-a8dc-4440-a027-f7e8c3e7513f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:04.051163 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-379f154e-a8dc-4440-a027-f7e8c3e7513f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:04.100677 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:04.145615 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f154e-a8dc-4440-a027-f7e8c3e7513f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:04.147236 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f154e-a8dc-4440-a027-f7e8c3e7513f service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:04.166788 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 726/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:04.989623 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43a98b-7c0e-4208-88fd-d179ea0359ba None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:04.990550 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43a98b-7c0e-4208-88fd-d179ea0359ba None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:04.990550 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43a98b-7c0e-4208-88fd-d179ea0359ba None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:04.992821 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 703/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:05:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:04.999018 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9301-93d3-431b-92b0-9d25889a9a05 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:04.999843 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9301-93d3-431b-92b0-9d25889a9a05 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:05.000022 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dd9301-93d3-431b-92b0-9d25889a9a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:05.078496 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-95dd9301-93d3-431b-92b0-9d25889a9a05 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:05.079654 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-95dd9301-93d3-431b-92b0-9d25889a9a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:05.183605 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 727/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:05:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:05.335953 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43a98b-7c0e-4208-88fd-d179ea0359ba None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:05.338166 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2d43a98b-7c0e-4208-88fd-d179ea0359ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:05.397680 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:05.503522 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43a98b-7c0e-4208-88fd-d179ea0359ba None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:05.624050 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553533c6-1317-475e-afbe-715b93a16951 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:05.624649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553533c6-1317-475e-afbe-715b93a16951 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:05.624938 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553533c6-1317-475e-afbe-715b93a16951 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:05.625211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553533c6-1317-475e-afbe-715b93a16951 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:05.626864 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-553533c6-1317-475e-afbe-715b93a16951 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:05.634047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:05.725738 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553533c6-1317-475e-afbe-715b93a16951 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:05.727402 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553533c6-1317-475e-afbe-715b93a16951 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:05.745822 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 704/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:06.554516 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6433058-5b13-4ac1-8ded-b6070d677db3 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:06.555083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6433058-5b13-4ac1-8ded-b6070d677db3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:06.555083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6433058-5b13-4ac1-8ded-b6070d677db3 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:06.556798 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 728/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:05:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:06.562259 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b0c61-1245-4f15-9d6f-aecef344f856 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:06.562678 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b0c61-1245-4f15-9d6f-aecef344f856 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:06.562797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b0c61-1245-4f15-9d6f-aecef344f856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:06.639538 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2d5b0c61-1245-4f15-9d6f-aecef344f856 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:06.640757 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2d5b0c61-1245-4f15-9d6f-aecef344f856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:06.710909 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:06.741231 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 705/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:05:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:06.895672 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6433058-5b13-4ac1-8ded-b6070d677db3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:06.897985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c6433058-5b13-4ac1-8ded-b6070d677db3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:06.925772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:07.059914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6433058-5b13-4ac1-8ded-b6070d677db3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:07.163728 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:07.191437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346a7b23-8e91-46be-bb2f-8bb01d41ff17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:07.192156 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a7b23-8e91-46be-bb2f-8bb01d41ff17 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:07.192462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a7b23-8e91-46be-bb2f-8bb01d41ff17 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:07.192736 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346a7b23-8e91-46be-bb2f-8bb01d41ff17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:07.194405 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-346a7b23-8e91-46be-bb2f-8bb01d41ff17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:07.288287 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a7b23-8e91-46be-bb2f-8bb01d41ff17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:07.289901 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346a7b23-8e91-46be-bb2f-8bb01d41ff17 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:07.307934 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 729/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:08.129484 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc592c1-b57d-4ba4-b11d-07e2277669ad None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:08.130060 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc592c1-b57d-4ba4-b11d-07e2277669ad None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:08.130060 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc592c1-b57d-4ba4-b11d-07e2277669ad None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:08.131398 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 706/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:08.139546 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17f5df-9873-4c3f-8e5e-86d643527438 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:08.139966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17f5df-9873-4c3f-8e5e-86d643527438 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:08.140122 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17f5df-9873-4c3f-8e5e-86d643527438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:08.228423 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1a17f5df-9873-4c3f-8e5e-86d643527438 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:08.229668 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1a17f5df-9873-4c3f-8e5e-86d643527438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:08.281871 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:08.340536 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 730/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:08.493488 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc592c1-b57d-4ba4-b11d-07e2277669ad None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:08.496056 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9fc592c1-b57d-4ba4-b11d-07e2277669ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:08.673541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc592c1-b57d-4ba4-b11d-07e2277669ad None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:08.731391 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:08.791864 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f45c4-153d-4f07-9706-9bf05ce24c67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:08.792441 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f45c4-153d-4f07-9706-9bf05ce24c67 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:08.792725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f45c4-153d-4f07-9706-9bf05ce24c67 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:08.793002 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f45c4-153d-4f07-9706-9bf05ce24c67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:08.794694 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e52f45c4-153d-4f07-9706-9bf05ce24c67 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:08.890273 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f45c4-153d-4f07-9706-9bf05ce24c67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:08.891955 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f45c4-153d-4f07-9706-9bf05ce24c67 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:08.910802 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 707/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:09.715588 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28d99c-d849-42e6-8454-6798e94dceb5 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:09.716041 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28d99c-d849-42e6-8454-6798e94dceb5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:09.716144 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab28d99c-d849-42e6-8454-6798e94dceb5 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:09.717578 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 731/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:09.723830 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537bcf6-6f92-415d-bc6e-4507b2d6b1d6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:09.724279 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537bcf6-6f92-415d-bc6e-4507b2d6b1d6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:09.724398 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537bcf6-6f92-415d-bc6e-4507b2d6b1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:09.815749 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a537bcf6-6f92-415d-bc6e-4507b2d6b1d6 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:09.816970 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a537bcf6-6f92-415d-bc6e-4507b2d6b1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:09.819023 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:09.917025 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 708/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:10.071583 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28d99c-d849-42e6-8454-6798e94dceb5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:10.073024 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ab28d99c-d849-42e6-8454-6798e94dceb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:10.227336 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab28d99c-d849-42e6-8454-6798e94dceb5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:10.260563 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:10.372833 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960183d9-9e60-4486-8906-f3f13d54f56c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:10.373401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960183d9-9e60-4486-8906-f3f13d54f56c service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:10.373681 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960183d9-9e60-4486-8906-f3f13d54f56c service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:10.373951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960183d9-9e60-4486-8906-f3f13d54f56c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:10.375629 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-960183d9-9e60-4486-8906-f3f13d54f56c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:10.469701 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960183d9-9e60-4486-8906-f3f13d54f56c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:10.471679 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960183d9-9e60-4486-8906-f3f13d54f56c service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:10.490138 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 732/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:12.429542 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c025fc-e3de-420a-b8b1-1455286ed2b7 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:12.430379 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c025fc-e3de-420a-b8b1-1455286ed2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:12.430479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c025fc-e3de-420a-b8b1-1455286ed2b7 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:12.432719 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 709/1441] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:05:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:12.441925 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd9f6c-6223-4b9c-b2ea-6fc51ce7a028 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:12.442364 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd9f6c-6223-4b9c-b2ea-6fc51ce7a028 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:12.442619 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfd9f6c-6223-4b9c-b2ea-6fc51ce7a028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:12.485229 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:12.513785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2dfd9f6c-6223-4b9c-b2ea-6fc51ce7a028 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:12.515005 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2dfd9f6c-6223-4b9c-b2ea-6fc51ce7a028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:12.617065 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 733/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:12.656069 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c025fc-e3de-420a-b8b1-1455286ed2b7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:12.657630 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a7c025fc-e3de-420a-b8b1-1455286ed2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:12.764983 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c025fc-e3de-420a-b8b1-1455286ed2b7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:12.806499 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:12.851478 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626cddeb-720e-441d-8c4f-29bdbdf71088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:12.852147 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cddeb-720e-441d-8c4f-29bdbdf71088 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:12.852429 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cddeb-720e-441d-8c4f-29bdbdf71088 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:12.852704 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626cddeb-720e-441d-8c4f-29bdbdf71088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:12.854373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-626cddeb-720e-441d-8c4f-29bdbdf71088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:12.968494 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cddeb-720e-441d-8c4f-29bdbdf71088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:12.969924 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626cddeb-720e-441d-8c4f-29bdbdf71088 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:12.988348 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 710/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:15.254922 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c059d-0c67-4409-8aec-2e251ee372cf None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:15.255531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c059d-0c67-4409-8aec-2e251ee372cf None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:15.255531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69c059d-0c67-4409-8aec-2e251ee372cf None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:15.257737 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 734/1444] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:05:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:15.266252 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc391a1-5c09-4fb7-add6-95d371352a0f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:15.267701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc391a1-5c09-4fb7-add6-95d371352a0f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:15.267701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc391a1-5c09-4fb7-add6-95d371352a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:15.341967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7bc391a1-5c09-4fb7-add6-95d371352a0f None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:15.343187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7bc391a1-5c09-4fb7-add6-95d371352a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:15.356984 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:15.441248 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 711/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:05:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:15.481839 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c059d-0c67-4409-8aec-2e251ee372cf None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:15.483439 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a69c059d-0c67-4409-8aec-2e251ee372cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:15.592657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69c059d-0c67-4409-8aec-2e251ee372cf None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:15.605578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:15.670451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99543cc-64ca-4ea4-ac0c-531fc7d1ce59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:15.671092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99543cc-64ca-4ea4-ac0c-531fc7d1ce59 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:15.671393 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99543cc-64ca-4ea4-ac0c-531fc7d1ce59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:15.671668 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99543cc-64ca-4ea4-ac0c-531fc7d1ce59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:15.673281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a99543cc-64ca-4ea4-ac0c-531fc7d1ce59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:15.784721 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99543cc-64ca-4ea4-ac0c-531fc7d1ce59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:15.786225 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99543cc-64ca-4ea4-ac0c-531fc7d1ce59 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:15.805059 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 735/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:05:18.130962 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e031d-b4b4-4c6e-89d5-72b30f936673 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:18.131873 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e031d-b4b4-4c6e-89d5-72b30f936673 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:18.131873 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e031d-b4b4-4c6e-89d5-72b30f936673 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:18.134183 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 712/1447] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:05:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:18.140808 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4405b5-e467-4721-b0af-559479196e4d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:18.141550 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4405b5-e467-4721-b0af-559479196e4d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:18.141883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4405b5-e467-4721-b0af-559479196e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:18.194529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:18.220177 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7d4405b5-e467-4721-b0af-559479196e4d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:18.221959 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7d4405b5-e467-4721-b0af-559479196e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:18.322726 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 736/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:05:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:18.365852 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e031d-b4b4-4c6e-89d5-72b30f936673 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:18.368984 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e56e031d-b4b4-4c6e-89d5-72b30f936673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:18.488522 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e031d-b4b4-4c6e-89d5-72b30f936673 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:18.529988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:18.566414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f73a3c-a605-4793-81c3-75370632f8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:18.567112 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f73a3c-a605-4793-81c3-75370632f8ff service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:18.567436 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f73a3c-a605-4793-81c3-75370632f8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:18.567718 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f73a3c-a605-4793-81c3-75370632f8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:18.569379 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-14f73a3c-a605-4793-81c3-75370632f8ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:18.688440 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f73a3c-a605-4793-81c3-75370632f8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:18.690854 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f73a3c-a605-4793-81c3-75370632f8ff service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:18.713442 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 713/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:20.872496 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea682ff-afb9-4ed5-a5a7-1588ab78d870 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:20.873335 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea682ff-afb9-4ed5-a5a7-1588ab78d870 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:20.873335 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea682ff-afb9-4ed5-a5a7-1588ab78d870 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:20.875646 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 737/1450] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:05:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:20.884502 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9efdc6-c9b1-46b6-a3d7-75435e4494ef None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:20.884961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9efdc6-c9b1-46b6-a3d7-75435e4494ef None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:20.885125 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9efdc6-c9b1-46b6-a3d7-75435e4494ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:20.955951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4a9efdc6-c9b1-46b6-a3d7-75435e4494ef None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:20.957176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4a9efdc6-c9b1-46b6-a3d7-75435e4494ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:20.978191 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:21.061966 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 714/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:05:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:21.100869 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea682ff-afb9-4ed5-a5a7-1588ab78d870 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:21.102408 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9ea682ff-afb9-4ed5-a5a7-1588ab78d870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:21.211046 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea682ff-afb9-4ed5-a5a7-1588ab78d870 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:21.232120 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:21.288446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3646acc2-858a-4101-a2cc-9b294ec1ee65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:21.289108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646acc2-858a-4101-a2cc-9b294ec1ee65 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:21.289396 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646acc2-858a-4101-a2cc-9b294ec1ee65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:21.289667 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3646acc2-858a-4101-a2cc-9b294ec1ee65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:21.291349 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3646acc2-858a-4101-a2cc-9b294ec1ee65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:21.407044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646acc2-858a-4101-a2cc-9b294ec1ee65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:21.408456 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3646acc2-858a-4101-a2cc-9b294ec1ee65 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:21.427823 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 738/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:23.525740 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244afb93-b43d-474b-afe7-1366df334662 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:23.526307 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244afb93-b43d-474b-afe7-1366df334662 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:23.526307 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244afb93-b43d-474b-afe7-1366df334662 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:23.527744 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 715/1453] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:23.533359 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6710eb-822d-4baa-afbc-35967ec462ed None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:23.533788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6710eb-822d-4baa-afbc-35967ec462ed None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:23.533905 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6710eb-822d-4baa-afbc-35967ec462ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:23.599839 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:23.604180 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-be6710eb-822d-4baa-afbc-35967ec462ed None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:23.606114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-be6710eb-822d-4baa-afbc-35967ec462ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:23.713433 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 739/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:05:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:23.752016 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244afb93-b43d-474b-afe7-1366df334662 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:23.753593 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-244afb93-b43d-474b-afe7-1366df334662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:23.865373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244afb93-b43d-474b-afe7-1366df334662 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:23.927095 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:23.953483 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f45c7a-971e-49f0-b630-bd9642476189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:23.954127 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f45c7a-971e-49f0-b630-bd9642476189 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:23.954417 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f45c7a-971e-49f0-b630-bd9642476189 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:23.954690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f45c7a-971e-49f0-b630-bd9642476189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:23.956370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-19f45c7a-971e-49f0-b630-bd9642476189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:24.068302 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f45c7a-971e-49f0-b630-bd9642476189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:24.069698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f45c7a-971e-49f0-b630-bd9642476189 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:24.088587 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 716/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:26.161256 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4a344-aaca-4104-a8bf-cb6064d6bc03 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:26.162102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4a344-aaca-4104-a8bf-cb6064d6bc03 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:26.162102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc4a344-aaca-4104-a8bf-cb6064d6bc03 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:26.164323 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 740/1456] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:05:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:26.171990 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34da05b-0048-4176-8491-000390f13d17 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:26.172745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34da05b-0048-4176-8491-000390f13d17 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:26.173430 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34da05b-0048-4176-8491-000390f13d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:26.263168 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b34da05b-0048-4176-8491-000390f13d17 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:26.264448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b34da05b-0048-4176-8491-000390f13d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:26.295070 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:26.364526 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 717/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:26.407536 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4a344-aaca-4104-a8bf-cb6064d6bc03 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:26.409831 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0cc4a344-aaca-4104-a8bf-cb6064d6bc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:26.517551 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc4a344-aaca-4104-a8bf-cb6064d6bc03 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:26.546782 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:26.593796 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd40483-70a4-46e2-86c3-a5e3e724458a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:26.594442 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd40483-70a4-46e2-86c3-a5e3e724458a service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:26.594724 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd40483-70a4-46e2-86c3-a5e3e724458a service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:26.595000 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd40483-70a4-46e2-86c3-a5e3e724458a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:26.596676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3bd40483-70a4-46e2-86c3-a5e3e724458a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:26.719165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd40483-70a4-46e2-86c3-a5e3e724458a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:26.720661 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd40483-70a4-46e2-86c3-a5e3e724458a service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:26.740111 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 741/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:05:28.900810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f9a30-b3cc-4262-b5ec-1afbf956c947 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:28.901392 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f9a30-b3cc-4262-b5ec-1afbf956c947 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:28.901392 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f9a30-b3cc-4262-b5ec-1afbf956c947 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:28.903635 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 718/1459] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:05:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:28.912458 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009a4fd-5073-42ba-b03d-74064b446a83 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:28.912846 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009a4fd-5073-42ba-b03d-74064b446a83 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:28.913012 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009a4fd-5073-42ba-b03d-74064b446a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:28.978485 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d009a4fd-5073-42ba-b03d-74064b446a83 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:28.979741 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d009a4fd-5073-42ba-b03d-74064b446a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:28.989715 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:29.083822 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 742/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:05:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:29.125094 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f9a30-b3cc-4262-b5ec-1afbf956c947 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:29.127684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-440f9a30-b3cc-4262-b5ec-1afbf956c947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:29.254255 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440f9a30-b3cc-4262-b5ec-1afbf956c947 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:29.310773 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:29.338236 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd5812-80ab-4947-97e7-27ffbeeefe6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:29.338822 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd5812-80ab-4947-97e7-27ffbeeefe6e service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:29.339107 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd5812-80ab-4947-97e7-27ffbeeefe6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:29.339407 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd5812-80ab-4947-97e7-27ffbeeefe6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:29.341070 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dddd5812-80ab-4947-97e7-27ffbeeefe6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:29.453324 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd5812-80ab-4947-97e7-27ffbeeefe6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:29.454779 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddd5812-80ab-4947-97e7-27ffbeeefe6e service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:29.474182 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 719/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:05:31.529601 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5250131-0cd6-4f73-99ad-68f6a19eb21d None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:31.530520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5250131-0cd6-4f73-99ad-68f6a19eb21d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:31.530520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5250131-0cd6-4f73-99ad-68f6a19eb21d None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:31.532906 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 743/1462] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:05:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:31.540847 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfba0e0-80bf-4223-8fb3-36c00d0c6dff None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:31.541297 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfba0e0-80bf-4223-8fb3-36c00d0c6dff None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:31.541497 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfba0e0-80bf-4223-8fb3-36c00d0c6dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:31.608861 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7cfba0e0-80bf-4223-8fb3-36c00d0c6dff None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:31.610053 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7cfba0e0-80bf-4223-8fb3-36c00d0c6dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:31.649174 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:31.709829 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 720/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:05:31.752724 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5250131-0cd6-4f73-99ad-68f6a19eb21d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:31.754272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f5250131-0cd6-4f73-99ad-68f6a19eb21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:31.873316 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5250131-0cd6-4f73-99ad-68f6a19eb21d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:31.917778 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:31.956614 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1022a0-4c56-4116-b17d-a867c54ff80c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:31.957262 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1022a0-4c56-4116-b17d-a867c54ff80c service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:31.957554 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1022a0-4c56-4116-b17d-a867c54ff80c service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:31.957822 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1022a0-4c56-4116-b17d-a867c54ff80c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:31.959506 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5f1022a0-4c56-4116-b17d-a867c54ff80c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:32.079991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1022a0-4c56-4116-b17d-a867c54ff80c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:32.081359 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1022a0-4c56-4116-b17d-a867c54ff80c service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:32.102761 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 744/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:34.167915 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057ec32-5977-4d02-abc0-7cfc4285c24a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:34.168797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057ec32-5977-4d02-abc0-7cfc4285c24a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:34.168797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0057ec32-5977-4d02-abc0-7cfc4285c24a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:34.170933 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 721/1465] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:05:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:34.177379 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743c09b-ffb5-448b-af6a-f5dc97272a94 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:34.177864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743c09b-ffb5-448b-af6a-f5dc97272a94 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:34.177985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743c09b-ffb5-448b-af6a-f5dc97272a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:34.251729 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5743c09b-ffb5-448b-af6a-f5dc97272a94 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:34.252977 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5743c09b-ffb5-448b-af6a-f5dc97272a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:34.271885 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:34.354457 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 745/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:05:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:34.391510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057ec32-5977-4d02-abc0-7cfc4285c24a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:34.393054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0057ec32-5977-4d02-abc0-7cfc4285c24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:34.510975 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0057ec32-5977-4d02-abc0-7cfc4285c24a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:34.578383 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:34.586911 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbccb56-a3d8-4a63-b38b-5271f24b7812 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:34.587621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbccb56-a3d8-4a63-b38b-5271f24b7812 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:34.587910 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbccb56-a3d8-4a63-b38b-5271f24b7812 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:34.588217 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbccb56-a3d8-4a63-b38b-5271f24b7812 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:34.589929 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9fbccb56-a3d8-4a63-b38b-5271f24b7812 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:34.719651 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbccb56-a3d8-4a63-b38b-5271f24b7812 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:34.721126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbccb56-a3d8-4a63-b38b-5271f24b7812 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:34.740246 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 722/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:36.765556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7627eed-727f-45d1-915d-52691cd15f6c None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:36.766476 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7627eed-727f-45d1-915d-52691cd15f6c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:36.766476 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7627eed-727f-45d1-915d-52691cd15f6c None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:36.768816 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 746/1468] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:05:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:36.775285 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea85044-a1c1-4d7a-9d56-56eac81dd0a2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:36.775850 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea85044-a1c1-4d7a-9d56-56eac81dd0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:36.775964 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea85044-a1c1-4d7a-9d56-56eac81dd0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:36.850536 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-aea85044-a1c1-4d7a-9d56-56eac81dd0a2 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:36.851797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-aea85044-a1c1-4d7a-9d56-56eac81dd0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:36.901465 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:36.955258 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 723/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:05:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:36.993581 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7627eed-727f-45d1-915d-52691cd15f6c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:36.995969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b7627eed-727f-45d1-915d-52691cd15f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:37.110092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7627eed-727f-45d1-915d-52691cd15f6c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:37.157561 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:37.187162 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3666e3-cddc-4f38-ade0-4049e9c9e8f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:37.187852 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3666e3-cddc-4f38-ade0-4049e9c9e8f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:37.188140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3666e3-cddc-4f38-ade0-4049e9c9e8f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:37.188423 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3666e3-cddc-4f38-ade0-4049e9c9e8f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:37.190039 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-be3666e3-cddc-4f38-ade0-4049e9c9e8f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:37.311457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3666e3-cddc-4f38-ade0-4049e9c9e8f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:37.312925 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3666e3-cddc-4f38-ade0-4049e9c9e8f4 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:37.332598 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 747/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:46.953132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=22 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:47.330103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=66 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:56.921343 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863af035-fd08-43cf-a6ce-aae60d09cb0f None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:56.922250 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863af035-fd08-43cf-a6ce-aae60d09cb0f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:56.922250 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863af035-fd08-43cf-a6ce-aae60d09cb0f None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:56.924541 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 724/1471] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:05:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:56.930916 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0533c92-b76d-497b-bc6b-80c012315837 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:56.931389 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0533c92-b76d-497b-bc6b-80c012315837 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:56.931529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0533c92-b76d-497b-bc6b-80c012315837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:57.005450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e0533c92-b76d-497b-bc6b-80c012315837 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:57.007444 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e0533c92-b76d-497b-bc6b-80c012315837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:57.121067 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 748/1472] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:05:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:57.206749 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc249ffe-6da5-4142-b15f-411a4b111763 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:57.207185 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc249ffe-6da5-4142-b15f-411a4b111763 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:57.207675 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc249ffe-6da5-4142-b15f-411a4b111763 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:57.209585 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 725/1473] 10.222.0.42 () {54 vars in 966 bytes} [Sun Jul 24 01:05:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:57.214441 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781006e9-ebd6-4c08-a3c1-620dc56bcdb9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:57.214735 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781006e9-ebd6-4c08-a3c1-620dc56bcdb9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:57.215015 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781006e9-ebd6-4c08-a3c1-620dc56bcdb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:57.298820 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-781006e9-ebd6-4c08-a3c1-620dc56bcdb9 None None] MFA Rules not processed for user `adbdf910e67d4185a0ae14edf34ee3b9`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:57.300067 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-781006e9-ebd6-4c08-a3c1-620dc56bcdb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:57.321247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:57.378992 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 749/1474] 10.222.0.42 () {58 vars in 1063 bytes} [Sun Jul 24 01:05:57 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:05:57.389683 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc249ffe-6da5-4142-b15f-411a4b111763 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:05:57.391250 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cc249ffe-6da5-4142-b15f-411a4b111763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:57.513231 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc249ffe-6da5-4142-b15f-411a4b111763 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:05:57.591224 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab0f088-e979-4f54-85b6-74c6c4ddd685 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbdf910e67d4185a0ae14edf34ee3b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:05:57.591889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0f088-e979-4f54-85b6-74c6c4ddd685 service glance] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:57.592174 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0f088-e979-4f54-85b6-74c6c4ddd685 service glance] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:57.592453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab0f088-e979-4f54-85b6-74c6c4ddd685 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:57.594105 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8ab0f088-e979-4f54-85b6-74c6c4ddd685 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:05:57.659789 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:05:57.717272 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0f088-e979-4f54-85b6-74c6c4ddd685 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:05:57.718742 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab0f088-e979-4f54-85b6-74c6c4ddd685 service glance] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:05:57.742888 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 726/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:05:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:05:59.893376 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a1944-c636-4014-aa3b-a6c9833786c4 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:59.894234 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a1944-c636-4014-aa3b-a6c9833786c4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:59.894234 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a1944-c636-4014-aa3b-a6c9833786c4 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:59.896659 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 750/1476] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:05:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:05:59.905555 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463b089-8d6d-4a8e-bea2-0f299a9f83fd None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:05:59.905968 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463b089-8d6d-4a8e-bea2-0f299a9f83fd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:05:59.906174 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463b089-8d6d-4a8e-bea2-0f299a9f83fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:05:59.985520 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9463b089-8d6d-4a8e-bea2-0f299a9f83fd None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:05:59.988560 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9463b089-8d6d-4a8e-bea2-0f299a9f83fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:00.096106 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 727/1477] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:05:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:06:00.119879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a1944-c636-4014-aa3b-a6c9833786c4 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:06:00.121400 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5d9a1944-c636-4014-aa3b-a6c9833786c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:00.252693 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a1944-c636-4014-aa3b-a6c9833786c4 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:06:00.300432 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:00.355369 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725558cc-b2f8-4785-b0a6-61e867bb6608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:06:00.355966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725558cc-b2f8-4785-b0a6-61e867bb6608 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:00.356248 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725558cc-b2f8-4785-b0a6-61e867bb6608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:00.356521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725558cc-b2f8-4785-b0a6-61e867bb6608 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:00.357256 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725558cc-b2f8-4785-b0a6-61e867bb6608 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:06:00.358991 dv-cinder-master-3-smb devstack@keystone.service[80519]: WARNING py.warnings [None req-725558cc-b2f8-4785-b0a6-61e867bb6608 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:06:00.358991 dv-cinder-master-3-smb devstack@keystone.service[80519]: warnings.warn(msg) Jul 24 01:06:00.358991 dv-cinder-master-3-smb devstack@keystone.service[80519]: Jul 24 01:06:00.360173 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725558cc-b2f8-4785-b0a6-61e867bb6608 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:06:00.379450 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 751/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Sun Jul 24 01:06:00 2022] GET /identity/v3/projects => generated 2553 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:06:02.419990 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f941-b7ac-4833-b516-ed16cbed1255 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:02.420534 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f941-b7ac-4833-b516-ed16cbed1255 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:02.420534 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f08f941-b7ac-4833-b516-ed16cbed1255 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:02.421853 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 728/1479] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:06:02.427515 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38868856-6fe4-4767-b371-0996a7cd49a6 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:02.427939 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38868856-6fe4-4767-b371-0996a7cd49a6 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:02.428091 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38868856-6fe4-4767-b371-0996a7cd49a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:02.498224 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-38868856-6fe4-4767-b371-0996a7cd49a6 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:06:02.499507 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-38868856-6fe4-4767-b371-0996a7cd49a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:02.598601 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 752/1480] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:06:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:06:02.649451 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08f941-b7ac-4833-b516-ed16cbed1255 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:06:02.651004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5f08f941-b7ac-4833-b516-ed16cbed1255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:02.662011 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:02.808517 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f08f941-b7ac-4833-b516-ed16cbed1255 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:06:02.891306 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:02.924062 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8abe72-65b4-4e78-84e8-6fd2f7a2d090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:06:02.924724 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8abe72-65b4-4e78-84e8-6fd2f7a2d090 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:02.925010 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8abe72-65b4-4e78-84e8-6fd2f7a2d090 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:02.925298 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8abe72-65b4-4e78-84e8-6fd2f7a2d090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:02.926961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bf8abe72-65b4-4e78-84e8-6fd2f7a2d090 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:03.025778 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8abe72-65b4-4e78-84e8-6fd2f7a2d090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:06:03.027459 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8abe72-65b4-4e78-84e8-6fd2f7a2d090 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:06:03.045766 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 729/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:06:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:06:05.242100 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0f58b-9864-4a4e-a559-e5835164971a None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:05.242692 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0f58b-9864-4a4e-a559-e5835164971a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:05.242692 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0f58b-9864-4a4e-a559-e5835164971a None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:05.244100 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 753/1482] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:06:05.250476 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b73f00-1ff1-46c1-bcc1-6d0fc1428163 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:05.251164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b73f00-1ff1-46c1-bcc1-6d0fc1428163 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:05.251433 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b73f00-1ff1-46c1-bcc1-6d0fc1428163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:05.326432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-34b73f00-1ff1-46c1-bcc1-6d0fc1428163 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:06:05.327671 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-34b73f00-1ff1-46c1-bcc1-6d0fc1428163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:05.376616 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:05.439397 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 730/1483] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:06:05.489553 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0f58b-9864-4a4e-a559-e5835164971a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:06:05.491260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f9f0f58b-9864-4a4e-a559-e5835164971a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:05.517542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:05.604332 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0f58b-9864-4a4e-a559-e5835164971a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:06:05.681178 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603cd29e-826d-49f8-b2c3-5bb7a698a906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:06:05.681838 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd29e-826d-49f8-b2c3-5bb7a698a906 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:05.682124 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd29e-826d-49f8-b2c3-5bb7a698a906 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:05.682389 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603cd29e-826d-49f8-b2c3-5bb7a698a906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:05.684066 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-603cd29e-826d-49f8-b2c3-5bb7a698a906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:05.776493 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:05.822652 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cd29e-826d-49f8-b2c3-5bb7a698a906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:06:05.824157 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603cd29e-826d-49f8-b2c3-5bb7a698a906 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:06:05.845608 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 754/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:06:07.929632 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4b2d8-7dc6-46f5-b1ac-6693834209fb None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:07.930551 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4b2d8-7dc6-46f5-b1ac-6693834209fb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:07.930551 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d4b2d8-7dc6-46f5-b1ac-6693834209fb None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:07.932816 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 731/1485] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:06:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:06:07.942451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0b6ed-f4c9-479b-96b6-28f0765187f7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:07.942920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0b6ed-f4c9-479b-96b6-28f0765187f7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:07.943116 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0b6ed-f4c9-479b-96b6-28f0765187f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:08.016417 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b1c0b6ed-f4c9-479b-96b6-28f0765187f7 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:06:08.017574 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b1c0b6ed-f4c9-479b-96b6-28f0765187f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:08.127113 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 755/1486] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:06:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:06:08.167176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4b2d8-7dc6-46f5-b1ac-6693834209fb None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:06:08.168812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-69d4b2d8-7dc6-46f5-b1ac-6693834209fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:08.280084 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d4b2d8-7dc6-46f5-b1ac-6693834209fb None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:06:08.354874 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:08.356804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297ad14-e098-4550-9d9d-8a0b01efbd4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:06:08.357548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297ad14-e098-4550-9d9d-8a0b01efbd4d service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:08.357840 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297ad14-e098-4550-9d9d-8a0b01efbd4d service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:08.358512 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297ad14-e098-4550-9d9d-8a0b01efbd4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:08.361009 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5297ad14-e098-4550-9d9d-8a0b01efbd4d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:08.478755 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297ad14-e098-4550-9d9d-8a0b01efbd4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:06:08.480257 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297ad14-e098-4550-9d9d-8a0b01efbd4d service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:06:08.499913 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 732/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:06:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:06:10.626331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a2131-925b-4d3c-b920-f0c3ac3dd3eb None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:10.626908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a2131-925b-4d3c-b920-f0c3ac3dd3eb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:10.626908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a2131-925b-4d3c-b920-f0c3ac3dd3eb None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:10.628340 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 756/1488] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:06:10.634018 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c495b-0fd4-4252-adfd-45df78d0440d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:10.634478 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c495b-0fd4-4252-adfd-45df78d0440d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:10.634577 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c495b-0fd4-4252-adfd-45df78d0440d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:10.710655 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-451c495b-0fd4-4252-adfd-45df78d0440d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:06:10.711917 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-451c495b-0fd4-4252-adfd-45df78d0440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:10.778946 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:10.825303 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 733/1489] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:06:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:06:10.866234 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a2131-925b-4d3c-b920-f0c3ac3dd3eb None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:06:10.867846 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-299a2131-925b-4d3c-b920-f0c3ac3dd3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:10.907805 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:10.978395 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a2131-925b-4d3c-b920-f0c3ac3dd3eb None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:06:11.051373 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29d2379-388b-4508-a9ef-2e5385e551f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:06:11.052024 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d2379-388b-4508-a9ef-2e5385e551f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:11.052307 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d2379-388b-4508-a9ef-2e5385e551f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:11.052593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29d2379-388b-4508-a9ef-2e5385e551f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:11.054273 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d29d2379-388b-4508-a9ef-2e5385e551f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:11.135997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:11.166886 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d2379-388b-4508-a9ef-2e5385e551f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:06:11.168391 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29d2379-388b-4508-a9ef-2e5385e551f9 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:06:11.187045 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 757/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:06:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:06:13.433924 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119a31-f089-4aae-8678-09f8a67378d6 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:13.434884 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119a31-f089-4aae-8678-09f8a67378d6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:13.434884 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119a31-f089-4aae-8678-09f8a67378d6 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:13.436985 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 734/1491] 10.222.0.42 () {54 vars in 926 bytes} [Sun Jul 24 01:06:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:06:13.445177 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab79843-c2f6-4051-83c1-9355c2fd7b66 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:13.445669 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab79843-c2f6-4051-83c1-9355c2fd7b66 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:13.445763 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab79843-c2f6-4051-83c1-9355c2fd7b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:13.513323 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4ab79843-c2f6-4051-83c1-9355c2fd7b66 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:06:13.514525 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4ab79843-c2f6-4051-83c1-9355c2fd7b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:13.610269 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 758/1492] 10.222.0.42 () {58 vars in 1023 bytes} [Sun Jul 24 01:06:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:06:13.649500 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d119a31-f089-4aae-8678-09f8a67378d6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:06:13.651037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8d119a31-f089-4aae-8678-09f8a67378d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:13.771923 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d119a31-f089-4aae-8678-09f8a67378d6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:06:13.849587 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380451b-e2dc-4354-a817-50ff0401d7d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:06:13.850251 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380451b-e2dc-4354-a817-50ff0401d7d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:06:13.850544 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380451b-e2dc-4354-a817-50ff0401d7d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:06:13.850815 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380451b-e2dc-4354-a817-50ff0401d7d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:06:13.852549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d380451b-e2dc-4354-a817-50ff0401d7d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:06:13.863128 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:13.969430 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380451b-e2dc-4354-a817-50ff0401d7d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:06:13.970884 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380451b-e2dc-4354-a817-50ff0401d7d3 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:06:13.991182 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 735/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:06:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:06:23.608016 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=82 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:06:23.988526 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=50 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:40.405160 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede5bde-4e1f-4543-b1dc-0ac7176a36c8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:40.405784 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede5bde-4e1f-4543-b1dc-0ac7176a36c8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:40.405784 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede5bde-4e1f-4543-b1dc-0ac7176a36c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:40.489381 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4ede5bde-4e1f-4543-b1dc-0ac7176a36c8 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:07:40.490617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4ede5bde-4e1f-4543-b1dc-0ac7176a36c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:40.605183 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 759/1494] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:07:40.616736 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c51653-37c3-44f4-93bd-fb72b1a56436 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:40.617260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c51653-37c3-44f4-93bd-fb72b1a56436 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:40.617260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c51653-37c3-44f4-93bd-fb72b1a56436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:40.695759 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d1c51653-37c3-44f4-93bd-fb72b1a56436 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:07:40.696984 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d1c51653-37c3-44f4-93bd-fb72b1a56436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:40.798050 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 736/1495] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:07:40.803008 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede5bde-4e1f-4543-b1dc-0ac7176a36c8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:07:40.804282 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4ede5bde-4e1f-4543-b1dc-0ac7176a36c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:40.816748 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede5bde-4e1f-4543-b1dc-0ac7176a36c8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:07:40.897081 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:40.933861 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f9756-8060-4f40-8a9a-ec8ac1fb72c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:07:40.934542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f9756-8060-4f40-8a9a-ec8ac1fb72c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:40.934827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f9756-8060-4f40-8a9a-ec8ac1fb72c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:40.935107 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6f9756-8060-4f40-8a9a-ec8ac1fb72c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:40.935991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f9756-8060-4f40-8a9a-ec8ac1fb72c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:07:40.936297 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f9756-8060-4f40-8a9a-ec8ac1fb72c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:07:40.937345 dv-cinder-master-3-smb devstack@keystone.service[80519]: WARNING py.warnings [None req-7a6f9756-8060-4f40-8a9a-ec8ac1fb72c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:07:40.937345 dv-cinder-master-3-smb devstack@keystone.service[80519]: warnings.warn(msg) Jul 24 01:07:40.937345 dv-cinder-master-3-smb devstack@keystone.service[80519]: Jul 24 01:07:40.938241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6f9756-8060-4f40-8a9a-ec8ac1fb72c4 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:07:40.949883 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 760/1496] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:07:40.958530 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c51653-37c3-44f4-93bd-fb72b1a56436 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:07:40.968299 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c51653-37c3-44f4-93bd-fb72b1a56436 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:07:41.032695 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:41.069075 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af8b60-16fc-4328-806c-621bdd481f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:07:41.069739 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af8b60-16fc-4328-806c-621bdd481f49 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:41.069996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af8b60-16fc-4328-806c-621bdd481f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:41.070264 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af8b60-16fc-4328-806c-621bdd481f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:41.070946 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af8b60-16fc-4328-806c-621bdd481f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:07:41.072783 dv-cinder-master-3-smb devstack@keystone.service[80520]: WARNING py.warnings [None req-36af8b60-16fc-4328-806c-621bdd481f49 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:07:41.072783 dv-cinder-master-3-smb devstack@keystone.service[80520]: warnings.warn(msg) Jul 24 01:07:41.072783 dv-cinder-master-3-smb devstack@keystone.service[80520]: Jul 24 01:07:41.074027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36af8b60-16fc-4328-806c-621bdd481f49 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:07:41.132297 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 737/1497] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:07:40 2022] POST /identity/v3/projects => generated 379 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:07:41.136685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f9756-8060-4f40-8a9a-ec8ac1fb72c4 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:07:41.138363 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7a6f9756-8060-4f40-8a9a-ec8ac1fb72c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:41.172741 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6f9756-8060-4f40-8a9a-ec8ac1fb72c4 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:07:41.275987 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf41cb9-dfd7-44cc-a7f2-1e47b6d5dd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:07:41.276592 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf41cb9-dfd7-44cc-a7f2-1e47b6d5dd9b admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:41.276872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf41cb9-dfd7-44cc-a7f2-1e47b6d5dd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:41.277144 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf41cb9-dfd7-44cc-a7f2-1e47b6d5dd9b admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:41.277837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf41cb9-dfd7-44cc-a7f2-1e47b6d5dd9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:07:41.278872 dv-cinder-master-3-smb devstack@keystone.service[80519]: WARNING py.warnings [None req-7bf41cb9-dfd7-44cc-a7f2-1e47b6d5dd9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:07:41.278872 dv-cinder-master-3-smb devstack@keystone.service[80519]: warnings.warn(msg) Jul 24 01:07:41.278872 dv-cinder-master-3-smb devstack@keystone.service[80519]: Jul 24 01:07:41.280134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf41cb9-dfd7-44cc-a7f2-1e47b6d5dd9b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:07:41.324014 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 761/1498] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:07:41 2022] POST /identity/v3/users => generated 290 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:07:41.328330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af8b60-16fc-4328-806c-621bdd481f49 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:07:41.329932 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-36af8b60-16fc-4328-806c-621bdd481f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:41.396827 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af8b60-16fc-4328-806c-621bdd481f49 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:07:41.495482 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:41.508161 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f132dbc-6862-416f-a230-e94559ca6925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:07:41.508849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f132dbc-6862-416f-a230-e94559ca6925 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:41.509138 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f132dbc-6862-416f-a230-e94559ca6925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:41.509419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f132dbc-6862-416f-a230-e94559ca6925 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:41.510153 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f132dbc-6862-416f-a230-e94559ca6925 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:07:41.511196 dv-cinder-master-3-smb devstack@keystone.service[80520]: WARNING py.warnings [None req-4f132dbc-6862-416f-a230-e94559ca6925 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:07:41.511196 dv-cinder-master-3-smb devstack@keystone.service[80520]: warnings.warn(msg) Jul 24 01:07:41.511196 dv-cinder-master-3-smb devstack@keystone.service[80520]: Jul 24 01:07:41.512230 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f132dbc-6862-416f-a230-e94559ca6925 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:07:41.525473 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 738/1499] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:07:41.529830 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf41cb9-dfd7-44cc-a7f2-1e47b6d5dd9b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:07:41.531312 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7bf41cb9-dfd7-44cc-a7f2-1e47b6d5dd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:41.542554 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf41cb9-dfd7-44cc-a7f2-1e47b6d5dd9b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:07:41.572402 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:41.647158 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07556ed6-b19c-45d7-812a-d41eccaf0175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:07:41.647849 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07556ed6-b19c-45d7-812a-d41eccaf0175 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:41.648174 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07556ed6-b19c-45d7-812a-d41eccaf0175 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:41.648446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07556ed6-b19c-45d7-812a-d41eccaf0175 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:41.649180 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07556ed6-b19c-45d7-812a-d41eccaf0175 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:07:41.650196 dv-cinder-master-3-smb devstack@keystone.service[80519]: WARNING py.warnings [None req-07556ed6-b19c-45d7-812a-d41eccaf0175 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:07:41.650196 dv-cinder-master-3-smb devstack@keystone.service[80519]: warnings.warn(msg) Jul 24 01:07:41.650196 dv-cinder-master-3-smb devstack@keystone.service[80519]: Jul 24 01:07:41.651079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07556ed6-b19c-45d7-812a-d41eccaf0175 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:07:41.663418 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 762/1500] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:07:41.667867 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f132dbc-6862-416f-a230-e94559ca6925 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:07:41.669390 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4f132dbc-6862-416f-a230-e94559ca6925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:41.703721 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f132dbc-6862-416f-a230-e94559ca6925 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:07:41.802154 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd87f17e-d8f1-4731-8d63-8a6122f32565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:07:41.802953 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f17e-d8f1-4731-8d63-8a6122f32565 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:41.803249 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f17e-d8f1-4731-8d63-8a6122f32565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:41.803548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd87f17e-d8f1-4731-8d63-8a6122f32565 admin admin] PATH_INFO: `/v3/projects/43c90470ba6f4ad49f576a5b55b06974/users/339a0dd9923b49d38567b3090ba5de6e/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:41.826805 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87f17e-d8f1-4731-8d63-8a6122f32565 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43c90470ba6f4ad49f576a5b55b06974, user_id=339a0dd9923b49d38567b3090ba5de6e, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:07:41.827904 dv-cinder-master-3-smb devstack@keystone.service[80520]: WARNING py.warnings [None req-cd87f17e-d8f1-4731-8d63-8a6122f32565 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:07:41.827904 dv-cinder-master-3-smb devstack@keystone.service[80520]: warnings.warn(msg) Jul 24 01:07:41.827904 dv-cinder-master-3-smb devstack@keystone.service[80520]: Jul 24 01:07:41.829867 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd87f17e-d8f1-4731-8d63-8a6122f32565 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:07:41.856367 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 739/1501] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:07:41 2022] PUT /identity/v3/projects/43c90470ba6f4ad49f576a5b55b06974/users/339a0dd9923b49d38567b3090ba5de6e/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:07:41.868748 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ed13f-9adc-4eb8-abc5-dbecbcc9c621 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:41.869023 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ed13f-9adc-4eb8-abc5-dbecbcc9c621 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:41.869339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ed13f-9adc-4eb8-abc5-dbecbcc9c621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:41.932718 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-db4ed13f-9adc-4eb8-abc5-dbecbcc9c621 None None] MFA Rules not processed for user `339a0dd9923b49d38567b3090ba5de6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:07:41.934296 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-db4ed13f-9adc-4eb8-abc5-dbecbcc9c621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:42.016339 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 763/1502] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:07:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:07:42.030554 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c6da0-e56a-4b32-a6bd-314562123ccd None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:42.030845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c6da0-e56a-4b32-a6bd-314562123ccd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:42.031122 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c6da0-e56a-4b32-a6bd-314562123ccd None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:42.032551 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 740/1503] 10.222.0.42 () {54 vars in 964 bytes} [Sun Jul 24 01:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:07:42.037572 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4914d09-4f9a-492a-b5b6-876535309880 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:42.037871 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4914d09-4f9a-492a-b5b6-876535309880 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:42.038177 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4914d09-4f9a-492a-b5b6-876535309880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:42.069622 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:42.119158 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d4914d09-4f9a-492a-b5b6-876535309880 None None] MFA Rules not processed for user `fa52d40556494110bf6962e09addfc15`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:07:42.120420 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d4914d09-4f9a-492a-b5b6-876535309880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:42.205798 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 764/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Sun Jul 24 01:07:42 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:07:42.214613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c6da0-e56a-4b32-a6bd-314562123ccd None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:07:42.217013 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c76c6da0-e56a-4b32-a6bd-314562123ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:42.276903 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:42.336668 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c6da0-e56a-4b32-a6bd-314562123ccd None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:07:42.415427 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408d931-dcfa-46cc-834f-38aaf2b57654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:07:42.416081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408d931-dcfa-46cc-834f-38aaf2b57654 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:42.416365 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408d931-dcfa-46cc-834f-38aaf2b57654 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:42.416641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408d931-dcfa-46cc-834f-38aaf2b57654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:42.418292 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f408d931-dcfa-46cc-834f-38aaf2b57654 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:42.521241 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408d931-dcfa-46cc-834f-38aaf2b57654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:07:42.522684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408d931-dcfa-46cc-834f-38aaf2b57654 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:07:42.526516 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:42.542042 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 741/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:07:42 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:07:42.590532 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20d54d-4464-48af-8e89-26ec150bedfb None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:42.590992 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20d54d-4464-48af-8e89-26ec150bedfb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:42.591092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20d54d-4464-48af-8e89-26ec150bedfb None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:42.592497 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 765/1506] 10.222.0.42 () {52 vars in 829 bytes} [Sun Jul 24 01:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:07:42.596375 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408d931-dcfa-46cc-834f-38aaf2b57654 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:07:42.597632 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f408d931-dcfa-46cc-834f-38aaf2b57654 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:42.701804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408d931-dcfa-46cc-834f-38aaf2b57654 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:07:42.804018 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce55a50-c44b-48db-985b-46344cdf30cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:07:42.804917 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce55a50-c44b-48db-985b-46344cdf30cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:42.805205 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce55a50-c44b-48db-985b-46344cdf30cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:42.805485 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce55a50-c44b-48db-985b-46344cdf30cf admin admin] PATH_INFO: `/v3/users/339a0dd9923b49d38567b3090ba5de6e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:42.819667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce55a50-c44b-48db-985b-46344cdf30cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=339a0dd9923b49d38567b3090ba5de6e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:07:42.820820 dv-cinder-master-3-smb devstack@keystone.service[80520]: WARNING py.warnings [None req-fce55a50-c44b-48db-985b-46344cdf30cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:07:42.820820 dv-cinder-master-3-smb devstack@keystone.service[80520]: warnings.warn(msg) Jul 24 01:07:42.820820 dv-cinder-master-3-smb devstack@keystone.service[80520]: Jul 24 01:07:42.822069 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce55a50-c44b-48db-985b-46344cdf30cf admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:07:42.832473 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:42.887309 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fce55a50-c44b-48db-985b-46344cdf30cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '339a0dd9923b49d38567b3090ba5de6e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:07:42.887823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fce55a50-c44b-48db-985b-46344cdf30cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '339a0dd9923b49d38567b3090ba5de6e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:07:42.888339 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fce55a50-c44b-48db-985b-46344cdf30cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '339a0dd9923b49d38567b3090ba5de6e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:07:42.900777 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fce55a50-c44b-48db-985b-46344cdf30cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '339a0dd9923b49d38567b3090ba5de6e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:07:42.920179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fce55a50-c44b-48db-985b-46344cdf30cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '339a0dd9923b49d38567b3090ba5de6e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:07:42.937055 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 742/1507] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:07:42 2022] DELETE /identity/v3/users/339a0dd9923b49d38567b3090ba5de6e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:07:42.941627 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3a643-d359-4902-9e03-3f47a62c1e26 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:42.941916 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3a643-d359-4902-9e03-3f47a62c1e26 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:42.942192 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f3a643-d359-4902-9e03-3f47a62c1e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:42.995823 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-06f3a643-d359-4902-9e03-3f47a62c1e26 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:07:42.997017 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-06f3a643-d359-4902-9e03-3f47a62c1e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:43.083846 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:43.098477 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 766/1508] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:07:43.108380 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce55a50-c44b-48db-985b-46344cdf30cf admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:07:43.109627 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fce55a50-c44b-48db-985b-46344cdf30cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:43.212607 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce55a50-c44b-48db-985b-46344cdf30cf admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:07:43.277943 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:43.301493 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b037d-de9c-41cc-ac1a-9e43741b0709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:07:43.302160 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b037d-de9c-41cc-ac1a-9e43741b0709 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:43.302453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b037d-de9c-41cc-ac1a-9e43741b0709 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:43.302729 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b037d-de9c-41cc-ac1a-9e43741b0709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:43.304471 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e78b037d-de9c-41cc-ac1a-9e43741b0709 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:43.419614 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b037d-de9c-41cc-ac1a-9e43741b0709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:07:43.420999 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b037d-de9c-41cc-ac1a-9e43741b0709 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:07:43.439669 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 743/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:07:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:07:43.804881 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3a643-d359-4902-9e03-3f47a62c1e26 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:07:43.806200 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-06f3a643-d359-4902-9e03-3f47a62c1e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:07:43.818438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f3a643-d359-4902-9e03-3f47a62c1e26 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:07:43.914920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484fd34-ae73-430e-9f42-0da307bcb77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:07:43.915836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484fd34-ae73-430e-9f42-0da307bcb77d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:07:43.916116 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484fd34-ae73-430e-9f42-0da307bcb77d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:07:43.916391 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484fd34-ae73-430e-9f42-0da307bcb77d admin admin] PATH_INFO: `/v3/projects/43c90470ba6f4ad49f576a5b55b06974` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:07:43.926577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484fd34-ae73-430e-9f42-0da307bcb77d admin admin] RBAC: Authorizing `identity:delete_project(project_id=43c90470ba6f4ad49f576a5b55b06974)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:07:43.927630 dv-cinder-master-3-smb devstack@keystone.service[80519]: WARNING py.warnings [None req-e484fd34-ae73-430e-9f42-0da307bcb77d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:07:43.927630 dv-cinder-master-3-smb devstack@keystone.service[80519]: warnings.warn(msg) Jul 24 01:07:43.927630 dv-cinder-master-3-smb devstack@keystone.service[80519]: Jul 24 01:07:43.928843 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484fd34-ae73-430e-9f42-0da307bcb77d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:07:43.991677 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e484fd34-ae73-430e-9f42-0da307bcb77d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43c90470ba6f4ad49f576a5b55b06974', 'request_id': 'req-e484fd34-ae73-430e-9f42-0da307bcb77d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:07:44.004903 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e484fd34-ae73-430e-9f42-0da307bcb77d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43c90470ba6f4ad49f576a5b55b06974', 'request_id': 'req-e484fd34-ae73-430e-9f42-0da307bcb77d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:07:44.011232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e484fd34-ae73-430e-9f42-0da307bcb77d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43c90470ba6f4ad49f576a5b55b06974', 'request_id': 'req-e484fd34-ae73-430e-9f42-0da307bcb77d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:07:44.037819 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e484fd34-ae73-430e-9f42-0da307bcb77d admin admin] The token cache is being invalidate because project 43c90470ba6f4ad49f576a5b55b06974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:07:44.038113 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e484fd34-ae73-430e-9f42-0da307bcb77d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:07:44.038558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e484fd34-ae73-430e-9f42-0da307bcb77d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:07:44.040133 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 767/1510] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:07:43 2022] DELETE /identity/v3/projects/43c90470ba6f4ad49f576a5b55b06974 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:07:53.437338 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=62 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:07:54.035920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:29.877158 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ddfa7-100a-4632-a5b4-beb0376b0222 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:29.878025 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ddfa7-100a-4632-a5b4-beb0376b0222 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:29.878025 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ddfa7-100a-4632-a5b4-beb0376b0222 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:29.880398 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 744/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:09:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:29.886218 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7e51c-8449-4da6-81ef-760f18d04300 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:29.886960 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7e51c-8449-4da6-81ef-760f18d04300 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:29.887155 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7e51c-8449-4da6-81ef-760f18d04300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:29.972499 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-bfc7e51c-8449-4da6-81ef-760f18d04300 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:29.973723 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bfc7e51c-8449-4da6-81ef-760f18d04300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:30.084161 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 768/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:30.241581 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ddfa7-100a-4632-a5b4-beb0376b0222 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:30.244248 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e87ddfa7-100a-4632-a5b4-beb0376b0222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:30.385001 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ddfa7-100a-4632-a5b4-beb0376b0222 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:30.391229 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1aaa0-e0b5-4c11-8f7f-198eea92e02e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:30.391895 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1aaa0-e0b5-4c11-8f7f-198eea92e02e service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:30.392172 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1aaa0-e0b5-4c11-8f7f-198eea92e02e service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:30.392455 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1aaa0-e0b5-4c11-8f7f-198eea92e02e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:30.400921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1aaa0-e0b5-4c11-8f7f-198eea92e02e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:30.402521 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1aaa0-e0b5-4c11-8f7f-198eea92e02e service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:30.412035 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 745/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:31.241217 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850124a-4beb-4dde-82c7-9699f0838d41 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:31.242097 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850124a-4beb-4dde-82c7-9699f0838d41 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:31.242097 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850124a-4beb-4dde-82c7-9699f0838d41 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:31.244444 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 769/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:09:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:31.250201 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f08ba2-4968-4758-b019-bf72c3a40bd3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:31.250654 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f08ba2-4968-4758-b019-bf72c3a40bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:31.250769 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f08ba2-4968-4758-b019-bf72c3a40bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:31.270980 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b3f08ba2-4968-4758-b019-bf72c3a40bd3 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:31.272239 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b3f08ba2-4968-4758-b019-bf72c3a40bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:31.281390 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 746/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:31.433801 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850124a-4beb-4dde-82c7-9699f0838d41 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:31.459249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850124a-4beb-4dde-82c7-9699f0838d41 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:31.465999 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9392ac2-a5dc-495f-b65e-2d5cbd45b314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:31.466664 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9392ac2-a5dc-495f-b65e-2d5cbd45b314 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:31.467030 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9392ac2-a5dc-495f-b65e-2d5cbd45b314 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:31.467339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9392ac2-a5dc-495f-b65e-2d5cbd45b314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:31.475945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9392ac2-a5dc-495f-b65e-2d5cbd45b314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:31.477597 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9392ac2-a5dc-495f-b65e-2d5cbd45b314 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:31.487168 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 770/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:31.686181 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e1467-37d1-44a3-aeae-dc452580d109 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:31.686446 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e1467-37d1-44a3-aeae-dc452580d109 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:31.686737 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291e1467-37d1-44a3-aeae-dc452580d109 None None] PATH_INFO: `/v3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:31.688198 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 747/1517] 10.222.0.20 () {54 vars in 925 bytes} [Sun Jul 24 01:09:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:09:31.695259 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bdba2-a03d-406c-a752-9aefa228f8ba None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:31.695609 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bdba2-a03d-406c-a752-9aefa228f8ba None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:31.695890 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bdba2-a03d-406c-a752-9aefa228f8ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:31.758111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-742bdba2-a03d-406c-a752-9aefa228f8ba None None] MFA Rules not processed for user `333db0711d0f41fe8066ba5b9d91dacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:31.759234 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-742bdba2-a03d-406c-a752-9aefa228f8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:31.781151 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:31.840444 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 771/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Jul 24 01:09:31 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:40.908977 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfc126-5eb7-4555-ac6c-400782ad28b4 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:40.909937 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfc126-5eb7-4555-ac6c-400782ad28b4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:40.909937 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bfc126-5eb7-4555-ac6c-400782ad28b4 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:40.912281 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 748/1519] 10.222.0.42 () {54 vars in 961 bytes} [Sun Jul 24 01:09:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:40.917587 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aef92a-e99e-4cc8-ad43-dacd59a68eee None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:40.918044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aef92a-e99e-4cc8-ad43-dacd59a68eee None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:40.918152 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aef92a-e99e-4cc8-ad43-dacd59a68eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:40.937230 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-12aef92a-e99e-4cc8-ad43-dacd59a68eee None None] MFA Rules not processed for user `333db0711d0f41fe8066ba5b9d91dacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:40.938431 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-12aef92a-e99e-4cc8-ad43-dacd59a68eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:40.947652 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 772/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Jul 24 01:09:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:40.955213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfc126-5eb7-4555-ac6c-400782ad28b4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:40.974244 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bfc126-5eb7-4555-ac6c-400782ad28b4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:40.982325 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f6e03-45e2-43b8-9bc4-edf335a005ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333db0711d0f41fe8066ba5b9d91dacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:40.982964 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f6e03-45e2-43b8-9bc4-edf335a005ec service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:40.983245 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f6e03-45e2-43b8-9bc4-edf335a005ec service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:40.983552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f6e03-45e2-43b8-9bc4-edf335a005ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:40.992308 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f6e03-45e2-43b8-9bc4-edf335a005ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:40.993920 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f6e03-45e2-43b8-9bc4-edf335a005ec service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:41.003865 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 749/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:42.726646 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d1cec-7936-4285-872d-df947b6da5e0 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:42.727626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d1cec-7936-4285-872d-df947b6da5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:42.727626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2d1cec-7936-4285-872d-df947b6da5e0 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:42.729826 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 773/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:09:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:42.737997 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a8764-dc1a-4b18-89d8-bc4baa487f84 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:42.738440 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a8764-dc1a-4b18-89d8-bc4baa487f84 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:42.738556 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a8764-dc1a-4b18-89d8-bc4baa487f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:42.760716 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9c9a8764-dc1a-4b18-89d8-bc4baa487f84 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:42.761971 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9c9a8764-dc1a-4b18-89d8-bc4baa487f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:42.774208 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 750/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:09:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:42.924163 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d1cec-7936-4285-872d-df947b6da5e0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:42.940298 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2d1cec-7936-4285-872d-df947b6da5e0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:42.946061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3156b10-345d-4af7-a19e-85b8ff0f6dbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:42.946703 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3156b10-345d-4af7-a19e-85b8ff0f6dbe service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:42.946987 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3156b10-345d-4af7-a19e-85b8ff0f6dbe service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:42.947264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3156b10-345d-4af7-a19e-85b8ff0f6dbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:42.955768 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3156b10-345d-4af7-a19e-85b8ff0f6dbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:42.957369 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3156b10-345d-4af7-a19e-85b8ff0f6dbe service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:42.967287 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 774/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:43.801498 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebe61d-b1b2-436c-af56-1c5239467f57 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:43.802035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebe61d-b1b2-436c-af56-1c5239467f57 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:43.802035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ebe61d-b1b2-436c-af56-1c5239467f57 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:43.804135 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 751/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Jul 24 01:09:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:43.811226 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa35a6f-d558-40ab-8899-13c42599a120 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:43.811663 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa35a6f-d558-40ab-8899-13c42599a120 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:43.811847 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa35a6f-d558-40ab-8899-13c42599a120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:43.831479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3aa35a6f-d558-40ab-8899-13c42599a120 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:43.832674 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3aa35a6f-d558-40ab-8899-13c42599a120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:43.841457 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 775/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Jul 24 01:09:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:43.991968 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebe61d-b1b2-436c-af56-1c5239467f57 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:44.008171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ebe61d-b1b2-436c-af56-1c5239467f57 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:44.014240 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933781c4-2f80-401e-86f9-612177e971ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:44.014897 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933781c4-2f80-401e-86f9-612177e971ad service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:44.015187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933781c4-2f80-401e-86f9-612177e971ad service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:44.015504 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933781c4-2f80-401e-86f9-612177e971ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:44.023926 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933781c4-2f80-401e-86f9-612177e971ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:44.025544 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933781c4-2f80-401e-86f9-612177e971ad service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:44.035020 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 752/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:48.024879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678acc0a-7518-49eb-b499-a04a045432ce None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:48.025472 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678acc0a-7518-49eb-b499-a04a045432ce None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:48.025472 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678acc0a-7518-49eb-b499-a04a045432ce None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:48.026829 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 776/1528] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:48.032229 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9331d-6882-47c4-8faf-803a281039eb None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:48.032721 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9331d-6882-47c4-8faf-803a281039eb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:48.032819 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d9331d-6882-47c4-8faf-803a281039eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:48.052132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a0d9331d-6882-47c4-8faf-803a281039eb None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:48.053341 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a0d9331d-6882-47c4-8faf-803a281039eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:48.065065 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 753/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:09:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:48.142380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678acc0a-7518-49eb-b499-a04a045432ce None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:48.144550 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-678acc0a-7518-49eb-b499-a04a045432ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:48.231436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678acc0a-7518-49eb-b499-a04a045432ce None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:48.235424 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaef086-56e9-4224-9f60-e5705b4977dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:48.236078 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaef086-56e9-4224-9f60-e5705b4977dc service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:48.236362 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaef086-56e9-4224-9f60-e5705b4977dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:48.236635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaef086-56e9-4224-9f60-e5705b4977dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:48.246467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaef086-56e9-4224-9f60-e5705b4977dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:48.247957 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beaef086-56e9-4224-9f60-e5705b4977dc service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:48.257378 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 777/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:50.280699 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93216e-b99d-42de-888c-ac1e1401ee44 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:50.281573 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93216e-b99d-42de-888c-ac1e1401ee44 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:50.281573 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d93216e-b99d-42de-888c-ac1e1401ee44 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:50.283956 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 754/1531] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:09:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:50.290376 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85875e7-2b57-4d7d-81e2-1beae81f5f03 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:50.291170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85875e7-2b57-4d7d-81e2-1beae81f5f03 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:50.291405 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85875e7-2b57-4d7d-81e2-1beae81f5f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:50.316166 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b85875e7-2b57-4d7d-81e2-1beae81f5f03 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:50.317361 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b85875e7-2b57-4d7d-81e2-1beae81f5f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:50.325794 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 778/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:09:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:50.365161 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93216e-b99d-42de-888c-ac1e1401ee44 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:50.379592 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d93216e-b99d-42de-888c-ac1e1401ee44 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:50.384040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e60ce8-211b-46c9-9246-1ec75d5b1f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:50.384688 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e60ce8-211b-46c9-9246-1ec75d5b1f69 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:50.384967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e60ce8-211b-46c9-9246-1ec75d5b1f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:50.385250 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e60ce8-211b-46c9-9246-1ec75d5b1f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:50.394976 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e60ce8-211b-46c9-9246-1ec75d5b1f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:50.396445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e60ce8-211b-46c9-9246-1ec75d5b1f69 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:50.409237 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 755/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:53.861463 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894494ea-f387-4a33-857c-db57a4923454 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:53.862005 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894494ea-f387-4a33-857c-db57a4923454 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:53.862005 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894494ea-f387-4a33-857c-db57a4923454 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:53.863448 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 779/1534] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:53.869719 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa859d81-3f31-4655-a63c-7e9c8e10b69e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:53.870490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa859d81-3f31-4655-a63c-7e9c8e10b69e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:53.870674 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa859d81-3f31-4655-a63c-7e9c8e10b69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:53.882695 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=81 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:53.897926 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-fa859d81-3f31-4655-a63c-7e9c8e10b69e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:53.899139 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fa859d81-3f31-4655-a63c-7e9c8e10b69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:53.908321 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 756/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:09:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:54.218357 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894494ea-f387-4a33-857c-db57a4923454 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:54.220373 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-894494ea-f387-4a33-857c-db57a4923454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:54.298997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:09:54.314932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894494ea-f387-4a33-857c-db57a4923454 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:54.318768 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2793368-8daf-4787-8afa-f00b8cf86749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:54.319457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2793368-8daf-4787-8afa-f00b8cf86749 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:54.319744 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2793368-8daf-4787-8afa-f00b8cf86749 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:54.320031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2793368-8daf-4787-8afa-f00b8cf86749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:54.329787 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2793368-8daf-4787-8afa-f00b8cf86749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:54.331221 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2793368-8daf-4787-8afa-f00b8cf86749 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:54.341296 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 780/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:09:56.392240 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb70bba-bbef-4c5d-bc88-2f0228e5ba6d None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:56.392842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb70bba-bbef-4c5d-bc88-2f0228e5ba6d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:56.392842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb70bba-bbef-4c5d-bc88-2f0228e5ba6d None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:56.394743 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 757/1537] 127.0.0.1 () {54 vars in 916 bytes} [Sun Jul 24 01:09:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:09:56.400286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6a98-5ac9-44cc-bd60-736fdabc43b7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:56.400699 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6a98-5ac9-44cc-bd60-736fdabc43b7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:56.400868 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ed6a98-5ac9-44cc-bd60-736fdabc43b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:56.419924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-91ed6a98-5ac9-44cc-bd60-736fdabc43b7 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:09:56.421135 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-91ed6a98-5ac9-44cc-bd60-736fdabc43b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:56.429965 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 781/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Sun Jul 24 01:09:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:09:56.748358 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb70bba-bbef-4c5d-bc88-2f0228e5ba6d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:09:56.751367 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6eb70bba-bbef-4c5d-bc88-2f0228e5ba6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:09:56.770076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb70bba-bbef-4c5d-bc88-2f0228e5ba6d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:09:56.774390 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81896778-8f1f-4a16-a166-dee713a6829c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:09:56.775042 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81896778-8f1f-4a16-a166-dee713a6829c service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:09:56.775332 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81896778-8f1f-4a16-a166-dee713a6829c service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:09:56.775633 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81896778-8f1f-4a16-a166-dee713a6829c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:09:56.786666 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81896778-8f1f-4a16-a166-dee713a6829c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:09:56.788123 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81896778-8f1f-4a16-a166-dee713a6829c service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:09:56.798721 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 758/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:09:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:10:06.415507 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=11 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:10:06.793904 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=8 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:35.725462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db1cd2-8097-4e13-bc10-d332073c9587 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:35.756626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db1cd2-8097-4e13-bc10-d332073c9587 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:35.756626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db1cd2-8097-4e13-bc10-d332073c9587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:35.756626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-93db1cd2-8097-4e13-bc10-d332073c9587 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:35.756626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-93db1cd2-8097-4e13-bc10-d332073c9587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:35.766303 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 782/1540] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:35.775115 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c49dd-c26d-4406-b5d2-e0ce9bce2d00 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:35.775733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c49dd-c26d-4406-b5d2-e0ce9bce2d00 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:35.775733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c49dd-c26d-4406-b5d2-e0ce9bce2d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:35.804801 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-025c49dd-c26d-4406-b5d2-e0ce9bce2d00 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:35.806048 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-025c49dd-c26d-4406-b5d2-e0ce9bce2d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:35.812726 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ffb99-b3d8-4545-af23-052f75d6e4d4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:35.813333 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ffb99-b3d8-4545-af23-052f75d6e4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:35.813797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ffb99-b3d8-4545-af23-052f75d6e4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:35.822247 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 759/1541] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:35.823412 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c49dd-c26d-4406-b5d2-e0ce9bce2d00 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:35.833215 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c49dd-c26d-4406-b5d2-e0ce9bce2d00 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:35.839629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18340148-8a78-42c4-8956-5d8a29542057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:35.840505 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18340148-8a78-42c4-8956-5d8a29542057 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:35.840949 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18340148-8a78-42c4-8956-5d8a29542057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:35.841378 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18340148-8a78-42c4-8956-5d8a29542057 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:35.842283 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18340148-8a78-42c4-8956-5d8a29542057 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:35.842742 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18340148-8a78-42c4-8956-5d8a29542057 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:35.843962 dv-cinder-master-3-smb devstack@keystone.service[80520]: WARNING py.warnings [None req-18340148-8a78-42c4-8956-5d8a29542057 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:35.843962 dv-cinder-master-3-smb devstack@keystone.service[80520]: warnings.warn(msg) Jul 24 01:11:35.843962 dv-cinder-master-3-smb devstack@keystone.service[80520]: Jul 24 01:11:35.845233 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18340148-8a78-42c4-8956-5d8a29542057 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:35.852433 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-785ffb99-b3d8-4545-af23-052f75d6e4d4 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:35.853911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-785ffb99-b3d8-4545-af23-052f75d6e4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:35.862450 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 760/1542] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:35.870956 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18340148-8a78-42c4-8956-5d8a29542057 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:35.877043 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 783/1543] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:35.886922 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18340148-8a78-42c4-8956-5d8a29542057 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:35.891316 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017bd4a-d0be-43f9-8770-7fbb9c77a5e1 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:35.891316 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017bd4a-d0be-43f9-8770-7fbb9c77a5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:35.891316 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017bd4a-d0be-43f9-8770-7fbb9c77a5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:35.895685 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8034d7-d593-4c3a-b169-2653fd06a95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:35.896656 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8034d7-d593-4c3a-b169-2653fd06a95c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:35.897111 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8034d7-d593-4c3a-b169-2653fd06a95c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:35.897543 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8034d7-d593-4c3a-b169-2653fd06a95c admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:35.898407 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8034d7-d593-4c3a-b169-2653fd06a95c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:35.900550 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8034d7-d593-4c3a-b169-2653fd06a95c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:35.923536 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f017bd4a-d0be-43f9-8770-7fbb9c77a5e1 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:35.925411 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f017bd4a-d0be-43f9-8770-7fbb9c77a5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:35.941921 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 784/1544] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:35.946275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7f5a4-202f-4f71-9f1b-bb6f8729c777 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:35.946275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7f5a4-202f-4f71-9f1b-bb6f8729c777 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:35.946275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f7f5a4-202f-4f71-9f1b-bb6f8729c777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:35.962994 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 761/1545] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:35 2022] POST /identity/v3/projects => generated 365 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:35.964330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8034d7-d593-4c3a-b169-2653fd06a95c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:35.992264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b0f7f5a4-202f-4f71-9f1b-bb6f8729c777 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:35.993558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b0f7f5a4-202f-4f71-9f1b-bb6f8729c777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:36.121474 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8034d7-d593-4c3a-b169-2653fd06a95c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.133292 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744a48b-9721-4140-92ef-921999376a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.133993 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744a48b-9721-4140-92ef-921999376a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.134279 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744a48b-9721-4140-92ef-921999376a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.134559 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744a48b-9721-4140-92ef-921999376a96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.135327 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744a48b-9721-4140-92ef-921999376a96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:36.135637 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744a48b-9721-4140-92ef-921999376a96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.139765 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744a48b-9721-4140-92ef-921999376a96 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.144906 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 785/1546] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:36.145741 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7f5a4-202f-4f71-9f1b-bb6f8729c777 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.162894 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f7f5a4-202f-4f71-9f1b-bb6f8729c777 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.167578 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 762/1547] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:36.169132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e00127-d2f7-4820-afa0-587ec3e13fd6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.169426 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e00127-d2f7-4820-afa0-587ec3e13fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.169704 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e00127-d2f7-4820-afa0-587ec3e13fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.176457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2e4b5-af55-441b-b0d1-f5b7e01a40d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.177478 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2e4b5-af55-441b-b0d1-f5b7e01a40d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.177769 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2e4b5-af55-441b-b0d1-f5b7e01a40d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.180239 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2e4b5-af55-441b-b0d1-f5b7e01a40d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.180974 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2e4b5-af55-441b-b0d1-f5b7e01a40d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.182936 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2e4b5-af55-441b-b0d1-f5b7e01a40d5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.206515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-14e00127-d2f7-4820-afa0-587ec3e13fd6 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:36.207974 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-14e00127-d2f7-4820-afa0-587ec3e13fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:36.216794 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 763/1548] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:36.225394 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 786/1549] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/users => generated 283 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:36.226698 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd08b7-979d-4afd-bc8c-ea3723830016 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.226992 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd08b7-979d-4afd-bc8c-ea3723830016 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.227270 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd08b7-979d-4afd-bc8c-ea3723830016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.228807 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfcb7e-6b72-41df-bd04-6b49a04b32d7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.229096 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfcb7e-6b72-41df-bd04-6b49a04b32d7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.230796 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfcb7e-6b72-41df-bd04-6b49a04b32d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.261544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a1fd08b7-979d-4afd-bc8c-ea3723830016 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:36.262843 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a1fd08b7-979d-4afd-bc8c-ea3723830016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:36.263482 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9cbfcb7e-6b72-41df-bd04-6b49a04b32d7 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:36.264671 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9cbfcb7e-6b72-41df-bd04-6b49a04b32d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:36.273146 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 787/1550] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:36.273758 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 764/1551] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:36.273968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd08b7-979d-4afd-bc8c-ea3723830016 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.274888 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996ecef-edb1-40e5-bd6b-6601c0e8f7d1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.275171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996ecef-edb1-40e5-bd6b-6601c0e8f7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.275502 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996ecef-edb1-40e5-bd6b-6601c0e8f7d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.284946 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd08b7-979d-4afd-bc8c-ea3723830016 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.291476 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e2834-8c8e-4c27-98ff-7194f27a72f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.292273 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e2834-8c8e-4c27-98ff-7194f27a72f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.292562 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e2834-8c8e-4c27-98ff-7194f27a72f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.292840 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e2834-8c8e-4c27-98ff-7194f27a72f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.293543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e2834-8c8e-4c27-98ff-7194f27a72f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.294592 dv-cinder-master-3-smb devstack@keystone.service[80519]: WARNING py.warnings [None req-f72e2834-8c8e-4c27-98ff-7194f27a72f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:36.294592 dv-cinder-master-3-smb devstack@keystone.service[80519]: warnings.warn(msg) Jul 24 01:11:36.294592 dv-cinder-master-3-smb devstack@keystone.service[80519]: Jul 24 01:11:36.294850 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a996ecef-edb1-40e5-bd6b-6601c0e8f7d1 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:36.295807 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a996ecef-edb1-40e5-bd6b-6601c0e8f7d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:36.295948 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e2834-8c8e-4c27-98ff-7194f27a72f5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.305212 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 765/1552] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:36.306030 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996ecef-edb1-40e5-bd6b-6601c0e8f7d1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.320719 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996ecef-edb1-40e5-bd6b-6601c0e8f7d1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.325647 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14e79d-edfe-4428-b124-6a46d41d8c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.326310 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14e79d-edfe-4428-b124-6a46d41d8c87 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.326592 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14e79d-edfe-4428-b124-6a46d41d8c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.326865 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e14e79d-edfe-4428-b124-6a46d41d8c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.327641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14e79d-edfe-4428-b124-6a46d41d8c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.329260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e14e79d-edfe-4428-b124-6a46d41d8c87 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.333740 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 788/1553] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:36.335355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed41aba-e487-4a71-b03f-be8a369b486e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.335895 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed41aba-e487-4a71-b03f-be8a369b486e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.336374 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed41aba-e487-4a71-b03f-be8a369b486e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.341702 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 766/1554] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:36.342585 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14e79d-edfe-4428-b124-6a46d41d8c87 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.357034 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7ed41aba-e487-4a71-b03f-be8a369b486e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:36.357976 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e14e79d-edfe-4428-b124-6a46d41d8c87 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.358268 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7ed41aba-e487-4a71-b03f-be8a369b486e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:36.414574 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53560179-debc-4246-a0b1-b734f432628e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.415244 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53560179-debc-4246-a0b1-b734f432628e admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.415557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53560179-debc-4246-a0b1-b734f432628e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.415833 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53560179-debc-4246-a0b1-b734f432628e admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.416576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53560179-debc-4246-a0b1-b734f432628e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:36.416878 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53560179-debc-4246-a0b1-b734f432628e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.417021 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 789/1555] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:36.418318 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9538670-2b28-4b11-ba1e-067f34aff40b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.418616 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9538670-2b28-4b11-ba1e-067f34aff40b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.418895 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9538670-2b28-4b11-ba1e-067f34aff40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.424956 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53560179-debc-4246-a0b1-b734f432628e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.436759 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d9538670-2b28-4b11-ba1e-067f34aff40b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:36.437588 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 767/1556] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:36.437969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d9538670-2b28-4b11-ba1e-067f34aff40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:36.438855 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77ee09-9ca8-4ac4-8a86-8945bc4ecb68 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.439149 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77ee09-9ca8-4ac4-8a86-8945bc4ecb68 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.439460 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f77ee09-9ca8-4ac4-8a86-8945bc4ecb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.446918 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 790/1557] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:36.447741 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9538670-2b28-4b11-ba1e-067f34aff40b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.455647 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:36.456874 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9538670-2b28-4b11-ba1e-067f34aff40b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.461418 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6f77ee09-9ca8-4ac4-8a86-8945bc4ecb68 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:36.461709 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a640d-cf10-4091-8ef8-5149b707cdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.462375 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a640d-cf10-4091-8ef8-5149b707cdcf admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.462665 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a640d-cf10-4091-8ef8-5149b707cdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.462946 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a640d-cf10-4091-8ef8-5149b707cdcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.463490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6f77ee09-9ca8-4ac4-8a86-8945bc4ecb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:36.463710 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a640d-cf10-4091-8ef8-5149b707cdcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:36.464022 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a640d-cf10-4091-8ef8-5149b707cdcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.465638 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a640d-cf10-4091-8ef8-5149b707cdcf admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.471373 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 768/1558] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:36.472710 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e0a59-ab17-41fa-9598-217ec9763be7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.472897 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e0a59-ab17-41fa-9598-217ec9763be7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.473173 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18e0a59-ab17-41fa-9598-217ec9763be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.484620 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 791/1559] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:36.484620 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a640d-cf10-4091-8ef8-5149b707cdcf admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.494119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a640d-cf10-4091-8ef8-5149b707cdcf admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.498260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c18e0a59-ab17-41fa-9598-217ec9763be7 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:36.498979 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a59d827-7c1c-449a-a76f-78158b093822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.499490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c18e0a59-ab17-41fa-9598-217ec9763be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:36.499682 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59d827-7c1c-449a-a76f-78158b093822 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.499974 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59d827-7c1c-449a-a76f-78158b093822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.500318 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a59d827-7c1c-449a-a76f-78158b093822 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.500986 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59d827-7c1c-449a-a76f-78158b093822 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.502926 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a59d827-7c1c-449a-a76f-78158b093822 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.507621 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 769/1560] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:36.508389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e0a59-ab17-41fa-9598-217ec9763be7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.518797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18e0a59-ab17-41fa-9598-217ec9763be7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.522005 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:36.523549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e9398-4836-4b36-af11-e6b3b6cf798a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.524208 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e9398-4836-4b36-af11-e6b3b6cf798a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.524536 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e9398-4836-4b36-af11-e6b3b6cf798a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.524842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e9398-4836-4b36-af11-e6b3b6cf798a admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.525578 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e9398-4836-4b36-af11-e6b3b6cf798a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.527211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e9398-4836-4b36-af11-e6b3b6cf798a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.534374 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 792/1561] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/users => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:36.534374 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c576c85-93df-44a7-a7d2-cbb3cc798ebd None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.534374 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c576c85-93df-44a7-a7d2-cbb3cc798ebd None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.534923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c576c85-93df-44a7-a7d2-cbb3cc798ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.538448 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 770/1562] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:36.539126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e9398-4836-4b36-af11-e6b3b6cf798a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.550782 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e9398-4836-4b36-af11-e6b3b6cf798a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.553580 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1c576c85-93df-44a7-a7d2-cbb3cc798ebd None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:36.555158 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1c576c85-93df-44a7-a7d2-cbb3cc798ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:36.556145 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe76b74e-cd11-4118-9550-6943b834bbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.556789 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76b74e-cd11-4118-9550-6943b834bbae admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.557078 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76b74e-cd11-4118-9550-6943b834bbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.557358 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe76b74e-cd11-4118-9550-6943b834bbae admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.558047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76b74e-cd11-4118-9550-6943b834bbae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.560004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe76b74e-cd11-4118-9550-6943b834bbae admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.563186 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 793/1563] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:36.567548 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c576c85-93df-44a7-a7d2-cbb3cc798ebd None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.577884 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c576c85-93df-44a7-a7d2-cbb3cc798ebd None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.583019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf81b01-57a6-4d55-a3fb-7d3b73408cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.583769 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf81b01-57a6-4d55-a3fb-7d3b73408cc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.584054 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf81b01-57a6-4d55-a3fb-7d3b73408cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.584404 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf81b01-57a6-4d55-a3fb-7d3b73408cc8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.585062 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf81b01-57a6-4d55-a3fb-7d3b73408cc8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:36.585433 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf81b01-57a6-4d55-a3fb-7d3b73408cc8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.587061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf81b01-57a6-4d55-a3fb-7d3b73408cc8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.591112 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 771/1564] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:36.592257 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09884a94-3890-4f1f-a8e4-547a74468847 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.592543 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09884a94-3890-4f1f-a8e4-547a74468847 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.592816 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09884a94-3890-4f1f-a8e4-547a74468847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.600082 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 794/1565] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:36.600805 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf81b01-57a6-4d55-a3fb-7d3b73408cc8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.611388 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-09884a94-3890-4f1f-a8e4-547a74468847 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:36.612584 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-09884a94-3890-4f1f-a8e4-547a74468847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:36.617123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf81b01-57a6-4d55-a3fb-7d3b73408cc8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.671500 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1739f4b-9a4c-44be-99c1-8d9cead563a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.676032 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 772/1566] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:36.676183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1739f4b-9a4c-44be-99c1-8d9cead563a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.676183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1739f4b-9a4c-44be-99c1-8d9cead563a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.676183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1739f4b-9a4c-44be-99c1-8d9cead563a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.676183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1739f4b-9a4c-44be-99c1-8d9cead563a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.676590 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11d5e6-24dc-464a-8cb1-2047c901f2a6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.676590 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11d5e6-24dc-464a-8cb1-2047c901f2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.676590 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f11d5e6-24dc-464a-8cb1-2047c901f2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.676840 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1739f4b-9a4c-44be-99c1-8d9cead563a2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.692424 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6f11d5e6-24dc-464a-8cb1-2047c901f2a6 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:36.693931 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6f11d5e6-24dc-464a-8cb1-2047c901f2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:36.707140 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 773/1567] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:36.707140 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11d5e6-24dc-464a-8cb1-2047c901f2a6 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.709799 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 795/1568] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:36.712285 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1739f4b-9a4c-44be-99c1-8d9cead563a2 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.717173 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f11d5e6-24dc-464a-8cb1-2047c901f2a6 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.772704 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5a5a1-5ec2-4d36-915b-ec225f0b4a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.773247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1739f4b-9a4c-44be-99c1-8d9cead563a2 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.773757 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5a5a1-5ec2-4d36-915b-ec225f0b4a42 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.773757 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5a5a1-5ec2-4d36-915b-ec225f0b4a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.773941 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5a5a1-5ec2-4d36-915b-ec225f0b4a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.774558 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5a5a1-5ec2-4d36-915b-ec225f0b4a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.776195 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d5a5a1-5ec2-4d36-915b-ec225f0b4a42 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.778399 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed31692-98b0-40f7-9c84-b71ff2e0a894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.779289 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed31692-98b0-40f7-9c84-b71ff2e0a894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.779597 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed31692-98b0-40f7-9c84-b71ff2e0a894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.779873 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed31692-98b0-40f7-9c84-b71ff2e0a894 admin admin] PATH_INFO: `/v3/projects/d7c0c7a3934f403ab2d52c44cdc1d8f7/users/f19bddbaa18948eebe5539e332aead44/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.786113 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 774/1569] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:36.787080 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5a5a1-5ec2-4d36-915b-ec225f0b4a42 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.794746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed31692-98b0-40f7-9c84-b71ff2e0a894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7c0c7a3934f403ab2d52c44cdc1d8f7, user_id=f19bddbaa18948eebe5539e332aead44, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.795834 dv-cinder-master-3-smb devstack@keystone.service[80519]: WARNING py.warnings [None req-aed31692-98b0-40f7-9c84-b71ff2e0a894 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:36.795834 dv-cinder-master-3-smb devstack@keystone.service[80519]: warnings.warn(msg) Jul 24 01:11:36.795834 dv-cinder-master-3-smb devstack@keystone.service[80519]: Jul 24 01:11:36.797892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed31692-98b0-40f7-9c84-b71ff2e0a894 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.798132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5a5a1-5ec2-4d36-915b-ec225f0b4a42 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.803459 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c84e17-f055-4cd4-a88e-50a047e2eec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.804580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c84e17-f055-4cd4-a88e-50a047e2eec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.804775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c84e17-f055-4cd4-a88e-50a047e2eec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.805050 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c84e17-f055-4cd4-a88e-50a047e2eec1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.805873 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c84e17-f055-4cd4-a88e-50a047e2eec1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:36.806230 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c84e17-f055-4cd4-a88e-50a047e2eec1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.807919 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c84e17-f055-4cd4-a88e-50a047e2eec1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.813379 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 796/1570] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:36 2022] PUT /identity/v3/projects/d7c0c7a3934f403ab2d52c44cdc1d8f7/users/f19bddbaa18948eebe5539e332aead44/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:36.816161 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed31692-98b0-40f7-9c84-b71ff2e0a894 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.822059 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 775/1571] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:36.822803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c84e17-f055-4cd4-a88e-50a047e2eec1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.833713 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c84e17-f055-4cd4-a88e-50a047e2eec1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.868130 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:36.869704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:36.886201 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed31692-98b0-40f7-9c84-b71ff2e0a894 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.891097 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9a12-553e-4a86-ab94-8125385f4072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.891809 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9a12-553e-4a86-ab94-8125385f4072 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.892089 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9a12-553e-4a86-ab94-8125385f4072 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.892360 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7e9a12-553e-4a86-ab94-8125385f4072 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.892744 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a249bb-c3c7-46b8-b56b-02144bf8e9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.893049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e9a12-553e-4a86-ab94-8125385f4072 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.893441 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a249bb-c3c7-46b8-b56b-02144bf8e9b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.893730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a249bb-c3c7-46b8-b56b-02144bf8e9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.894003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a249bb-c3c7-46b8-b56b-02144bf8e9b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.894684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a249bb-c3c7-46b8-b56b-02144bf8e9b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.894984 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7e9a12-553e-4a86-ab94-8125385f4072 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.896730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a249bb-c3c7-46b8-b56b-02144bf8e9b6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:36.917475 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 797/1572] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:36.918260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9a12-553e-4a86-ab94-8125385f4072 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.932385 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 776/1573] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:36 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:36.932385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a249bb-c3c7-46b8-b56b-02144bf8e9b6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:36.932729 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7e9a12-553e-4a86-ab94-8125385f4072 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:36.991015 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60a4a7-c77e-43a6-a752-f434910a38bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:36.991810 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60a4a7-c77e-43a6-a752-f434910a38bd admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:36.992100 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60a4a7-c77e-43a6-a752-f434910a38bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:36.992378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d60a4a7-c77e-43a6-a752-f434910a38bd admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:36.993130 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60a4a7-c77e-43a6-a752-f434910a38bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:36.993440 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60a4a7-c77e-43a6-a752-f434910a38bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:36.995124 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d60a4a7-c77e-43a6-a752-f434910a38bd admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.008460 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 798/1574] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:37.009325 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60a4a7-c77e-43a6-a752-f434910a38bd admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.020074 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d60a4a7-c77e-43a6-a752-f434910a38bd admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.025149 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581baf96-d84e-4ae9-9bc4-6b3a5f765d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.025764 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581baf96-d84e-4ae9-9bc4-6b3a5f765d63 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.026049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581baf96-d84e-4ae9-9bc4-6b3a5f765d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.026326 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581baf96-d84e-4ae9-9bc4-6b3a5f765d63 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.027065 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581baf96-d84e-4ae9-9bc4-6b3a5f765d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.029090 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581baf96-d84e-4ae9-9bc4-6b3a5f765d63 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.052870 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 799/1575] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:37 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:37.053739 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581baf96-d84e-4ae9-9bc4-6b3a5f765d63 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.064709 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581baf96-d84e-4ae9-9bc4-6b3a5f765d63 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.069581 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a89e5-65c7-4932-a1ed-b1038b1c321d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.070267 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a89e5-65c7-4932-a1ed-b1038b1c321d admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.070555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a89e5-65c7-4932-a1ed-b1038b1c321d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.070873 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a89e5-65c7-4932-a1ed-b1038b1c321d admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.071652 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a89e5-65c7-4932-a1ed-b1038b1c321d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.073286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a89e5-65c7-4932-a1ed-b1038b1c321d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.084366 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 800/1576] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:37.085643 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f223a3-54ca-4fb6-abcb-7f97dd346156 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.085938 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f223a3-54ca-4fb6-abcb-7f97dd346156 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.086220 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f223a3-54ca-4fb6-abcb-7f97dd346156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.112779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b5f223a3-54ca-4fb6-abcb-7f97dd346156 None None] MFA Rules not processed for user `f19bddbaa18948eebe5539e332aead44`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:37.114090 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b5f223a3-54ca-4fb6-abcb-7f97dd346156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:37.122132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a249bb-c3c7-46b8-b56b-02144bf8e9b6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.126821 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abba43-dd8a-4308-919d-b6b0f942c896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.127585 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abba43-dd8a-4308-919d-b6b0f942c896 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.127943 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abba43-dd8a-4308-919d-b6b0f942c896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.128287 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3abba43-dd8a-4308-919d-b6b0f942c896 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.129092 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abba43-dd8a-4308-919d-b6b0f942c896 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:37.129469 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abba43-dd8a-4308-919d-b6b0f942c896 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.131171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3abba43-dd8a-4308-919d-b6b0f942c896 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.142688 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 777/1577] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:37.143724 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abba43-dd8a-4308-919d-b6b0f942c896 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.153482 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3abba43-dd8a-4308-919d-b6b0f942c896 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.158385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d901ab0-2b72-4cba-9103-9d7a130492b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.158659 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d901ab0-2b72-4cba-9103-9d7a130492b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.158944 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d901ab0-2b72-4cba-9103-9d7a130492b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.159220 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d901ab0-2b72-4cba-9103-9d7a130492b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.159943 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d901ab0-2b72-4cba-9103-9d7a130492b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.161902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d901ab0-2b72-4cba-9103-9d7a130492b3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.184825 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 801/1578] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:37.185965 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f223a3-54ca-4fb6-abcb-7f97dd346156 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.189191 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 778/1579] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:37 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:37.192268 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d901ab0-2b72-4cba-9103-9d7a130492b3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.197020 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f223a3-54ca-4fb6-abcb-7f97dd346156 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.226287 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:37.255651 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d901ab0-2b72-4cba-9103-9d7a130492b3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.256684 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db4141-1828-45eb-bf0f-819a4fb083f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.257342 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db4141-1828-45eb-bf0f-819a4fb083f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.257625 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db4141-1828-45eb-bf0f-819a4fb083f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.257896 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66db4141-1828-45eb-bf0f-819a4fb083f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.258628 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db4141-1828-45eb-bf0f-819a4fb083f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.260296 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66db4141-1828-45eb-bf0f-819a4fb083f8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.260778 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41522c0-81e4-4b0b-8b92-02d5eba81d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.261619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41522c0-81e4-4b0b-8b92-02d5eba81d30 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.261910 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41522c0-81e4-4b0b-8b92-02d5eba81d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.262186 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41522c0-81e4-4b0b-8b92-02d5eba81d30 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.262878 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41522c0-81e4-4b0b-8b92-02d5eba81d30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.263944 dv-cinder-master-3-smb devstack@keystone.service[80520]: WARNING py.warnings [None req-c41522c0-81e4-4b0b-8b92-02d5eba81d30 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:37.263944 dv-cinder-master-3-smb devstack@keystone.service[80520]: warnings.warn(msg) Jul 24 01:11:37.263944 dv-cinder-master-3-smb devstack@keystone.service[80520]: Jul 24 01:11:37.265317 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41522c0-81e4-4b0b-8b92-02d5eba81d30 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.270096 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 802/1580] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:37.270888 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db4141-1828-45eb-bf0f-819a4fb083f8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.280542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66db4141-1828-45eb-bf0f-819a4fb083f8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.285318 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592f69d-7321-45b1-b6a1-8895d809c81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.285956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592f69d-7321-45b1-b6a1-8895d809c81e admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.286238 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592f69d-7321-45b1-b6a1-8895d809c81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.286579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e592f69d-7321-45b1-b6a1-8895d809c81e admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.287237 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592f69d-7321-45b1-b6a1-8895d809c81e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.291803 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 779/1581] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:37 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:37.291946 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e592f69d-7321-45b1-b6a1-8895d809c81e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.292063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41522c0-81e4-4b0b-8b92-02d5eba81d30 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.300995 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41522c0-81e4-4b0b-8b92-02d5eba81d30 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.306216 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b4588-a841-4f1d-ab56-93c7de1cc6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.307094 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b4588-a841-4f1d-ab56-93c7de1cc6ef admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.307399 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b4588-a841-4f1d-ab56-93c7de1cc6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.307703 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b4588-a841-4f1d-ab56-93c7de1cc6ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.308538 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b4588-a841-4f1d-ab56-93c7de1cc6ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.310154 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b4588-a841-4f1d-ab56-93c7de1cc6ef admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.317156 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 803/1582] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:37 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:37.320454 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592f69d-7321-45b1-b6a1-8895d809c81e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.321430 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 780/1583] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:37.322226 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b4588-a841-4f1d-ab56-93c7de1cc6ef admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.331591 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b4588-a841-4f1d-ab56-93c7de1cc6ef admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.340533 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:37.382678 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e592f69d-7321-45b1-b6a1-8895d809c81e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.387187 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92c21e-0ec8-4eff-9a6e-a6fc6f80e3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.388164 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92c21e-0ec8-4eff-9a6e-a6fc6f80e3c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.388443 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92c21e-0ec8-4eff-9a6e-a6fc6f80e3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.388608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a261b-a81b-442d-9051-21f2a8a7cd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.388736 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92c21e-0ec8-4eff-9a6e-a6fc6f80e3c0 admin admin] PATH_INFO: `/v3/projects/e076ee7a9aba4327977e47cd15f4d598/users/2d7d2c987db04aaabc0d75c1930f9c6f/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.389452 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a261b-a81b-442d-9051-21f2a8a7cd79 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.389882 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a261b-a81b-442d-9051-21f2a8a7cd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.390300 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8a261b-a81b-442d-9051-21f2a8a7cd79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.391284 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a261b-a81b-442d-9051-21f2a8a7cd79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.393264 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8a261b-a81b-442d-9051-21f2a8a7cd79 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.403194 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92c21e-0ec8-4eff-9a6e-a6fc6f80e3c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e076ee7a9aba4327977e47cd15f4d598, user_id=2d7d2c987db04aaabc0d75c1930f9c6f, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.405924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92c21e-0ec8-4eff-9a6e-a6fc6f80e3c0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.420718 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 804/1584] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:37 2022] PUT /identity/v3/projects/e076ee7a9aba4327977e47cd15f4d598/users/2d7d2c987db04aaabc0d75c1930f9c6f/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:37.424664 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 781/1585] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:37 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:37.424827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92c21e-0ec8-4eff-9a6e-a6fc6f80e3c0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.424928 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a261b-a81b-442d-9051-21f2a8a7cd79 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.481902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8a261b-a81b-442d-9051-21f2a8a7cd79 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.486023 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92c21e-0ec8-4eff-9a6e-a6fc6f80e3c0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.486648 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8550a7a-a90b-48e8-9482-99b393b106bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.487371 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8550a7a-a90b-48e8-9482-99b393b106bd admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.487661 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8550a7a-a90b-48e8-9482-99b393b106bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.487967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8550a7a-a90b-48e8-9482-99b393b106bd admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.488696 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8550a7a-a90b-48e8-9482-99b393b106bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.490752 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8550a7a-a90b-48e8-9482-99b393b106bd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.491339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57c9f9-3110-444f-a0ac-a85a07c424cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.492005 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57c9f9-3110-444f-a0ac-a85a07c424cf admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.492295 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57c9f9-3110-444f-a0ac-a85a07c424cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.492576 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57c9f9-3110-444f-a0ac-a85a07c424cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.493272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57c9f9-3110-444f-a0ac-a85a07c424cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.495201 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a57c9f9-3110-444f-a0ac-a85a07c424cf admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.511258 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 782/1586] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:37 2022] POST /identity/v3/users => generated 302 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:37.512173 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8550a7a-a90b-48e8-9482-99b393b106bd admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.522419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8550a7a-a90b-48e8-9482-99b393b106bd admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.525842 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 805/1587] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:37 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:37.526659 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57c9f9-3110-444f-a0ac-a85a07c424cf admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.529677 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f87334-e7c0-467f-b7cb-88cdec26beac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.530341 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f87334-e7c0-467f-b7cb-88cdec26beac admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.530684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f87334-e7c0-467f-b7cb-88cdec26beac admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.530904 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f87334-e7c0-467f-b7cb-88cdec26beac admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.531667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f87334-e7c0-467f-b7cb-88cdec26beac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.533280 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f87334-e7c0-467f-b7cb-88cdec26beac admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.542193 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:37.544304 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 783/1588] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:37.545163 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f87334-e7c0-467f-b7cb-88cdec26beac admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.555350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f87334-e7c0-467f-b7cb-88cdec26beac admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.596766 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57c9f9-3110-444f-a0ac-a85a07c424cf admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.602654 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa0271-c084-488c-ad7a-b84652cfed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.603376 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa0271-c084-488c-ad7a-b84652cfed6f admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.603667 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa0271-c084-488c-ad7a-b84652cfed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.603945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aa0271-c084-488c-ad7a-b84652cfed6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.604685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa0271-c084-488c-ad7a-b84652cfed6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.606345 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38aa0271-c084-488c-ad7a-b84652cfed6f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.610728 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74713502-dfb5-4a07-960a-60036ceeb65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.611442 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74713502-dfb5-4a07-960a-60036ceeb65c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.612050 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74713502-dfb5-4a07-960a-60036ceeb65c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.612050 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74713502-dfb5-4a07-960a-60036ceeb65c admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.612889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74713502-dfb5-4a07-960a-60036ceeb65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.614811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74713502-dfb5-4a07-960a-60036ceeb65c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.617229 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 806/1589] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:37.620285 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa0271-c084-488c-ad7a-b84652cfed6f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.631770 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aa0271-c084-488c-ad7a-b84652cfed6f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.635695 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 784/1590] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:37 2022] POST /identity/v3/users => generated 296 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:37.636693 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74713502-dfb5-4a07-960a-60036ceeb65c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.640033 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671154ab-e190-4586-9939-014516a8db76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.640701 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671154ab-e190-4586-9939-014516a8db76 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.640981 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671154ab-e190-4586-9939-014516a8db76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.641251 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671154ab-e190-4586-9939-014516a8db76 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.641970 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671154ab-e190-4586-9939-014516a8db76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.643610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671154ab-e190-4586-9939-014516a8db76 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.646265 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74713502-dfb5-4a07-960a-60036ceeb65c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.651055 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595306a6-db1c-4b75-b065-b671e12430d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.651745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595306a6-db1c-4b75-b065-b671e12430d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.652146 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595306a6-db1c-4b75-b065-b671e12430d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.652431 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595306a6-db1c-4b75-b065-b671e12430d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.653110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595306a6-db1c-4b75-b065-b671e12430d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.657252 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 807/1591] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:37.657390 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595306a6-db1c-4b75-b065-b671e12430d4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.657502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3070b8e-7d2f-42c3-ab62-897844ea4249 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.657502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3070b8e-7d2f-42c3-ab62-897844ea4249 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.657502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3070b8e-7d2f-42c3-ab62-897844ea4249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.661743 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:37.674616 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d3070b8e-7d2f-42c3-ab62-897844ea4249 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:37.675890 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d3070b8e-7d2f-42c3-ab62-897844ea4249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:37.677912 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 785/1592] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:37 2022] POST /identity/v3/users => generated 292 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:37.682056 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595306a6-db1c-4b75-b065-b671e12430d4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.685270 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 808/1593] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:37.686053 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3070b8e-7d2f-42c3-ab62-897844ea4249 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.697088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3070b8e-7d2f-42c3-ab62-897844ea4249 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.697305 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595306a6-db1c-4b75-b065-b671e12430d4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.701738 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84335f-00ba-4b92-9ab4-631d1e353e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.702431 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84335f-00ba-4b92-9ab4-631d1e353e9d admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.702731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84335f-00ba-4b92-9ab4-631d1e353e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.703011 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84335f-00ba-4b92-9ab4-631d1e353e9d admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.703215 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fc111-3954-4d7e-a893-157dc8e57a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.703752 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84335f-00ba-4b92-9ab4-631d1e353e9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.704304 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc111-3954-4d7e-a893-157dc8e57a77 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.704729 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc111-3954-4d7e-a893-157dc8e57a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.705140 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9fc111-3954-4d7e-a893-157dc8e57a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.705727 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84335f-00ba-4b92-9ab4-631d1e353e9d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.706272 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fc111-3954-4d7e-a893-157dc8e57a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.708914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9fc111-3954-4d7e-a893-157dc8e57a77 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.724955 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 786/1594] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:37.726149 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 809/1595] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:37 2022] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:37.726293 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fc111-3954-4d7e-a893-157dc8e57a77 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.727568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84335f-00ba-4b92-9ab4-631d1e353e9d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.738945 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9fc111-3954-4d7e-a893-157dc8e57a77 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.741063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84335f-00ba-4b92-9ab4-631d1e353e9d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.744092 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5f88e-e1b7-4737-ac62-8c92229f6144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.744988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5f88e-e1b7-4737-ac62-8c92229f6144 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.745275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5f88e-e1b7-4737-ac62-8c92229f6144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.745553 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5f88e-e1b7-4737-ac62-8c92229f6144 admin admin] PATH_INFO: `/v3/projects/cc1d39abfaef4e9c80564f545f431bbe/users/601f4db65bf74587ab9b0080a44b4f79/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.747285 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853ddd2-1b0c-4cb9-91c5-eb95e8bc3116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.747973 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853ddd2-1b0c-4cb9-91c5-eb95e8bc3116 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.748252 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853ddd2-1b0c-4cb9-91c5-eb95e8bc3116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.748531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853ddd2-1b0c-4cb9-91c5-eb95e8bc3116 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.749281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853ddd2-1b0c-4cb9-91c5-eb95e8bc3116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.750891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853ddd2-1b0c-4cb9-91c5-eb95e8bc3116 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.760903 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 810/1596] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:37.761228 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5f88e-e1b7-4737-ac62-8c92229f6144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1d39abfaef4e9c80564f545f431bbe, user_id=601f4db65bf74587ab9b0080a44b4f79, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.761936 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853ddd2-1b0c-4cb9-91c5-eb95e8bc3116 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.764296 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5f88e-e1b7-4737-ac62-8c92229f6144 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.771402 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853ddd2-1b0c-4cb9-91c5-eb95e8bc3116 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.776090 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ed5be-720f-47c9-a0ed-fe369278768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.776732 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ed5be-720f-47c9-a0ed-fe369278768c admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.777012 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ed5be-720f-47c9-a0ed-fe369278768c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.777284 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ed5be-720f-47c9-a0ed-fe369278768c admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.777999 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ed5be-720f-47c9-a0ed-fe369278768c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.779764 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 787/1597] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:37 2022] PUT /identity/v3/projects/cc1d39abfaef4e9c80564f545f431bbe/users/601f4db65bf74587ab9b0080a44b4f79/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:37.780168 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3ed5be-720f-47c9-a0ed-fe369278768c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.780325 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5f88e-e1b7-4737-ac62-8c92229f6144 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.790353 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 811/1598] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:37.793575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ed5be-720f-47c9-a0ed-fe369278768c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.804888 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ed5be-720f-47c9-a0ed-fe369278768c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.843669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5f88e-e1b7-4737-ac62-8c92229f6144 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.848258 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c472a8-3685-419e-938b-1bee6fbecc2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.849215 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c472a8-3685-419e-938b-1bee6fbecc2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.849508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c472a8-3685-419e-938b-1bee6fbecc2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.849787 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c472a8-3685-419e-938b-1bee6fbecc2d admin admin] PATH_INFO: `/v3/projects/b6578102e5a746a584bcc9e4b2f64d46/users/1e7d0f401530454ba0cae0f5e9d6e0ce/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.865077 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d7655-4c0d-41fd-a96c-1d1bac3075dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.865374 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c472a8-3685-419e-938b-1bee6fbecc2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6578102e5a746a584bcc9e4b2f64d46, user_id=1e7d0f401530454ba0cae0f5e9d6e0ce, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.865755 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d7655-4c0d-41fd-a96c-1d1bac3075dd admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.866035 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d7655-4c0d-41fd-a96c-1d1bac3075dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.866311 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d7655-4c0d-41fd-a96c-1d1bac3075dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.867036 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d7655-4c0d-41fd-a96c-1d1bac3075dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.868074 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c472a8-3685-419e-938b-1bee6fbecc2d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.868678 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d7655-4c0d-41fd-a96c-1d1bac3075dd admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.879587 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 812/1599] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:37.880433 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d7655-4c0d-41fd-a96c-1d1bac3075dd admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.884544 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 788/1600] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:37 2022] PUT /identity/v3/projects/b6578102e5a746a584bcc9e4b2f64d46/users/1e7d0f401530454ba0cae0f5e9d6e0ce/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:37.885509 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c472a8-3685-419e-938b-1bee6fbecc2d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.932470 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:37.936904 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d7655-4c0d-41fd-a96c-1d1bac3075dd admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.946792 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c472a8-3685-419e-938b-1bee6fbecc2d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.951397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7599b9d-ec07-48f1-9894-2d11dd93670c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.952057 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7599b9d-ec07-48f1-9894-2d11dd93670c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.952336 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7599b9d-ec07-48f1-9894-2d11dd93670c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.952604 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7599b9d-ec07-48f1-9894-2d11dd93670c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.953336 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7599b9d-ec07-48f1-9894-2d11dd93670c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.954965 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7599b9d-ec07-48f1-9894-2d11dd93670c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.964961 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 789/1601] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:37.965810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7599b9d-ec07-48f1-9894-2d11dd93670c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:37.975082 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7599b9d-ec07-48f1-9894-2d11dd93670c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:37.979750 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5536c-fe76-4cb6-aea9-5770dd7eea2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.980405 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5536c-fe76-4cb6-aea9-5770dd7eea2a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.980669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5536c-fe76-4cb6-aea9-5770dd7eea2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.980942 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5536c-fe76-4cb6-aea9-5770dd7eea2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.981654 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5536c-fe76-4cb6-aea9-5770dd7eea2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:37.983316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5536c-fe76-4cb6-aea9-5770dd7eea2a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:37.988456 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b349f5-b1bf-40f3-9bfb-65fc29a1fd76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:37.989125 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b349f5-b1bf-40f3-9bfb-65fc29a1fd76 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:37.989414 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b349f5-b1bf-40f3-9bfb-65fc29a1fd76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:37.989734 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b349f5-b1bf-40f3-9bfb-65fc29a1fd76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:37.995273 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 790/1602] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:37.996151 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5536c-fe76-4cb6-aea9-5770dd7eea2a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:38.000770 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b349f5-b1bf-40f3-9bfb-65fc29a1fd76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:38.002289 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b349f5-b1bf-40f3-9bfb-65fc29a1fd76 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:38.005755 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5536c-fe76-4cb6-aea9-5770dd7eea2a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:38.010424 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb1d20-9a46-43b4-aca1-afb733e58715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:38.011315 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb1d20-9a46-43b4-aca1-afb733e58715 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.011607 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb1d20-9a46-43b4-aca1-afb733e58715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.011885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb1d20-9a46-43b4-aca1-afb733e58715 admin admin] PATH_INFO: `/v3/projects/8d009cdd7cc94c608822a47c67390104/users/b92f449e31434a1a84bc9453757186a1/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.012801 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 813/1603] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:38.013863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d066c8-3196-478e-98c7-736aafe24438 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.014190 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d066c8-3196-478e-98c7-736aafe24438 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.014421 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d066c8-3196-478e-98c7-736aafe24438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.027713 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb1d20-9a46-43b4-aca1-afb733e58715 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d009cdd7cc94c608822a47c67390104, user_id=b92f449e31434a1a84bc9453757186a1, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:38.030394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb1d20-9a46-43b4-aca1-afb733e58715 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:38.037821 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-41d066c8-3196-478e-98c7-736aafe24438 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:38.039056 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-41d066c8-3196-478e-98c7-736aafe24438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:38.043665 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:38.047371 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 814/1604] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:38.050539 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 791/1605] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:37 2022] PUT /identity/v3/projects/8d009cdd7cc94c608822a47c67390104/users/b92f449e31434a1a84bc9453757186a1/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:38.051495 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb1d20-9a46-43b4-aca1-afb733e58715 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:38.055210 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d066c8-3196-478e-98c7-736aafe24438 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:38.070821 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d066c8-3196-478e-98c7-736aafe24438 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:38.135179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb1d20-9a46-43b4-aca1-afb733e58715 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:38.139858 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263c85d-b9d5-4a42-a410-a9533d88e685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:38.140040 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ca79ab-c8d3-413f-8976-1bd99c3b6bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:38.140755 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263c85d-b9d5-4a42-a410-a9533d88e685 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.140889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca79ab-c8d3-413f-8976-1bd99c3b6bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.141108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca79ab-c8d3-413f-8976-1bd99c3b6bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.141267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263c85d-b9d5-4a42-a410-a9533d88e685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.141435 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ca79ab-c8d3-413f-8976-1bd99c3b6bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.141881 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7263c85d-b9d5-4a42-a410-a9533d88e685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.142176 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca79ab-c8d3-413f-8976-1bd99c3b6bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:38.142605 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263c85d-b9d5-4a42-a410-a9533d88e685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:38.143911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ca79ab-c8d3-413f-8976-1bd99c3b6bc7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:38.144508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7263c85d-b9d5-4a42-a410-a9533d88e685 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:38.157811 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 815/1606] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:38.157811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945de39-8d4f-4559-87a0-295b723a15b2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.157811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945de39-8d4f-4559-87a0-295b723a15b2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.157811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3945de39-8d4f-4559-87a0-295b723a15b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.158876 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 792/1607] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:38.159866 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263c85d-b9d5-4a42-a410-a9533d88e685 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:38.172121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7263c85d-b9d5-4a42-a410-a9533d88e685 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:38.176251 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3945de39-8d4f-4559-87a0-295b723a15b2 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:38.177622 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3945de39-8d4f-4559-87a0-295b723a15b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:38.177771 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3016e6-799a-4c03-8593-3a6ead32e6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:38.178757 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3016e6-799a-4c03-8593-3a6ead32e6e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.179562 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3016e6-799a-4c03-8593-3a6ead32e6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.179903 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3016e6-799a-4c03-8593-3a6ead32e6e3 admin admin] PATH_INFO: `/v3/projects/f22a02f653c74cc6b84ffef78c2e6a68/users/e374a9861f4b418b943c91b0ecd3ba5a/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.187244 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 816/1608] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:38.188089 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945de39-8d4f-4559-87a0-295b723a15b2 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:38.200754 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3945de39-8d4f-4559-87a0-295b723a15b2 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:38.206282 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3016e6-799a-4c03-8593-3a6ead32e6e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22a02f653c74cc6b84ffef78c2e6a68, user_id=e374a9861f4b418b943c91b0ecd3ba5a, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:38.207863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde5444-a0dc-4a51-9586-dd2cf22bd505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:38.208969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde5444-a0dc-4a51-9586-dd2cf22bd505 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.209608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3016e6-799a-4c03-8593-3a6ead32e6e3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:38.209843 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde5444-a0dc-4a51-9586-dd2cf22bd505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.210193 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde5444-a0dc-4a51-9586-dd2cf22bd505 admin admin] PATH_INFO: `/v3/projects/90092038d12744c2bfff3ca0add45daf/users/4f2d887502a04a308b476ca2ad303a4d/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.229367 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 793/1609] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:38 2022] PUT /identity/v3/projects/f22a02f653c74cc6b84ffef78c2e6a68/users/e374a9861f4b418b943c91b0ecd3ba5a/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:38.230954 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c29a5-1333-4605-9c1c-1b68251d8d1f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.231327 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c29a5-1333-4605-9c1c-1b68251d8d1f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.231668 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6c29a5-1333-4605-9c1c-1b68251d8d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.233502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde5444-a0dc-4a51-9586-dd2cf22bd505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90092038d12744c2bfff3ca0add45daf, user_id=4f2d887502a04a308b476ca2ad303a4d, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:38.236626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dde5444-a0dc-4a51-9586-dd2cf22bd505 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:38.254004 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 817/1610] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:38 2022] PUT /identity/v3/projects/90092038d12744c2bfff3ca0add45daf/users/4f2d887502a04a308b476ca2ad303a4d/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:38.254917 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde5444-a0dc-4a51-9586-dd2cf22bd505 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:38.256948 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5dde5444-a0dc-4a51-9586-dd2cf22bd505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:38.267279 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7f6c29a5-1333-4605-9c1c-1b68251d8d1f None None] MFA Rules not processed for user `b92f449e31434a1a84bc9453757186a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:38.268967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7f6c29a5-1333-4605-9c1c-1b68251d8d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:38.331433 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde5444-a0dc-4a51-9586-dd2cf22bd505 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:38.335577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9a898-7952-41ac-b4df-5410072af1cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:38.336450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a898-7952-41ac-b4df-5410072af1cd service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.336894 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a898-7952-41ac-b4df-5410072af1cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.337354 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a898-7952-41ac-b4df-5410072af1cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.343430 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 794/1611] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:38.345726 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c29a5-1333-4605-9c1c-1b68251d8d1f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:38.368569 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:38.439206 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9a898-7952-41ac-b4df-5410072af1cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:38.442342 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6c29a5-1333-4605-9c1c-1b68251d8d1f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:38.442776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9a898-7952-41ac-b4df-5410072af1cd service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:38.447209 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a57e6-8b54-4400-95cb-face4afe4221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:38.448446 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a57e6-8b54-4400-95cb-face4afe4221 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.448862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a57e6-8b54-4400-95cb-face4afe4221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.449297 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a57e6-8b54-4400-95cb-face4afe4221 admin admin] PATH_INFO: `/v3/projects/55d33269082642989cbc18c052f07b94/users/1b8154ce6b6b40b4959bf354ccb5c59d/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.455974 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:38.457384 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 818/1612] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:38.458591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9a898-7952-41ac-b4df-5410072af1cd service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:38.468727 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9a898-7952-41ac-b4df-5410072af1cd service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:38.472459 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a57e6-8b54-4400-95cb-face4afe4221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d33269082642989cbc18c052f07b94, user_id=1b8154ce6b6b40b4959bf354ccb5c59d, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:38.474349 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4e81c-f399-4214-a022-70b7df09d159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:38.475201 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a57e6-8b54-4400-95cb-face4afe4221 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:38.475335 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4e81c-f399-4214-a022-70b7df09d159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.475589 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4e81c-f399-4214-a022-70b7df09d159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.475864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4e81c-f399-4214-a022-70b7df09d159 admin admin] PATH_INFO: `/v3/projects/39d60a6aa0c045f9b27fb65b647772c6/users/930defb348d1476c8021deb4ebfa590a/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.491691 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 795/1613] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:38 2022] PUT /identity/v3/projects/55d33269082642989cbc18c052f07b94/users/1b8154ce6b6b40b4959bf354ccb5c59d/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:38.492408 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4e81c-f399-4214-a022-70b7df09d159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d60a6aa0c045f9b27fb65b647772c6, user_id=930defb348d1476c8021deb4ebfa590a, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:38.493445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a57e6-8b54-4400-95cb-face4afe4221 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:38.495305 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4e81c-f399-4214-a022-70b7df09d159 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:38.513015 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 819/1614] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:38 2022] PUT /identity/v3/projects/39d60a6aa0c045f9b27fb65b647772c6/users/930defb348d1476c8021deb4ebfa590a/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:38.517515 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4e81c-f399-4214-a022-70b7df09d159 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:38.559710 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a57e6-8b54-4400-95cb-face4afe4221 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:38.595434 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4e81c-f399-4214-a022-70b7df09d159 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:38.601838 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850f539-992e-4eed-92b8-60651f97c76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:38.602547 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850f539-992e-4eed-92b8-60651f97c76b admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.602865 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850f539-992e-4eed-92b8-60651f97c76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.603155 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850f539-992e-4eed-92b8-60651f97c76b admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.603996 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850f539-992e-4eed-92b8-60651f97c76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:38.605783 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850f539-992e-4eed-92b8-60651f97c76b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:38.619457 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 820/1615] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:38.620820 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48021f06-5920-4cbd-a952-57cd39639ab7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.621106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48021f06-5920-4cbd-a952-57cd39639ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.621380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48021f06-5920-4cbd-a952-57cd39639ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.625886 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7c07f-0e8a-476b-8817-7d9c932f3eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:38.626842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7c07f-0e8a-476b-8817-7d9c932f3eef service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.627439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7c07f-0e8a-476b-8817-7d9c932f3eef service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.628011 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7c07f-0e8a-476b-8817-7d9c932f3eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.640123 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7c07f-0e8a-476b-8817-7d9c932f3eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:38.641946 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7c07f-0e8a-476b-8817-7d9c932f3eef service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:38.653346 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-48021f06-5920-4cbd-a952-57cd39639ab7 None None] MFA Rules not processed for user `4f2d887502a04a308b476ca2ad303a4d`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:38.653875 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 796/1616] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:38.654435 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-48021f06-5920-4cbd-a952-57cd39639ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:38.655169 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7c07f-0e8a-476b-8817-7d9c932f3eef service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:38.716758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7c07f-0e8a-476b-8817-7d9c932f3eef service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:38.720730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08714ecc-0e3a-4b3c-ae75-bf137dc710cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:38.721635 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08714ecc-0e3a-4b3c-ae75-bf137dc710cd service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.722152 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08714ecc-0e3a-4b3c-ae75-bf137dc710cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.722584 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08714ecc-0e3a-4b3c-ae75-bf137dc710cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.728258 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 821/1617] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:38.729560 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499d682-a9b3-4432-8ecf-61e7cc0c3d51 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.729847 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499d682-a9b3-4432-8ecf-61e7cc0c3d51 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.730123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e499d682-a9b3-4432-8ecf-61e7cc0c3d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.758789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e499d682-a9b3-4432-8ecf-61e7cc0c3d51 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:38.760160 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e499d682-a9b3-4432-8ecf-61e7cc0c3d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:38.772591 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 822/1618] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:38.772591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1391ae-763d-4d51-ab71-47dac7ca228b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.772591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1391ae-763d-4d51-ab71-47dac7ca228b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.772591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1391ae-763d-4d51-ab71-47dac7ca228b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.796635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:38.804520 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:38.807386 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ea1391ae-763d-4d51-ab71-47dac7ca228b None None] MFA Rules not processed for user `930defb348d1476c8021deb4ebfa590a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:38.807528 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08714ecc-0e3a-4b3c-ae75-bf137dc710cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:38.809044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ea1391ae-763d-4d51-ab71-47dac7ca228b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:38.809321 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08714ecc-0e3a-4b3c-ae75-bf137dc710cd service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:38.822913 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 797/1619] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:38.823935 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08714ecc-0e3a-4b3c-ae75-bf137dc710cd service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:38.834540 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08714ecc-0e3a-4b3c-ae75-bf137dc710cd service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:38.840335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a30d-ed0a-478f-9514-56367bb254db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:38.841449 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a30d-ed0a-478f-9514-56367bb254db admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.841820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a30d-ed0a-478f-9514-56367bb254db admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.842102 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e42a30d-ed0a-478f-9514-56367bb254db admin admin] PATH_INFO: `/v3/projects/f22a02f653c74cc6b84ffef78c2e6a68/users/e374a9861f4b418b943c91b0ecd3ba5a/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.844974 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42a30d-ed0a-478f-9514-56367bb254db admin admin] RBAC: Authorizing `identity:create_grant(project_id=f22a02f653c74cc6b84ffef78c2e6a68, user_id=e374a9861f4b418b943c91b0ecd3ba5a, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:38.847857 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e42a30d-ed0a-478f-9514-56367bb254db admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:38.859994 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 798/1620] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:38 2022] PUT /identity/v3/projects/f22a02f653c74cc6b84ffef78c2e6a68/users/e374a9861f4b418b943c91b0ecd3ba5a/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:38.861595 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a30d-ed0a-478f-9514-56367bb254db admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:38.908404 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 823/1621] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:38.909561 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1391ae-763d-4d51-ab71-47dac7ca228b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:38.921974 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1391ae-763d-4d51-ab71-47dac7ca228b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:38.981800 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e42a30d-ed0a-478f-9514-56367bb254db admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:38.990799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2237c1bc-e832-488f-b9ea-30c6af50c688 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:38.991514 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237c1bc-e832-488f-b9ea-30c6af50c688 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.991795 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237c1bc-e832-488f-b9ea-30c6af50c688 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.992131 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2237c1bc-e832-488f-b9ea-30c6af50c688 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.993851 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db1040e-2a01-4cc0-8525-3764106b6a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:38.994516 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1040e-2a01-4cc0-8525-3764106b6a81 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:38.995020 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1040e-2a01-4cc0-8525-3764106b6a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:38.995488 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db1040e-2a01-4cc0-8525-3764106b6a81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:38.996294 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1040e-2a01-4cc0-8525-3764106b6a81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:39.001038 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db1040e-2a01-4cc0-8525-3764106b6a81 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:39.005897 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237c1bc-e832-488f-b9ea-30c6af50c688 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:39.006591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2237c1bc-e832-488f-b9ea-30c6af50c688 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:39.018562 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 824/1622] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:39.033471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dbad9-1db2-46d0-9560-ed3ed95c81b4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:39.035021 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dbad9-1db2-46d0-9560-ed3ed95c81b4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:39.035340 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dbad9-1db2-46d0-9560-ed3ed95c81b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:39.046966 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 799/1623] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:38 2022] POST /identity/v3/projects => generated 405 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:39.048862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf87d-d29a-45ff-a86b-91af7d5b1cef None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:39.049370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf87d-d29a-45ff-a86b-91af7d5b1cef None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:39.049752 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13bf87d-d29a-45ff-a86b-91af7d5b1cef None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:39.052435 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 800/1624] 10.222.0.42 () {54 vars in 962 bytes} [Sun Jul 24 01:11:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:11:39.055449 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf87d-d29a-45ff-a86b-91af7d5b1cef None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:39.106031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-087dbad9-1db2-46d0-9560-ed3ed95c81b4 None None] MFA Rules not processed for user `e374a9861f4b418b943c91b0ecd3ba5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:39.109697 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-087dbad9-1db2-46d0-9560-ed3ed95c81b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:39.261395 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 825/1625] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:39.263038 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82475d-075f-4aee-83b6-8436d1336f86 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:39.263485 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82475d-075f-4aee-83b6-8436d1336f86 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:39.263861 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b82475d-075f-4aee-83b6-8436d1336f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:39.303563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13bf87d-d29a-45ff-a86b-91af7d5b1cef None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:39.318108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935365d5-39bf-430b-83fa-be4bd7502ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:39.319499 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935365d5-39bf-430b-83fa-be4bd7502ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:39.319789 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935365d5-39bf-430b-83fa-be4bd7502ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:39.320119 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935365d5-39bf-430b-83fa-be4bd7502ac4 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:39.320984 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935365d5-39bf-430b-83fa-be4bd7502ac4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:39.321637 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-8b82475d-075f-4aee-83b6-8436d1336f86 None None] MFA Rules not processed for user `6c32c443ee1a421e98e7656e8e86e27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:39.322939 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935365d5-39bf-430b-83fa-be4bd7502ac4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:39.323389 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8b82475d-075f-4aee-83b6-8436d1336f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:39.336366 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:39.375894 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 801/1626] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:39 2022] POST /identity/v3/users => generated 309 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:39.375894 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935365d5-39bf-430b-83fa-be4bd7502ac4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:39.463503 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 826/1627] 10.222.0.42 () {58 vars in 1059 bytes} [Sun Jul 24 01:11:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:39.465437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82475d-075f-4aee-83b6-8436d1336f86 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:39.489527 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b82475d-075f-4aee-83b6-8436d1336f86 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:39.499737 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba00bdb-0d6c-4e07-98d2-4836c13dca70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:39.500589 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba00bdb-0d6c-4e07-98d2-4836c13dca70 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:39.501159 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba00bdb-0d6c-4e07-98d2-4836c13dca70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:39.501543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba00bdb-0d6c-4e07-98d2-4836c13dca70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:39.502673 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba00bdb-0d6c-4e07-98d2-4836c13dca70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:39.504489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba00bdb-0d6c-4e07-98d2-4836c13dca70 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:39.513786 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935365d5-39bf-430b-83fa-be4bd7502ac4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:39.518292 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ac6d0-8efc-4e30-a36b-0eb1df2b6153 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:39.519005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac6d0-8efc-4e30-a36b-0eb1df2b6153 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:39.519288 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac6d0-8efc-4e30-a36b-0eb1df2b6153 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:39.519596 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac6d0-8efc-4e30-a36b-0eb1df2b6153 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:39.524320 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 827/1628] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:39.524320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba00bdb-0d6c-4e07-98d2-4836c13dca70 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:39.535613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ac6d0-8efc-4e30-a36b-0eb1df2b6153 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:39.537255 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ac6d0-8efc-4e30-a36b-0eb1df2b6153 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:39.543909 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:39.558868 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 802/1629] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:39.558868 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ac6d0-8efc-4e30-a36b-0eb1df2b6153 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:39.573921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba00bdb-0d6c-4e07-98d2-4836c13dca70 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:39.589949 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3185a-7e52-4915-96c1-6cb5c770afa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:39.590927 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3185a-7e52-4915-96c1-6cb5c770afa6 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:39.591319 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3185a-7e52-4915-96c1-6cb5c770afa6 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:39.591735 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb3185a-7e52-4915-96c1-6cb5c770afa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:39.604134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ac6d0-8efc-4e30-a36b-0eb1df2b6153 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:39.625374 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8637eef-32fb-45f1-91ac-e88bba973626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:39.628972 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8637eef-32fb-45f1-91ac-e88bba973626 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:39.629448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8637eef-32fb-45f1-91ac-e88bba973626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:39.630595 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8637eef-32fb-45f1-91ac-e88bba973626 admin admin] PATH_INFO: `/v3/projects/a85462c5874340e7924e8b20fc68e696/users/869cf3eee4bc4e55bee4bb244c654485/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:39.684760 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8637eef-32fb-45f1-91ac-e88bba973626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85462c5874340e7924e8b20fc68e696, user_id=869cf3eee4bc4e55bee4bb244c654485, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:39.688299 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8637eef-32fb-45f1-91ac-e88bba973626 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:39.721168 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 803/1630] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:39 2022] PUT /identity/v3/projects/a85462c5874340e7924e8b20fc68e696/users/869cf3eee4bc4e55bee4bb244c654485/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:39.724446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3185a-7e52-4915-96c1-6cb5c770afa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:39.726472 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb3185a-7e52-4915-96c1-6cb5c770afa6 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:39.726664 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8637eef-32fb-45f1-91ac-e88bba973626 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:39.752115 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 828/1631] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:39.762324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3185a-7e52-4915-96c1-6cb5c770afa6 service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:39.775083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb3185a-7e52-4915-96c1-6cb5c770afa6 service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:39.855625 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b31730-722c-4fe7-96ca-887ea9fe5943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:39.856524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b31730-722c-4fe7-96ca-887ea9fe5943 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:39.856812 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b31730-722c-4fe7-96ca-887ea9fe5943 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:39.857093 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b31730-722c-4fe7-96ca-887ea9fe5943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:39.877005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8637eef-32fb-45f1-91ac-e88bba973626 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:39.894033 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3f8e0-79b5-4cbc-a19f-a1fbfeb17fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:39.895136 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3f8e0-79b5-4cbc-a19f-a1fbfeb17fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:39.895545 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3f8e0-79b5-4cbc-a19f-a1fbfeb17fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:39.896167 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a3f8e0-79b5-4cbc-a19f-a1fbfeb17fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:39.896997 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3f8e0-79b5-4cbc-a19f-a1fbfeb17fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:39.901652 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a3f8e0-79b5-4cbc-a19f-a1fbfeb17fa9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:39.916789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:39.929779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b31730-722c-4fe7-96ca-887ea9fe5943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:39.931078 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 804/1632] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:39.931933 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b31730-722c-4fe7-96ca-887ea9fe5943 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:39.936275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3f8e0-79b5-4cbc-a19f-a1fbfeb17fa9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:39.943223 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 829/1633] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:11:39.957582 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a3f8e0-79b5-4cbc-a19f-a1fbfeb17fa9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:39.972024 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f63b0-7d91-4402-998d-449eba1e8e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:39.972024 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f63b0-7d91-4402-998d-449eba1e8e7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:39.972024 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f63b0-7d91-4402-998d-449eba1e8e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:39.972409 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f63b0-7d91-4402-998d-449eba1e8e7d admin admin] PATH_INFO: `/v3/projects/a85462c5874340e7924e8b20fc68e696/users/869cf3eee4bc4e55bee4bb244c654485/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:39.981715 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f63b0-7d91-4402-998d-449eba1e8e7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a85462c5874340e7924e8b20fc68e696, user_id=869cf3eee4bc4e55bee4bb244c654485, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:39.985417 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f63b0-7d91-4402-998d-449eba1e8e7d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:40.011419 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 805/1634] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:39 2022] PUT /identity/v3/projects/a85462c5874340e7924e8b20fc68e696/users/869cf3eee4bc4e55bee4bb244c654485/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:40.022379 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fa7de-fc69-4220-97d9-14526d0f78b6 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:40.022679 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fa7de-fc69-4220-97d9-14526d0f78b6 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:40.022960 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fa7de-fc69-4220-97d9-14526d0f78b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:40.080782 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a36fa7de-fc69-4220-97d9-14526d0f78b6 None None] MFA Rules not processed for user `869cf3eee4bc4e55bee4bb244c654485`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:40.085402 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a36fa7de-fc69-4220-97d9-14526d0f78b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:40.290474 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 830/1635] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:40.299165 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f63b0-7d91-4402-998d-449eba1e8e7d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:40.333094 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a70334-f0aa-4e0e-ad78-a52c8d4417fd None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:40.333479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a70334-f0aa-4e0e-ad78-a52c8d4417fd None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:40.333767 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a70334-f0aa-4e0e-ad78-a52c8d4417fd None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:40.335503 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 831/1636] 10.222.0.42 () {54 vars in 912 bytes} [Sun Jul 24 01:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:11:40.341331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90e3c-baa8-4085-ab38-0049e890c567 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:40.341637 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90e3c-baa8-4085-ab38-0049e890c567 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:40.341922 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca90e3c-baa8-4085-ab38-0049e890c567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:40.375088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3ca90e3c-baa8-4085-ab38-0049e890c567 None None] MFA Rules not processed for user `6c32c443ee1a421e98e7656e8e86e27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:40.379137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3ca90e3c-baa8-4085-ab38-0049e890c567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:40.428564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f63b0-7d91-4402-998d-449eba1e8e7d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:40.433545 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843e28d-f76c-4164-89d3-c7dbcff647e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:40.434211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843e28d-f76c-4164-89d3-c7dbcff647e3 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:40.434496 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843e28d-f76c-4164-89d3-c7dbcff647e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:40.434807 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3843e28d-f76c-4164-89d3-c7dbcff647e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:40.448690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843e28d-f76c-4164-89d3-c7dbcff647e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:40.450564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3843e28d-f76c-4164-89d3-c7dbcff647e3 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:40.464668 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 806/1637] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:40 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:40.527203 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 832/1638] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:11:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:40.547756 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843e28d-f76c-4164-89d3-c7dbcff647e3 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:40.572804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3843e28d-f76c-4164-89d3-c7dbcff647e3 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:40.584008 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aad4e2b-224f-4f7a-866a-5364346c1063 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:40.584700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad4e2b-224f-4f7a-866a-5364346c1063 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:40.585018 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad4e2b-224f-4f7a-866a-5364346c1063 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:40.585265 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aad4e2b-224f-4f7a-866a-5364346c1063 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:40.644027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad4e2b-224f-4f7a-866a-5364346c1063 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:40.647848 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aad4e2b-224f-4f7a-866a-5364346c1063 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:40.668650 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 807/1639] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:40.728908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca90e3c-baa8-4085-ab38-0049e890c567 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:40.883969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca90e3c-baa8-4085-ab38-0049e890c567 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:40.900037 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92e999-4042-4133-8aea-87472d52e2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:40.903140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92e999-4042-4133-8aea-87472d52e2f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:40.904753 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92e999-4042-4133-8aea-87472d52e2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:40.905275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92e999-4042-4133-8aea-87472d52e2f0 admin admin] PATH_INFO: `/v3/users/4f2d887502a04a308b476ca2ad303a4d` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:40.908607 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92e999-4042-4133-8aea-87472d52e2f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2d887502a04a308b476ca2ad303a4d)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:40.912057 dv-cinder-master-3-smb devstack@keystone.service[80519]: WARNING py.warnings [None req-5b92e999-4042-4133-8aea-87472d52e2f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:40.912057 dv-cinder-master-3-smb devstack@keystone.service[80519]: warnings.warn(msg) Jul 24 01:11:40.912057 dv-cinder-master-3-smb devstack@keystone.service[80519]: Jul 24 01:11:40.914801 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92e999-4042-4133-8aea-87472d52e2f0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:40.928532 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:41.054831 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5b92e999-4042-4133-8aea-87472d52e2f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2d887502a04a308b476ca2ad303a4d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:41.061678 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5b92e999-4042-4133-8aea-87472d52e2f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2d887502a04a308b476ca2ad303a4d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:41.082493 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5b92e999-4042-4133-8aea-87472d52e2f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2d887502a04a308b476ca2ad303a4d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:41.083228 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5b92e999-4042-4133-8aea-87472d52e2f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2d887502a04a308b476ca2ad303a4d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:41.103793 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5b92e999-4042-4133-8aea-87472d52e2f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2d887502a04a308b476ca2ad303a4d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:41.168912 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 833/1640] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:40 2022] DELETE /identity/v3/users/4f2d887502a04a308b476ca2ad303a4d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:41.174538 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ce2a8-0289-4345-865a-6124fd1d55c4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:41.174538 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ce2a8-0289-4345-865a-6124fd1d55c4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:41.174538 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ce2a8-0289-4345-865a-6124fd1d55c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:41.198233 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d9295-0c68-4ef3-90d4-408867e26fca None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:41.198569 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d9295-0c68-4ef3-90d4-408867e26fca None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:41.198975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d9295-0c68-4ef3-90d4-408867e26fca None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:41.201101 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 834/1641] 10.222.0.42 () {54 vars in 962 bytes} [Sun Jul 24 01:11:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:11:41.206576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f84ce2a8-0289-4345-865a-6124fd1d55c4 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:41.207863 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f84ce2a8-0289-4345-865a-6124fd1d55c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:41.212530 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db347fdd-fa96-4fd6-b39f-0a276bf420f3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:41.219348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db347fdd-fa96-4fd6-b39f-0a276bf420f3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:41.219970 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db347fdd-fa96-4fd6-b39f-0a276bf420f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:41.245450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-db347fdd-fa96-4fd6-b39f-0a276bf420f3 None None] MFA Rules not processed for user `6c32c443ee1a421e98e7656e8e86e27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:41.247133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-db347fdd-fa96-4fd6-b39f-0a276bf420f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:41.321310 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:41.353790 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 808/1642] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:41.380713 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 835/1643] 10.222.0.42 () {58 vars in 1059 bytes} [Sun Jul 24 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:41.381434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ce2a8-0289-4345-865a-6124fd1d55c4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:41.382713 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cc468-a158-46fa-9b59-fb7b09cee077 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:41.383007 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cc468-a158-46fa-9b59-fb7b09cee077 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:41.383415 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21cc468-a158-46fa-9b59-fb7b09cee077 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:41.384994 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f84ce2a8-0289-4345-865a-6124fd1d55c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:41.396098 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 836/1644] 10.222.0.42 () {54 vars in 912 bytes} [Sun Jul 24 01:11:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:11:41.397431 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef0bc7-dbb4-48e2-926c-0ad1837be0d5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:41.397721 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef0bc7-dbb4-48e2-926c-0ad1837be0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:41.398418 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef0bc7-dbb4-48e2-926c-0ad1837be0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:41.438169 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d4ef0bc7-dbb4-48e2-926c-0ad1837be0d5 None None] MFA Rules not processed for user `6c32c443ee1a421e98e7656e8e86e27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:41.440194 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d4ef0bc7-dbb4-48e2-926c-0ad1837be0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:41.469797 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 837/1645] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:11:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:41.522543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef0bc7-dbb4-48e2-926c-0ad1837be0d5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:41.524120 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d4ef0bc7-dbb4-48e2-926c-0ad1837be0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:41.540829 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ce2a8-0289-4345-865a-6124fd1d55c4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:41.552770 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808af4b-b8fd-4e68-918d-7356b2be138c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:41.553448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808af4b-b8fd-4e68-918d-7356b2be138c service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:41.553733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808af4b-b8fd-4e68-918d-7356b2be138c service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:41.554368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9808af4b-b8fd-4e68-918d-7356b2be138c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:41.576669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808af4b-b8fd-4e68-918d-7356b2be138c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:41.581874 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9808af4b-b8fd-4e68-918d-7356b2be138c service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:41.607331 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 809/1646] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:11:41.708434 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef0bc7-dbb4-48e2-926c-0ad1837be0d5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:41.718092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ac606-970f-4889-a73f-29c53dffa844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:41.719456 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ac606-970f-4889-a73f-29c53dffa844 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:41.719993 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ac606-970f-4889-a73f-29c53dffa844 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:41.720491 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0ac606-970f-4889-a73f-29c53dffa844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:41.739558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ac606-970f-4889-a73f-29c53dffa844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:41.741663 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0ac606-970f-4889-a73f-29c53dffa844 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:41.774474 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 838/1647] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:42.508212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808af4b-b8fd-4e68-918d-7356b2be138c service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:42.510283 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9808af4b-b8fd-4e68-918d-7356b2be138c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:42.543274 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9808af4b-b8fd-4e68-918d-7356b2be138c service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:42.554465 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:42.565811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:42.568066 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:42.569047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] PATH_INFO: `/v3/projects/90092038d12744c2bfff3ca0add45daf` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:42.573932 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90092038d12744c2bfff3ca0add45daf)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:42.578980 dv-cinder-master-3-smb devstack@keystone.service[80520]: WARNING py.warnings [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 24 01:11:42.578980 dv-cinder-master-3-smb devstack@keystone.service[80520]: warnings.warn(msg) Jul 24 01:11:42.578980 dv-cinder-master-3-smb devstack@keystone.service[80520]: Jul 24 01:11:42.582152 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:42.775615 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90092038d12744c2bfff3ca0add45daf', 'request_id': 'req-1a553e0b-c11f-4316-a844-5d3db17d5b53'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:42.794037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90092038d12744c2bfff3ca0add45daf', 'request_id': 'req-1a553e0b-c11f-4316-a844-5d3db17d5b53'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:42.806453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90092038d12744c2bfff3ca0add45daf', 'request_id': 'req-1a553e0b-c11f-4316-a844-5d3db17d5b53'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:42.884899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] The token cache is being invalidate because project 90092038d12744c2bfff3ca0add45daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:42.885234 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:42.888300 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:42.894925 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 810/1648] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:42 2022] DELETE /identity/v3/projects/90092038d12744c2bfff3ca0add45daf => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:42.896724 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ac606-970f-4889-a73f-29c53dffa844 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:42.954104 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0ac606-970f-4889-a73f-29c53dffa844 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:43.002225 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:43.128665 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c475a8-955a-4d31-884c-dbc690d3b5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:43.129593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c475a8-955a-4d31-884c-dbc690d3b5bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:43.129877 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c475a8-955a-4d31-884c-dbc690d3b5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:43.130189 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c475a8-955a-4d31-884c-dbc690d3b5bf admin admin] PATH_INFO: `/v3/users/869cf3eee4bc4e55bee4bb244c654485` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:43.139969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c475a8-955a-4d31-884c-dbc690d3b5bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=869cf3eee4bc4e55bee4bb244c654485)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:43.148932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c475a8-955a-4d31-884c-dbc690d3b5bf admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:43.281696 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d5c475a8-955a-4d31-884c-dbc690d3b5bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '869cf3eee4bc4e55bee4bb244c654485'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:43.286331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d5c475a8-955a-4d31-884c-dbc690d3b5bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '869cf3eee4bc4e55bee4bb244c654485'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:43.310458 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d5c475a8-955a-4d31-884c-dbc690d3b5bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '869cf3eee4bc4e55bee4bb244c654485'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:43.311392 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d5c475a8-955a-4d31-884c-dbc690d3b5bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '869cf3eee4bc4e55bee4bb244c654485'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:43.331751 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d5c475a8-955a-4d31-884c-dbc690d3b5bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '869cf3eee4bc4e55bee4bb244c654485'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:43.383655 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 839/1649] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:42 2022] DELETE /identity/v3/users/869cf3eee4bc4e55bee4bb244c654485 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:44.176141 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:44.178734 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:44.202248 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a553e0b-c11f-4316-a844-5d3db17d5b53 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:44.323648 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86f43-df6a-4954-a161-0c3c8354c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:44.324982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86f43-df6a-4954-a161-0c3c8354c4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:44.325518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86f43-df6a-4954-a161-0c3c8354c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:44.326061 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef86f43-df6a-4954-a161-0c3c8354c4c9 admin admin] PATH_INFO: `/v3/users/f19bddbaa18948eebe5539e332aead44` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:44.328169 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef86f43-df6a-4954-a161-0c3c8354c4c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f19bddbaa18948eebe5539e332aead44)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:44.335337 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef86f43-df6a-4954-a161-0c3c8354c4c9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:44.386805 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:44.499494 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fef86f43-df6a-4954-a161-0c3c8354c4c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f19bddbaa18948eebe5539e332aead44'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:44.500861 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fef86f43-df6a-4954-a161-0c3c8354c4c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f19bddbaa18948eebe5539e332aead44'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:44.501528 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fef86f43-df6a-4954-a161-0c3c8354c4c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f19bddbaa18948eebe5539e332aead44'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:44.522125 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fef86f43-df6a-4954-a161-0c3c8354c4c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f19bddbaa18948eebe5539e332aead44'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:44.577630 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fef86f43-df6a-4954-a161-0c3c8354c4c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f19bddbaa18948eebe5539e332aead44'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:44.669405 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 811/1650] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:44 2022] DELETE /identity/v3/users/f19bddbaa18948eebe5539e332aead44 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:44.675083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351170f9-b3e9-436c-8b1b-3c7b3976c7b5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:44.676068 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351170f9-b3e9-436c-8b1b-3c7b3976c7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:44.680353 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351170f9-b3e9-436c-8b1b-3c7b3976c7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:44.729836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-351170f9-b3e9-436c-8b1b-3c7b3976c7b5 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:44.735798 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-351170f9-b3e9-436c-8b1b-3c7b3976c7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:44.905432 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 840/1651] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:44.942349 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86f43-df6a-4954-a161-0c3c8354c4c9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:44.943846 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fef86f43-df6a-4954-a161-0c3c8354c4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:45.065326 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef86f43-df6a-4954-a161-0c3c8354c4c9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:45.074672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffdfc6-b6e0-4907-b5d2-884424e6259c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:45.074672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffdfc6-b6e0-4907-b5d2-884424e6259c service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:45.074672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffdfc6-b6e0-4907-b5d2-884424e6259c service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:45.075154 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffdfc6-b6e0-4907-b5d2-884424e6259c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:45.096371 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffdfc6-b6e0-4907-b5d2-884424e6259c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:45.098941 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffdfc6-b6e0-4907-b5d2-884424e6259c service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:45.119925 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 812/1652] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:45.154369 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351170f9-b3e9-436c-8b1b-3c7b3976c7b5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:45.156676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-351170f9-b3e9-436c-8b1b-3c7b3976c7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:45.189202 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351170f9-b3e9-436c-8b1b-3c7b3976c7b5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:45.213541 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948e0e3-8c93-48d1-aed4-db6c981e1043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:45.217312 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948e0e3-8c93-48d1-aed4-db6c981e1043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:45.230716 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948e0e3-8c93-48d1-aed4-db6c981e1043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:45.233439 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948e0e3-8c93-48d1-aed4-db6c981e1043 admin admin] PATH_INFO: `/v3/projects/a85462c5874340e7924e8b20fc68e696` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:45.240243 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948e0e3-8c93-48d1-aed4-db6c981e1043 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a85462c5874340e7924e8b20fc68e696)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:45.244390 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948e0e3-8c93-48d1-aed4-db6c981e1043 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:45.312347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:45.363646 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b948e0e3-8c93-48d1-aed4-db6c981e1043 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a85462c5874340e7924e8b20fc68e696', 'request_id': 'req-b948e0e3-8c93-48d1-aed4-db6c981e1043'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:45.377066 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b948e0e3-8c93-48d1-aed4-db6c981e1043 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a85462c5874340e7924e8b20fc68e696', 'request_id': 'req-b948e0e3-8c93-48d1-aed4-db6c981e1043'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:45.388401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b948e0e3-8c93-48d1-aed4-db6c981e1043 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a85462c5874340e7924e8b20fc68e696', 'request_id': 'req-b948e0e3-8c93-48d1-aed4-db6c981e1043'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:45.442486 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b948e0e3-8c93-48d1-aed4-db6c981e1043 admin admin] The token cache is being invalidate because project a85462c5874340e7924e8b20fc68e696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:45.442917 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b948e0e3-8c93-48d1-aed4-db6c981e1043 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:45.443719 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b948e0e3-8c93-48d1-aed4-db6c981e1043 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:45.445945 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 841/1653] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:45 2022] DELETE /identity/v3/projects/a85462c5874340e7924e8b20fc68e696 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:45.450844 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb8172-5311-4fc7-8e49-80d535f039e5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:45.451694 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb8172-5311-4fc7-8e49-80d535f039e5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:45.452548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb8172-5311-4fc7-8e49-80d535f039e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:45.486466 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4ecb8172-5311-4fc7-8e49-80d535f039e5 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:45.489835 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4ecb8172-5311-4fc7-8e49-80d535f039e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:45.662768 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 813/1654] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:45.671110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1162b-79cc-4a8f-ab30-6cfcfe816a25 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:45.671804 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1162b-79cc-4a8f-ab30-6cfcfe816a25 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:45.672156 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1162b-79cc-4a8f-ab30-6cfcfe816a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:45.709950 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-15f1162b-79cc-4a8f-ab30-6cfcfe816a25 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:45.712307 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-15f1162b-79cc-4a8f-ab30-6cfcfe816a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:45.738379 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 842/1655] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:45.739897 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb8172-5311-4fc7-8e49-80d535f039e5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:45.750155 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb8172-5311-4fc7-8e49-80d535f039e5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:45.760397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae2a50-e4fe-448d-ac8a-c21135729017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:45.760779 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae2a50-e4fe-448d-ac8a-c21135729017 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:45.761100 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae2a50-e4fe-448d-ac8a-c21135729017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:45.763252 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae2a50-e4fe-448d-ac8a-c21135729017 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:45.764042 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae2a50-e4fe-448d-ac8a-c21135729017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:45.764354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae2a50-e4fe-448d-ac8a-c21135729017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:45.769126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae2a50-e4fe-448d-ac8a-c21135729017 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:45.791383 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 814/1656] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:45.794375 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1162b-79cc-4a8f-ab30-6cfcfe816a25 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:45.813324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1162b-79cc-4a8f-ab30-6cfcfe816a25 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:45.830066 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a55b7-c1df-49bb-be85-12ab1a928989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:45.830995 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a55b7-c1df-49bb-be85-12ab1a928989 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:45.831531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a55b7-c1df-49bb-be85-12ab1a928989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:45.852820 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96a55b7-c1df-49bb-be85-12ab1a928989 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:45.854252 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a55b7-c1df-49bb-be85-12ab1a928989 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:45.857670 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96a55b7-c1df-49bb-be85-12ab1a928989 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:45.941625 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 843/1657] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:45 2022] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:45.942955 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae2a50-e4fe-448d-ac8a-c21135729017 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:45.955769 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae2a50-e4fe-448d-ac8a-c21135729017 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:46.028142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:46.108217 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61781385-9136-47d1-966b-4cc75ca83f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:46.108922 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61781385-9136-47d1-966b-4cc75ca83f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:46.109208 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61781385-9136-47d1-966b-4cc75ca83f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:46.109490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61781385-9136-47d1-966b-4cc75ca83f65 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:46.110196 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61781385-9136-47d1-966b-4cc75ca83f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:46.112187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61781385-9136-47d1-966b-4cc75ca83f65 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:46.169710 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 815/1658] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:45 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:46.170915 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a55b7-c1df-49bb-be85-12ab1a928989 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:46.185579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96a55b7-c1df-49bb-be85-12ab1a928989 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:46.207521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b470d6d-5387-482b-9190-17aa57be9e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:46.209688 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b470d6d-5387-482b-9190-17aa57be9e91 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:46.211158 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b470d6d-5387-482b-9190-17aa57be9e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:46.211532 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b470d6d-5387-482b-9190-17aa57be9e91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:46.216303 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b470d6d-5387-482b-9190-17aa57be9e91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:46.218050 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b470d6d-5387-482b-9190-17aa57be9e91 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:46.250115 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 844/1659] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:11:46.256328 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61781385-9136-47d1-966b-4cc75ca83f65 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:46.273339 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61781385-9136-47d1-966b-4cc75ca83f65 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:46.287189 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93820e3d-75f6-4c8d-82cb-a3f4e2d4f724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:46.291215 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93820e3d-75f6-4c8d-82cb-a3f4e2d4f724 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:46.291998 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93820e3d-75f6-4c8d-82cb-a3f4e2d4f724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:46.292329 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93820e3d-75f6-4c8d-82cb-a3f4e2d4f724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:46.293799 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93820e3d-75f6-4c8d-82cb-a3f4e2d4f724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:46.297524 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93820e3d-75f6-4c8d-82cb-a3f4e2d4f724 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:46.359102 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 816/1660] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:46.364640 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b470d6d-5387-482b-9190-17aa57be9e91 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:46.398735 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b470d6d-5387-482b-9190-17aa57be9e91 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:46.410216 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa8a6b-d62e-4151-bfce-b80d5e4b391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:46.425188 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa8a6b-d62e-4151-bfce-b80d5e4b391d admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:46.425531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa8a6b-d62e-4151-bfce-b80d5e4b391d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:46.425867 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa8a6b-d62e-4151-bfce-b80d5e4b391d admin admin] PATH_INFO: `/v3/projects/08ed8f6df27047bba911721bcea8454c/users/a35cd458a02d42d1b1474d2383677221/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:46.480518 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa8a6b-d62e-4151-bfce-b80d5e4b391d admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ed8f6df27047bba911721bcea8454c, user_id=a35cd458a02d42d1b1474d2383677221, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:46.504392 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa8a6b-d62e-4151-bfce-b80d5e4b391d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:46.546042 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 845/1661] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:46 2022] PUT /identity/v3/projects/08ed8f6df27047bba911721bcea8454c/users/a35cd458a02d42d1b1474d2383677221/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:46.560905 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff46a1-13e2-4309-8cff-78859ab74e1d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:46.561370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff46a1-13e2-4309-8cff-78859ab74e1d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:46.561370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff46a1-13e2-4309-8cff-78859ab74e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:46.632490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0bff46a1-13e2-4309-8cff-78859ab74e1d None None] MFA Rules not processed for user `a35cd458a02d42d1b1474d2383677221`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:46.634001 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0bff46a1-13e2-4309-8cff-78859ab74e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:46.886840 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 817/1662] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:46.888068 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa8a6b-d62e-4151-bfce-b80d5e4b391d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:47.084443 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa8a6b-d62e-4151-bfce-b80d5e4b391d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:47.100753 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125adff-44fa-4834-b5cb-782f0cdf591c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:47.101459 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125adff-44fa-4834-b5cb-782f0cdf591c admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:47.101741 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125adff-44fa-4834-b5cb-782f0cdf591c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:47.102016 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125adff-44fa-4834-b5cb-782f0cdf591c admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:47.102729 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125adff-44fa-4834-b5cb-782f0cdf591c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:47.104791 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125adff-44fa-4834-b5cb-782f0cdf591c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:47.193390 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 846/1663] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:46 2022] POST /identity/v3/projects => generated 365 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:47.194031 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff46a1-13e2-4309-8cff-78859ab74e1d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:47.215656 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff46a1-13e2-4309-8cff-78859ab74e1d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:47.367719 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a95208-838d-4527-a75c-50f22a132a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:47.368428 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a95208-838d-4527-a75c-50f22a132a66 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:47.368716 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a95208-838d-4527-a75c-50f22a132a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:47.368995 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a95208-838d-4527-a75c-50f22a132a66 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:47.369708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a95208-838d-4527-a75c-50f22a132a66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:47.372178 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a95208-838d-4527-a75c-50f22a132a66 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:47.430910 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 818/1664] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:47 2022] POST /identity/v3/users => generated 289 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:47.431671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125adff-44fa-4834-b5cb-782f0cdf591c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:47.447883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125adff-44fa-4834-b5cb-782f0cdf591c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:47.468042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62793bbd-36c4-4043-bf50-cbd8e47e2cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:47.468745 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62793bbd-36c4-4043-bf50-cbd8e47e2cdc admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:47.469099 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62793bbd-36c4-4043-bf50-cbd8e47e2cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:47.469292 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62793bbd-36c4-4043-bf50-cbd8e47e2cdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:47.470078 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62793bbd-36c4-4043-bf50-cbd8e47e2cdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:47.471671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62793bbd-36c4-4043-bf50-cbd8e47e2cdc admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:47.497120 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 847/1665] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:47.506400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a95208-838d-4527-a75c-50f22a132a66 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:47.519628 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a95208-838d-4527-a75c-50f22a132a66 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:47.533408 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3b3be-1d72-4746-aad1-5e572a244612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:47.534474 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3b3be-1d72-4746-aad1-5e572a244612 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:47.534861 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3b3be-1d72-4746-aad1-5e572a244612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:47.535242 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda3b3be-1d72-4746-aad1-5e572a244612 admin admin] PATH_INFO: `/v3/projects/c1ff44ea591c46458194a94f0e6bbff9/users/bb78dd0cee7e419989974b8d55c3f3dc/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:47.570691 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62793bbd-36c4-4043-bf50-cbd8e47e2cdc admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:47.572697 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-62793bbd-36c4-4043-bf50-cbd8e47e2cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:47.593667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3b3be-1d72-4746-aad1-5e572a244612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ff44ea591c46458194a94f0e6bbff9, user_id=bb78dd0cee7e419989974b8d55c3f3dc, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:47.599413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62793bbd-36c4-4043-bf50-cbd8e47e2cdc admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:47.600730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda3b3be-1d72-4746-aad1-5e572a244612 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:47.607599 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37523b-4b92-4101-afb2-5b3a18b4777a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:47.608515 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37523b-4b92-4101-afb2-5b3a18b4777a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:47.608799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37523b-4b92-4101-afb2-5b3a18b4777a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:47.609074 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b37523b-4b92-4101-afb2-5b3a18b4777a admin admin] PATH_INFO: `/v3/users/930defb348d1476c8021deb4ebfa590a` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:47.612073 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37523b-4b92-4101-afb2-5b3a18b4777a admin admin] RBAC: Authorizing `identity:delete_user(user_id=930defb348d1476c8021deb4ebfa590a)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:47.614051 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b37523b-4b92-4101-afb2-5b3a18b4777a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:47.623269 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:47.629778 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 819/1666] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:47 2022] PUT /identity/v3/projects/c1ff44ea591c46458194a94f0e6bbff9/users/bb78dd0cee7e419989974b8d55c3f3dc/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:47.647975 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3b3be-1d72-4746-aad1-5e572a244612 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:47.697444 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:47.744639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6b37523b-4b92-4101-afb2-5b3a18b4777a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '930defb348d1476c8021deb4ebfa590a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:47.745716 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6b37523b-4b92-4101-afb2-5b3a18b4777a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '930defb348d1476c8021deb4ebfa590a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:47.762133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6b37523b-4b92-4101-afb2-5b3a18b4777a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '930defb348d1476c8021deb4ebfa590a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:47.762899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6b37523b-4b92-4101-afb2-5b3a18b4777a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '930defb348d1476c8021deb4ebfa590a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:47.772324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6b37523b-4b92-4101-afb2-5b3a18b4777a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '930defb348d1476c8021deb4ebfa590a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:47.797450 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 848/1667] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:47 2022] DELETE /identity/v3/users/930defb348d1476c8021deb4ebfa590a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:47.798497 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37523b-4b92-4101-afb2-5b3a18b4777a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:47.803210 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6b37523b-4b92-4101-afb2-5b3a18b4777a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:47.812630 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda3b3be-1d72-4746-aad1-5e572a244612 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:47.891445 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b37523b-4b92-4101-afb2-5b3a18b4777a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:47.898125 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27514174-3fd4-438b-9c76-e0537d91b041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:47.899163 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27514174-3fd4-438b-9c76-e0537d91b041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:47.899501 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27514174-3fd4-438b-9c76-e0537d91b041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:47.899782 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27514174-3fd4-438b-9c76-e0537d91b041 admin admin] PATH_INFO: `/v3/projects/d7c0c7a3934f403ab2d52c44cdc1d8f7` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:47.901395 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27514174-3fd4-438b-9c76-e0537d91b041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7c0c7a3934f403ab2d52c44cdc1d8f7)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:47.916070 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27514174-3fd4-438b-9c76-e0537d91b041 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:47.967921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9ebe2d-7d29-43d5-9dd8-81489a422e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:47.968778 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ebe2d-7d29-43d5-9dd8-81489a422e52 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:47.970032 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ebe2d-7d29-43d5-9dd8-81489a422e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:47.970141 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9ebe2d-7d29-43d5-9dd8-81489a422e52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:47.972384 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ebe2d-7d29-43d5-9dd8-81489a422e52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:47.977528 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9ebe2d-7d29-43d5-9dd8-81489a422e52 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:47.997546 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-27514174-3fd4-438b-9c76-e0537d91b041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7c0c7a3934f403ab2d52c44cdc1d8f7', 'request_id': 'req-27514174-3fd4-438b-9c76-e0537d91b041'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:48.011162 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 820/1668] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:48.011735 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-27514174-3fd4-438b-9c76-e0537d91b041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7c0c7a3934f403ab2d52c44cdc1d8f7', 'request_id': 'req-27514174-3fd4-438b-9c76-e0537d91b041'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:48.018237 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eb04f-a4f4-4c1b-b1f9-4739ea92ba99 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:48.018330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eb04f-a4f4-4c1b-b1f9-4739ea92ba99 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:48.018682 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409eb04f-a4f4-4c1b-b1f9-4739ea92ba99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:48.027791 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-27514174-3fd4-438b-9c76-e0537d91b041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7c0c7a3934f403ab2d52c44cdc1d8f7', 'request_id': 'req-27514174-3fd4-438b-9c76-e0537d91b041'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:48.057790 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-27514174-3fd4-438b-9c76-e0537d91b041 admin admin] The token cache is being invalidate because project d7c0c7a3934f403ab2d52c44cdc1d8f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:48.058720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-27514174-3fd4-438b-9c76-e0537d91b041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:48.060052 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-27514174-3fd4-438b-9c76-e0537d91b041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:48.061246 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-409eb04f-a4f4-4c1b-b1f9-4739ea92ba99 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:48.062687 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 849/1669] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:47 2022] DELETE /identity/v3/projects/d7c0c7a3934f403ab2d52c44cdc1d8f7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:48.063862 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27514174-3fd4-438b-9c76-e0537d91b041 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:48.066482 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-409eb04f-a4f4-4c1b-b1f9-4739ea92ba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:48.067635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-27514174-3fd4-438b-9c76-e0537d91b041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:48.122784 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:48.179231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27514174-3fd4-438b-9c76-e0537d91b041 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:48.189521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a68ae6-6aea-4962-9be5-1f2c9fbc8d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:48.191114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a68ae6-6aea-4962-9be5-1f2c9fbc8d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:48.191625 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a68ae6-6aea-4962-9be5-1f2c9fbc8d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:48.192173 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a68ae6-6aea-4962-9be5-1f2c9fbc8d09 admin admin] PATH_INFO: `/v3/projects/c1ff44ea591c46458194a94f0e6bbff9/users/bb78dd0cee7e419989974b8d55c3f3dc/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:48.195900 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a68ae6-6aea-4962-9be5-1f2c9fbc8d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1ff44ea591c46458194a94f0e6bbff9, user_id=bb78dd0cee7e419989974b8d55c3f3dc, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:48.199220 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a68ae6-6aea-4962-9be5-1f2c9fbc8d09 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:48.210214 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 821/1670] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:48.211199 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409eb04f-a4f4-4c1b-b1f9-4739ea92ba99 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:48.214603 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-409eb04f-a4f4-4c1b-b1f9-4739ea92ba99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:48.216966 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 850/1671] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:48 2022] PUT /identity/v3/projects/c1ff44ea591c46458194a94f0e6bbff9/users/bb78dd0cee7e419989974b8d55c3f3dc/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:48.227742 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277dad2-d28f-4194-b44a-a13071055ad9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:48.228316 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277dad2-d28f-4194-b44a-a13071055ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:48.228772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277dad2-d28f-4194-b44a-a13071055ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:48.237005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409eb04f-a4f4-4c1b-b1f9-4739ea92ba99 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:48.279420 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e277dad2-d28f-4194-b44a-a13071055ad9 None None] MFA Rules not processed for user `bb78dd0cee7e419989974b8d55c3f3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:48.283751 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e277dad2-d28f-4194-b44a-a13071055ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:48.320552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:48.354314 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdbe29-66b0-44c3-9f0d-8a38279fecd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:48.357223 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdbe29-66b0-44c3-9f0d-8a38279fecd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:48.357672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdbe29-66b0-44c3-9f0d-8a38279fecd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:48.358402 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fdbe29-66b0-44c3-9f0d-8a38279fecd2 admin admin] PATH_INFO: `/v3/users/e374a9861f4b418b943c91b0ecd3ba5a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:48.362376 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdbe29-66b0-44c3-9f0d-8a38279fecd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e374a9861f4b418b943c91b0ecd3ba5a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:48.366793 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fdbe29-66b0-44c3-9f0d-8a38279fecd2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:48.453479 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 851/1672] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:48.454515 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277dad2-d28f-4194-b44a-a13071055ad9 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:48.465526 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e277dad2-d28f-4194-b44a-a13071055ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:48.473320 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-62fdbe29-66b0-44c3-9f0d-8a38279fecd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e374a9861f4b418b943c91b0ecd3ba5a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:48.474422 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-62fdbe29-66b0-44c3-9f0d-8a38279fecd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e374a9861f4b418b943c91b0ecd3ba5a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:48.475289 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-62fdbe29-66b0-44c3-9f0d-8a38279fecd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e374a9861f4b418b943c91b0ecd3ba5a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:48.490677 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-62fdbe29-66b0-44c3-9f0d-8a38279fecd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e374a9861f4b418b943c91b0ecd3ba5a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:48.517790 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-62fdbe29-66b0-44c3-9f0d-8a38279fecd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e374a9861f4b418b943c91b0ecd3ba5a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:48.546573 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 822/1673] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:48 2022] DELETE /identity/v3/users/e374a9861f4b418b943c91b0ecd3ba5a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:48.547828 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdbe29-66b0-44c3-9f0d-8a38279fecd2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:48.550509 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-62fdbe29-66b0-44c3-9f0d-8a38279fecd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:48.557104 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277dad2-d28f-4194-b44a-a13071055ad9 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:48.669782 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754a1a0-069d-4715-b181-2cec383aee22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:48.670458 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a1a0-069d-4715-b181-2cec383aee22 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:48.670745 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a1a0-069d-4715-b181-2cec383aee22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:48.671143 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754a1a0-069d-4715-b181-2cec383aee22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:48.672184 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fdbe29-66b0-44c3-9f0d-8a38279fecd2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:48.674138 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d754a1a0-069d-4715-b181-2cec383aee22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:48.676036 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a4fd4-d237-489b-8063-6f7c2cf2fdbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:48.677601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a4fd4-d237-489b-8063-6f7c2cf2fdbe service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:48.677888 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a4fd4-d237-489b-8063-6f7c2cf2fdbe service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:48.678164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a4fd4-d237-489b-8063-6f7c2cf2fdbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:48.680630 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ca6a4fd4-d237-489b-8063-6f7c2cf2fdbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:48.720403 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:48.812572 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754a1a0-069d-4715-b181-2cec383aee22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:48.813307 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a4fd4-d237-489b-8063-6f7c2cf2fdbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:48.814143 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d754a1a0-069d-4715-b181-2cec383aee22 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:48.817270 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a4fd4-d237-489b-8063-6f7c2cf2fdbe service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:48.837298 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 852/1674] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:48.847906 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 823/1675] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:48.977738 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754a1a0-069d-4715-b181-2cec383aee22 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:48.992251 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754a1a0-069d-4715-b181-2cec383aee22 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:49.000263 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9b4814-b3cb-490a-8233-fa3acbe7f871 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:49.000980 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b4814-b3cb-490a-8233-fa3acbe7f871 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:49.001266 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b4814-b3cb-490a-8233-fa3acbe7f871 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:49.001545 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9b4814-b3cb-490a-8233-fa3acbe7f871 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:49.010189 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cf9b4814-b3cb-490a-8233-fa3acbe7f871 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:49.141170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b4814-b3cb-490a-8233-fa3acbe7f871 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:49.142572 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9b4814-b3cb-490a-8233-fa3acbe7f871 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:49.167001 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 853/1676] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:49.427554 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a4fd4-d237-489b-8063-6f7c2cf2fdbe service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:49.430170 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ca6a4fd4-d237-489b-8063-6f7c2cf2fdbe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:49.497730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a4fd4-d237-489b-8063-6f7c2cf2fdbe service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:49.522862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbfa194-a51f-40d3-9709-2478dc49c6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:49.524601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfa194-a51f-40d3-9709-2478dc49c6f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:49.527603 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfa194-a51f-40d3-9709-2478dc49c6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:49.528661 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbfa194-a51f-40d3-9709-2478dc49c6f7 admin admin] PATH_INFO: `/v3/projects/f22a02f653c74cc6b84ffef78c2e6a68` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:49.535030 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfa194-a51f-40d3-9709-2478dc49c6f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f22a02f653c74cc6b84ffef78c2e6a68)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:49.545731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbfa194-a51f-40d3-9709-2478dc49c6f7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:49.578396 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:49.687895 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2fbfa194-a51f-40d3-9709-2478dc49c6f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f22a02f653c74cc6b84ffef78c2e6a68', 'request_id': 'req-2fbfa194-a51f-40d3-9709-2478dc49c6f7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:49.705279 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2fbfa194-a51f-40d3-9709-2478dc49c6f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f22a02f653c74cc6b84ffef78c2e6a68', 'request_id': 'req-2fbfa194-a51f-40d3-9709-2478dc49c6f7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:49.713916 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2fbfa194-a51f-40d3-9709-2478dc49c6f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f22a02f653c74cc6b84ffef78c2e6a68', 'request_id': 'req-2fbfa194-a51f-40d3-9709-2478dc49c6f7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:49.745063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2fbfa194-a51f-40d3-9709-2478dc49c6f7 admin admin] The token cache is being invalidate because project f22a02f653c74cc6b84ffef78c2e6a68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:49.745457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2fbfa194-a51f-40d3-9709-2478dc49c6f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:49.746185 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2fbfa194-a51f-40d3-9709-2478dc49c6f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:49.747869 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 824/1677] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:49 2022] DELETE /identity/v3/projects/f22a02f653c74cc6b84ffef78c2e6a68 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:49.753443 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92d830-97a3-4495-9168-b1cef855ec98 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:49.753582 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92d830-97a3-4495-9168-b1cef855ec98 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:49.753918 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92d830-97a3-4495-9168-b1cef855ec98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:49.793770 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3d92d830-97a3-4495-9168-b1cef855ec98 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:49.795327 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3d92d830-97a3-4495-9168-b1cef855ec98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:49.951162 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 854/1678] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:49.959108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622d08e-105b-4142-a6bf-be4888572ce2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:49.959428 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622d08e-105b-4142-a6bf-be4888572ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:49.960174 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622d08e-105b-4142-a6bf-be4888572ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:49.995845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e622d08e-105b-4142-a6bf-be4888572ce2 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:49.996595 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e622d08e-105b-4142-a6bf-be4888572ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:50.014770 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 825/1679] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:50.019394 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92d830-97a3-4495-9168-b1cef855ec98 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:50.029480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92d830-97a3-4495-9168-b1cef855ec98 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:50.044872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114d7dc-9a28-46ad-a435-fc2d1dd8e4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:50.045920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114d7dc-9a28-46ad-a435-fc2d1dd8e4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:50.045920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114d7dc-9a28-46ad-a435-fc2d1dd8e4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:50.046119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b114d7dc-9a28-46ad-a435-fc2d1dd8e4f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:50.047379 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114d7dc-9a28-46ad-a435-fc2d1dd8e4f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:50.047379 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114d7dc-9a28-46ad-a435-fc2d1dd8e4f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:50.048834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b114d7dc-9a28-46ad-a435-fc2d1dd8e4f0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:50.081403 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 855/1680] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:50.086423 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622d08e-105b-4142-a6bf-be4888572ce2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:50.099999 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622d08e-105b-4142-a6bf-be4888572ce2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:50.111135 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca15c51-70d4-43b6-9c74-cbe9d375db28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:50.111869 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca15c51-70d4-43b6-9c74-cbe9d375db28 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:50.112158 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca15c51-70d4-43b6-9c74-cbe9d375db28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:50.112739 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca15c51-70d4-43b6-9c74-cbe9d375db28 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:50.113137 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca15c51-70d4-43b6-9c74-cbe9d375db28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:50.115161 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca15c51-70d4-43b6-9c74-cbe9d375db28 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:50.194802 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 826/1681] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:50 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:50.199166 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114d7dc-9a28-46ad-a435-fc2d1dd8e4f0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:50.215400 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b114d7dc-9a28-46ad-a435-fc2d1dd8e4f0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:50.325691 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:50.398377 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9edc1-6f03-4f57-821e-a06bbe1cd366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:50.399270 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9edc1-6f03-4f57-821e-a06bbe1cd366 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:50.399691 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9edc1-6f03-4f57-821e-a06bbe1cd366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:50.400079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9edc1-6f03-4f57-821e-a06bbe1cd366 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:50.400906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9edc1-6f03-4f57-821e-a06bbe1cd366 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:50.403113 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9edc1-6f03-4f57-821e-a06bbe1cd366 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:50.451708 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 856/1682] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:50 2022] POST /identity/v3/users => generated 290 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:50.453457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca15c51-70d4-43b6-9c74-cbe9d375db28 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:50.483651 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca15c51-70d4-43b6-9c74-cbe9d375db28 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:50.510108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc9710-cd92-4ab3-b64e-39c5b3333d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:50.511161 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc9710-cd92-4ab3-b64e-39c5b3333d60 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:50.511624 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc9710-cd92-4ab3-b64e-39c5b3333d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:50.512497 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc9710-cd92-4ab3-b64e-39c5b3333d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:50.516982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc9710-cd92-4ab3-b64e-39c5b3333d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:50.525359 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fc9710-cd92-4ab3-b64e-39c5b3333d60 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:50.563346 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 827/1683] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:50.567447 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9edc1-6f03-4f57-821e-a06bbe1cd366 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:50.582817 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9edc1-6f03-4f57-821e-a06bbe1cd366 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:50.599122 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248ba50-25cb-4df4-a47f-2c9503fda4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:50.600265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248ba50-25cb-4df4-a47f-2c9503fda4fe admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:50.600779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248ba50-25cb-4df4-a47f-2c9503fda4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:50.601276 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248ba50-25cb-4df4-a47f-2c9503fda4fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:50.602327 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248ba50-25cb-4df4-a47f-2c9503fda4fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:50.604218 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248ba50-25cb-4df4-a47f-2c9503fda4fe admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:50.630283 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc9710-cd92-4ab3-b64e-39c5b3333d60 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:50.630855 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 857/1684] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:50.661383 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc9710-cd92-4ab3-b64e-39c5b3333d60 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:50.675324 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56c0e8-d1d2-4910-9671-81cbb0a00216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:50.677074 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56c0e8-d1d2-4910-9671-81cbb0a00216 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:50.677411 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56c0e8-d1d2-4910-9671-81cbb0a00216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:50.677784 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da56c0e8-d1d2-4910-9671-81cbb0a00216 admin admin] PATH_INFO: `/v3/projects/b0d6c3c693f34ad08e914d9dcc3a2588/users/795354a0681f43c890261ba04626fc87/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:50.732269 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56c0e8-d1d2-4910-9671-81cbb0a00216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d6c3c693f34ad08e914d9dcc3a2588, user_id=795354a0681f43c890261ba04626fc87, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:50.740829 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da56c0e8-d1d2-4910-9671-81cbb0a00216 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:50.773840 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 828/1685] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:50 2022] PUT /identity/v3/projects/b0d6c3c693f34ad08e914d9dcc3a2588/users/795354a0681f43c890261ba04626fc87/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:50.785544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2154798-8266-46e3-a1f0-4ca8606801a9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:50.785999 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2154798-8266-46e3-a1f0-4ca8606801a9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:50.786596 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2154798-8266-46e3-a1f0-4ca8606801a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:50.859214 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e2154798-8266-46e3-a1f0-4ca8606801a9 None None] MFA Rules not processed for user `795354a0681f43c890261ba04626fc87`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:50.860873 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e2154798-8266-46e3-a1f0-4ca8606801a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:51.016690 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 858/1686] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:50 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:51.018049 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56c0e8-d1d2-4910-9671-81cbb0a00216 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:51.240646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da56c0e8-d1d2-4910-9671-81cbb0a00216 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:51.257619 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2154798-8266-46e3-a1f0-4ca8606801a9 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:51.259589 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e2154798-8266-46e3-a1f0-4ca8606801a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:51.260458 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8c05c-51b6-4c41-948f-6ca73b510539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:51.261876 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8c05c-51b6-4c41-948f-6ca73b510539 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:51.263482 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8c05c-51b6-4c41-948f-6ca73b510539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:51.264528 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8c05c-51b6-4c41-948f-6ca73b510539 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:51.267121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8c05c-51b6-4c41-948f-6ca73b510539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:51.272240 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8c05c-51b6-4c41-948f-6ca73b510539 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:51.299760 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2154798-8266-46e3-a1f0-4ca8606801a9 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:51.307269 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5fd7c-a539-4637-aa46-3eae7b3537bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:51.308682 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5fd7c-a539-4637-aa46-3eae7b3537bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:51.309157 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5fd7c-a539-4637-aa46-3eae7b3537bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:51.309642 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d5fd7c-a539-4637-aa46-3eae7b3537bc admin admin] PATH_INFO: `/v3/projects/39d60a6aa0c045f9b27fb65b647772c6` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:51.312024 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5fd7c-a539-4637-aa46-3eae7b3537bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d60a6aa0c045f9b27fb65b647772c6)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:51.314418 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d5fd7c-a539-4637-aa46-3eae7b3537bc admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:51.343453 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 829/1687] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:51 2022] POST /identity/v3/projects => generated 379 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:11:51.347347 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8c05c-51b6-4c41-948f-6ca73b510539 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:51.393453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:51.464421 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-20d5fd7c-a539-4637-aa46-3eae7b3537bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d60a6aa0c045f9b27fb65b647772c6', 'request_id': 'req-20d5fd7c-a539-4637-aa46-3eae7b3537bc'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:51.484693 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-20d5fd7c-a539-4637-aa46-3eae7b3537bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d60a6aa0c045f9b27fb65b647772c6', 'request_id': 'req-20d5fd7c-a539-4637-aa46-3eae7b3537bc'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:51.506602 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-20d5fd7c-a539-4637-aa46-3eae7b3537bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d60a6aa0c045f9b27fb65b647772c6', 'request_id': 'req-20d5fd7c-a539-4637-aa46-3eae7b3537bc'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:51.532890 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-20d5fd7c-a539-4637-aa46-3eae7b3537bc admin admin] The token cache is being invalidate because project 39d60a6aa0c045f9b27fb65b647772c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:51.533361 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-20d5fd7c-a539-4637-aa46-3eae7b3537bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:51.534902 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-20d5fd7c-a539-4637-aa46-3eae7b3537bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:51.537025 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 859/1688] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:51 2022] DELETE /identity/v3/projects/39d60a6aa0c045f9b27fb65b647772c6 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:11:51.539386 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5fd7c-a539-4637-aa46-3eae7b3537bc admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:51.544533 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-20d5fd7c-a539-4637-aa46-3eae7b3537bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:51.627968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:51.632899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8c05c-51b6-4c41-948f-6ca73b510539 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:51.720677 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d5fd7c-a539-4637-aa46-3eae7b3537bc admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:51.741972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cddda-ccf3-44f8-b808-257a1eb55ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:51.743378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cddda-ccf3-44f8-b808-257a1eb55ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:51.743812 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cddda-ccf3-44f8-b808-257a1eb55ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:51.744226 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cddda-ccf3-44f8-b808-257a1eb55ee4 admin admin] PATH_INFO: `/v3/users/b92f449e31434a1a84bc9453757186a1` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:51.745830 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cddda-ccf3-44f8-b808-257a1eb55ee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b92f449e31434a1a84bc9453757186a1)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:51.748728 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712cddda-ccf3-44f8-b808-257a1eb55ee4 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:51.880777 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f8a3a5-f02c-4da9-bc7d-5e4c7fe3e0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:51.881590 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8a3a5-f02c-4da9-bc7d-5e4c7fe3e0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:51.881590 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8a3a5-f02c-4da9-bc7d-5e4c7fe3e0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:51.881590 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8a3a5-f02c-4da9-bc7d-5e4c7fe3e0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:51.882343 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8a3a5-f02c-4da9-bc7d-5e4c7fe3e0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:51.884296 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f8a3a5-f02c-4da9-bc7d-5e4c7fe3e0c3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:51.916783 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-712cddda-ccf3-44f8-b808-257a1eb55ee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b92f449e31434a1a84bc9453757186a1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:51.919757 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-712cddda-ccf3-44f8-b808-257a1eb55ee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b92f449e31434a1a84bc9453757186a1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:51.953692 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 830/1689] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:51 2022] POST /identity/v3/users => generated 296 bytes in 607 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:11:51.955349 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e593d8-ac0e-4503-956c-d0fcf4169c1b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:51.955763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e593d8-ac0e-4503-956c-d0fcf4169c1b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:51.956001 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e593d8-ac0e-4503-956c-d0fcf4169c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:51.960101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-712cddda-ccf3-44f8-b808-257a1eb55ee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b92f449e31434a1a84bc9453757186a1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:51.961123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-712cddda-ccf3-44f8-b808-257a1eb55ee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b92f449e31434a1a84bc9453757186a1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:51.980450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-712cddda-ccf3-44f8-b808-257a1eb55ee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b92f449e31434a1a84bc9453757186a1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:52.030753 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f0e593d8-ac0e-4503-956c-d0fcf4169c1b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:52.039943 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f0e593d8-ac0e-4503-956c-d0fcf4169c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:52.051279 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 860/1690] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:51 2022] DELETE /identity/v3/users/b92f449e31434a1a84bc9453757186a1 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:52.053639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cddda-ccf3-44f8-b808-257a1eb55ee4 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:52.059978 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-712cddda-ccf3-44f8-b808-257a1eb55ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:52.064895 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 831/1691] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:52.071712 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dee1b-8442-46b9-94fa-3eb4bf102172 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:52.071712 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dee1b-8442-46b9-94fa-3eb4bf102172 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:52.072846 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dee1b-8442-46b9-94fa-3eb4bf102172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:52.123814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9e2dee1b-8442-46b9-94fa-3eb4bf102172 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:52.125917 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9e2dee1b-8442-46b9-94fa-3eb4bf102172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:52.283915 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cddda-ccf3-44f8-b808-257a1eb55ee4 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:52.295429 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf841b97-4f53-45f6-b3d9-ce551c170c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:52.296136 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf841b97-4f53-45f6-b3d9-ce551c170c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:52.296415 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf841b97-4f53-45f6-b3d9-ce551c170c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:52.298444 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf841b97-4f53-45f6-b3d9-ce551c170c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:52.300032 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf841b97-4f53-45f6-b3d9-ce551c170c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:52.310725 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf841b97-4f53-45f6-b3d9-ce551c170c80 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:52.333870 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 832/1692] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:52.335251 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe4350-4587-4a2b-a2d7-28793f1fb274 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:52.335581 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe4350-4587-4a2b-a2d7-28793f1fb274 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:52.335867 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abe4350-4587-4a2b-a2d7-28793f1fb274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:52.344458 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 861/1693] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:52.350450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf841b97-4f53-45f6-b3d9-ce551c170c80 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:52.386215 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf841b97-4f53-45f6-b3d9-ce551c170c80 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:52.392302 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0abe4350-4587-4a2b-a2d7-28793f1fb274 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:52.395268 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0abe4350-4587-4a2b-a2d7-28793f1fb274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:52.398325 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288d6f4-36a2-42c2-b9a0-34a24b8ffd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:52.399844 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288d6f4-36a2-42c2-b9a0-34a24b8ffd5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:52.400100 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288d6f4-36a2-42c2-b9a0-34a24b8ffd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:52.400449 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3288d6f4-36a2-42c2-b9a0-34a24b8ffd5e admin admin] PATH_INFO: `/v3/projects/efc30aea41424085a13498818da651da/users/0873ddfe031d4140b1c5b9c4a6636b06/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:52.422053 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 833/1694] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:52.424121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe4350-4587-4a2b-a2d7-28793f1fb274 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:52.427828 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0abe4350-4587-4a2b-a2d7-28793f1fb274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:52.440061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288d6f4-36a2-42c2-b9a0-34a24b8ffd5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc30aea41424085a13498818da651da, user_id=0873ddfe031d4140b1c5b9c4a6636b06, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:52.442864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3288d6f4-36a2-42c2-b9a0-34a24b8ffd5e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:52.477927 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 862/1695] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:52 2022] PUT /identity/v3/projects/efc30aea41424085a13498818da651da/users/0873ddfe031d4140b1c5b9c4a6636b06/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:52.480045 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288d6f4-36a2-42c2-b9a0-34a24b8ffd5e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:52.560943 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:52.563475 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:52.599002 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abe4350-4587-4a2b-a2d7-28793f1fb274 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:52.649424 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3288d6f4-36a2-42c2-b9a0-34a24b8ffd5e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:52.659382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2085249-e3c6-4ba6-8bb7-35100650774d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:52.660475 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2085249-e3c6-4ba6-8bb7-35100650774d admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:52.660765 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2085249-e3c6-4ba6-8bb7-35100650774d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:52.661079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2085249-e3c6-4ba6-8bb7-35100650774d admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:52.661825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2085249-e3c6-4ba6-8bb7-35100650774d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:52.662710 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2085249-e3c6-4ba6-8bb7-35100650774d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:52.664136 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2085249-e3c6-4ba6-8bb7-35100650774d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:52.696825 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 863/1696] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:52.702192 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2085249-e3c6-4ba6-8bb7-35100650774d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:52.726531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2085249-e3c6-4ba6-8bb7-35100650774d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:52.729778 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af2eb3-45f1-4712-8ca0-69fb7f471b07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:52.732746 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af2eb3-45f1-4712-8ca0-69fb7f471b07 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:52.733301 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af2eb3-45f1-4712-8ca0-69fb7f471b07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:52.733836 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7af2eb3-45f1-4712-8ca0-69fb7f471b07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:52.747019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba616bdd-1a4a-4570-97b8-0a3c87cde3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:52.747888 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba616bdd-1a4a-4570-97b8-0a3c87cde3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:52.748170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba616bdd-1a4a-4570-97b8-0a3c87cde3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:52.748453 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba616bdd-1a4a-4570-97b8-0a3c87cde3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:52.749190 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba616bdd-1a4a-4570-97b8-0a3c87cde3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:52.754103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba616bdd-1a4a-4570-97b8-0a3c87cde3ad admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:52.760708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af2eb3-45f1-4712-8ca0-69fb7f471b07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:52.762915 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7af2eb3-45f1-4712-8ca0-69fb7f471b07 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:52.780979 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 864/1697] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:52.781848 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba616bdd-1a4a-4570-97b8-0a3c87cde3ad admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:52.788289 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 834/1698] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:52.789301 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af2eb3-45f1-4712-8ca0-69fb7f471b07 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:52.809162 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba616bdd-1a4a-4570-97b8-0a3c87cde3ad admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:52.829506 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7af2eb3-45f1-4712-8ca0-69fb7f471b07 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:52.831468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edab6a-6291-4d93-9617-f837b2e4408b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:52.831905 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edab6a-6291-4d93-9617-f837b2e4408b admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:52.832254 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edab6a-6291-4d93-9617-f837b2e4408b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:52.832543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49edab6a-6291-4d93-9617-f837b2e4408b admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:52.833383 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edab6a-6291-4d93-9617-f837b2e4408b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:52.840491 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49edab6a-6291-4d93-9617-f837b2e4408b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:52.849511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d11f78-083c-42a6-873a-5917ea9f0628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:52.850881 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d11f78-083c-42a6-873a-5917ea9f0628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:52.851448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d11f78-083c-42a6-873a-5917ea9f0628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:52.851950 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d11f78-083c-42a6-873a-5917ea9f0628 admin admin] PATH_INFO: `/v3/projects/efc30aea41424085a13498818da651da/users/0873ddfe031d4140b1c5b9c4a6636b06/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:52.866996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d11f78-083c-42a6-873a-5917ea9f0628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc30aea41424085a13498818da651da, user_id=0873ddfe031d4140b1c5b9c4a6636b06, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:52.874803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d11f78-083c-42a6-873a-5917ea9f0628 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:52.909761 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 835/1699] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:52 2022] PUT /identity/v3/projects/efc30aea41424085a13498818da651da/users/0873ddfe031d4140b1c5b9c4a6636b06/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:52.921244 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc49f3-7fd7-4eec-a53d-0d90db83133c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:52.921717 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc49f3-7fd7-4eec-a53d-0d90db83133c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:52.922194 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc49f3-7fd7-4eec-a53d-0d90db83133c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:52.925579 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 865/1700] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:52 2022] POST /identity/v3/projects => generated 357 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:52.929836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edab6a-6291-4d93-9617-f837b2e4408b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:53.006040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ecdc49f3-7fd7-4eec-a53d-0d90db83133c None None] MFA Rules not processed for user `0873ddfe031d4140b1c5b9c4a6636b06`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:53.011588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ecdc49f3-7fd7-4eec-a53d-0d90db83133c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:53.153067 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49edab6a-6291-4d93-9617-f837b2e4408b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:53.165958 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206788e-7469-41b1-a2ef-17f234c8601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:53.167547 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206788e-7469-41b1-a2ef-17f234c8601e admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:53.167837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206788e-7469-41b1-a2ef-17f234c8601e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:53.168113 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206788e-7469-41b1-a2ef-17f234c8601e admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:53.168823 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206788e-7469-41b1-a2ef-17f234c8601e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:53.174427 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206788e-7469-41b1-a2ef-17f234c8601e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:53.187020 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 836/1701] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:53.208740 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc49f3-7fd7-4eec-a53d-0d90db83133c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:53.219276 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ecdc49f3-7fd7-4eec-a53d-0d90db83133c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:53.228646 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 866/1702] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:52 2022] POST /identity/v3/users => generated 279 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:53.232989 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206788e-7469-41b1-a2ef-17f234c8601e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:53.262273 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206788e-7469-41b1-a2ef-17f234c8601e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:53.272954 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b171307-f2ac-42e3-af3d-543afe2210d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:53.273951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b171307-f2ac-42e3-af3d-543afe2210d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:53.276281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b171307-f2ac-42e3-af3d-543afe2210d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:53.277645 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b171307-f2ac-42e3-af3d-543afe2210d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:53.278393 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b171307-f2ac-42e3-af3d-543afe2210d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:53.281450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b171307-f2ac-42e3-af3d-543afe2210d9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:53.313561 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 867/1703] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:11:53.318891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b171307-f2ac-42e3-af3d-543afe2210d9 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:53.341512 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b171307-f2ac-42e3-af3d-543afe2210d9 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:53.367048 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed0ed1-9a6e-4a79-8273-37d4065c5b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:53.367640 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0ed1-9a6e-4a79-8273-37d4065c5b37 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:53.367906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0ed1-9a6e-4a79-8273-37d4065c5b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:53.368228 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed0ed1-9a6e-4a79-8273-37d4065c5b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:53.369078 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed0ed1-9a6e-4a79-8273-37d4065c5b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:53.373766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc49f3-7fd7-4eec-a53d-0d90db83133c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:53.376635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed0ed1-9a6e-4a79-8273-37d4065c5b37 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:53.384631 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d392c-67f7-412a-b688-a1e755cbe3e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:53.385440 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d392c-67f7-412a-b688-a1e755cbe3e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:53.387992 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d392c-67f7-412a-b688-a1e755cbe3e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:53.388306 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9d392c-67f7-412a-b688-a1e755cbe3e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:53.393277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8f9d392c-67f7-412a-b688-a1e755cbe3e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:53.410854 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 868/1704] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:53.415778 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed0ed1-9a6e-4a79-8273-37d4065c5b37 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:53.440648 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed0ed1-9a6e-4a79-8273-37d4065c5b37 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:53.451671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591bdd8b-0fdb-4181-9f3b-2e42ce284d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:53.458555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bdd8b-0fdb-4181-9f3b-2e42ce284d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:53.458845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bdd8b-0fdb-4181-9f3b-2e42ce284d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:53.459125 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591bdd8b-0fdb-4181-9f3b-2e42ce284d37 admin admin] PATH_INFO: `/v3/projects/da11855c351a48d6a68c1f4c157ab1c1/users/229483b90aa5441d89dc13536d9bd7f0/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:53.460396 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:53.510299 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bdd8b-0fdb-4181-9f3b-2e42ce284d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da11855c351a48d6a68c1f4c157ab1c1, user_id=229483b90aa5441d89dc13536d9bd7f0, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:53.521115 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591bdd8b-0fdb-4181-9f3b-2e42ce284d37 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:53.559462 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 869/1705] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:53 2022] PUT /identity/v3/projects/da11855c351a48d6a68c1f4c157ab1c1/users/229483b90aa5441d89dc13536d9bd7f0/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:53.559660 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d392c-67f7-412a-b688-a1e755cbe3e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:53.559660 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9d392c-67f7-412a-b688-a1e755cbe3e8 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:53.561978 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8450b-732b-4a8f-ac9e-31e3459fbbd2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:53.562952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8450b-732b-4a8f-ac9e-31e3459fbbd2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:53.562952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b8450b-732b-4a8f-ac9e-31e3459fbbd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:53.575984 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 837/1706] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:53.674916 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-81b8450b-732b-4a8f-ac9e-31e3459fbbd2 None None] MFA Rules not processed for user `229483b90aa5441d89dc13536d9bd7f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:53.680667 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-81b8450b-732b-4a8f-ac9e-31e3459fbbd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:53.712161 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:53.888293 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 870/1707] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:53 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:53.892226 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d392c-67f7-412a-b688-a1e755cbe3e8 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:53.915318 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9d392c-67f7-412a-b688-a1e755cbe3e8 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:54.054964 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9731bf1-efb6-4564-a80c-3dceb16ec0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:54.055845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9731bf1-efb6-4564-a80c-3dceb16ec0a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.056154 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9731bf1-efb6-4564-a80c-3dceb16ec0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.056432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9731bf1-efb6-4564-a80c-3dceb16ec0a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.057508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9731bf1-efb6-4564-a80c-3dceb16ec0a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:54.064451 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9731bf1-efb6-4564-a80c-3dceb16ec0a7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:54.133364 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 838/1708] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:53 2022] POST /identity/v3/projects => generated 355 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:54.134987 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8450b-732b-4a8f-ac9e-31e3459fbbd2 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:54.151762 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b8450b-732b-4a8f-ac9e-31e3459fbbd2 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:54.280320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20721315-d482-4acc-931a-fdf553d8d982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:54.289396 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721315-d482-4acc-931a-fdf553d8d982 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.289396 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721315-d482-4acc-931a-fdf553d8d982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.289396 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721315-d482-4acc-931a-fdf553d8d982 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.289396 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20721315-d482-4acc-931a-fdf553d8d982 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:54.289396 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20721315-d482-4acc-931a-fdf553d8d982 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:54.330067 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 871/1709] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:54 2022] POST /identity/v3/users => generated 284 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:54.333597 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9731bf1-efb6-4564-a80c-3dceb16ec0a7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:54.347788 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9731bf1-efb6-4564-a80c-3dceb16ec0a7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:54.354730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f1e899-dfd2-47e3-8543-952c5b40584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:54.355816 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1e899-dfd2-47e3-8543-952c5b40584b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.356292 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1e899-dfd2-47e3-8543-952c5b40584b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.356690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f1e899-dfd2-47e3-8543-952c5b40584b admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.357563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1e899-dfd2-47e3-8543-952c5b40584b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:54.360124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f1e899-dfd2-47e3-8543-952c5b40584b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:54.438445 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 839/1710] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:11:54.441354 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20721315-d482-4acc-931a-fdf553d8d982 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:54.459685 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77082f-7c4e-4388-bd84-dd6eca477240 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.460080 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77082f-7c4e-4388-bd84-dd6eca477240 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.460490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77082f-7c4e-4388-bd84-dd6eca477240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.463709 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20721315-d482-4acc-931a-fdf553d8d982 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:54.483903 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0700d1-9b43-469b-a7dc-26d68ddd2f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:54.488994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0700d1-9b43-469b-a7dc-26d68ddd2f5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.489940 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0700d1-9b43-469b-a7dc-26d68ddd2f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.494403 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0700d1-9b43-469b-a7dc-26d68ddd2f5e admin admin] PATH_INFO: `/v3/projects/efc40d483a13492d8c5a71f60eb6ee92/users/bdcdc45c27684ac5b0dde8581487e087/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.561381 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6b77082f-7c4e-4388-bd84-dd6eca477240 None None] MFA Rules not processed for user `1e7d0f401530454ba0cae0f5e9d6e0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:54.563243 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6b77082f-7c4e-4388-bd84-dd6eca477240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:54.563792 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0700d1-9b43-469b-a7dc-26d68ddd2f5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc40d483a13492d8c5a71f60eb6ee92, user_id=bdcdc45c27684ac5b0dde8581487e087, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:54.570910 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0700d1-9b43-469b-a7dc-26d68ddd2f5e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:54.604444 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 872/1711] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:54 2022] PUT /identity/v3/projects/efc40d483a13492d8c5a71f60eb6ee92/users/bdcdc45c27684ac5b0dde8581487e087/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:54.607666 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b04a-81fe-4fc9-baa5-83af780340dc None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.608399 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b04a-81fe-4fc9-baa5-83af780340dc None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.608855 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce9b04a-81fe-4fc9-baa5-83af780340dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.645605 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1ce9b04a-81fe-4fc9-baa5-83af780340dc None None] MFA Rules not processed for user `2d7d2c987db04aaabc0d75c1930f9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:54.647925 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1ce9b04a-81fe-4fc9-baa5-83af780340dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:54.727173 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 840/1712] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:54.728885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77082f-7c4e-4388-bd84-dd6eca477240 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:54.753780 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77082f-7c4e-4388-bd84-dd6eca477240 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:54.819898 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 873/1713] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:54.820558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9b04a-81fe-4fc9-baa5-83af780340dc None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:54.833989 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1ce9b04a-81fe-4fc9-baa5-83af780340dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:54.837142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:54.858170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:54.920829 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf37aec5-4c8d-4470-9962-48e7f9d8521c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:54.921547 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37aec5-4c8d-4470-9962-48e7f9d8521c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.921967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37aec5-4c8d-4470-9962-48e7f9d8521c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.922256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf37aec5-4c8d-4470-9962-48e7f9d8521c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.923010 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37aec5-4c8d-4470-9962-48e7f9d8521c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:54.924725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf37aec5-4c8d-4470-9962-48e7f9d8521c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:54.957301 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 841/1714] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:54.959881 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0573f-8569-4347-83a0-b92b59965e17 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.960377 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0573f-8569-4347-83a0-b92b59965e17 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:54.960803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e0573f-8569-4347-83a0-b92b59965e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:54.985329 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-32e0573f-8569-4347-83a0-b92b59965e17 None None] MFA Rules not processed for user `2d7d2c987db04aaabc0d75c1930f9c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:54.986842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-32e0573f-8569-4347-83a0-b92b59965e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:54.997014 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 842/1715] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:54.997148 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce9b04a-81fe-4fc9-baa5-83af780340dc None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:54.999496 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae6fcb-a51b-4a00-a3df-da5c3646e83b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:54.999971 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae6fcb-a51b-4a00-a3df-da5c3646e83b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:55.000498 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae6fcb-a51b-4a00-a3df-da5c3646e83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:55.011211 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6cd1f-d9c0-4ee1-81e9-e29848e09327 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:55.013683 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6cd1f-d9c0-4ee1-81e9-e29848e09327 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:55.013971 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6cd1f-d9c0-4ee1-81e9-e29848e09327 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:55.014254 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b6cd1f-d9c0-4ee1-81e9-e29848e09327 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:55.036394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0cae6fcb-a51b-4a00-a3df-da5c3646e83b None None] MFA Rules not processed for user `601f4db65bf74587ab9b0080a44b4f79`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:55.038899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0cae6fcb-a51b-4a00-a3df-da5c3646e83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:55.170391 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6cd1f-d9c0-4ee1-81e9-e29848e09327 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:55.176204 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b6cd1f-d9c0-4ee1-81e9-e29848e09327 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:55.192527 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 843/1716] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:55.193047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae6fcb-a51b-4a00-a3df-da5c3646e83b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:55.209230 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 874/1717] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:55.210301 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6cd1f-d9c0-4ee1-81e9-e29848e09327 service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:55.211236 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-32b6cd1f-d9c0-4ee1-81e9-e29848e09327 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:55.222562 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae6fcb-a51b-4a00-a3df-da5c3646e83b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:55.237555 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda09b72-d71c-495e-b24e-a0aa340d8087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:55.241767 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda09b72-d71c-495e-b24e-a0aa340d8087 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:55.242060 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda09b72-d71c-495e-b24e-a0aa340d8087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:55.242344 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda09b72-d71c-495e-b24e-a0aa340d8087 admin admin] PATH_INFO: `/v3/projects/efc40d483a13492d8c5a71f60eb6ee92/users/bdcdc45c27684ac5b0dde8581487e087/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:55.253646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda09b72-d71c-495e-b24e-a0aa340d8087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc40d483a13492d8c5a71f60eb6ee92, user_id=bdcdc45c27684ac5b0dde8581487e087, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:55.254577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b6cd1f-d9c0-4ee1-81e9-e29848e09327 service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:55.257432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda09b72-d71c-495e-b24e-a0aa340d8087 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:55.262764 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7009fa7-e878-4e00-ac8c-49a83ada7ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:55.266413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7009fa7-e878-4e00-ac8c-49a83ada7ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:55.267077 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7009fa7-e878-4e00-ac8c-49a83ada7ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:55.267182 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7009fa7-e878-4e00-ac8c-49a83ada7ef2 admin admin] PATH_INFO: `/v3/projects/8d009cdd7cc94c608822a47c67390104` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:55.270031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7009fa7-e878-4e00-ac8c-49a83ada7ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d009cdd7cc94c608822a47c67390104)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:55.274275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7009fa7-e878-4e00-ac8c-49a83ada7ef2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:55.311425 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 844/1718] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:55 2022] PUT /identity/v3/projects/efc40d483a13492d8c5a71f60eb6ee92/users/bdcdc45c27684ac5b0dde8581487e087/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:55.311425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda09b72-d71c-495e-b24e-a0aa340d8087 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:55.318356 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cda09b72-d71c-495e-b24e-a0aa340d8087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:55.370273 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a7009fa7-e878-4e00-ac8c-49a83ada7ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d009cdd7cc94c608822a47c67390104', 'request_id': 'req-a7009fa7-e878-4e00-ac8c-49a83ada7ef2'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:55.391576 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a7009fa7-e878-4e00-ac8c-49a83ada7ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d009cdd7cc94c608822a47c67390104', 'request_id': 'req-a7009fa7-e878-4e00-ac8c-49a83ada7ef2'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:55.414460 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a7009fa7-e878-4e00-ac8c-49a83ada7ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d009cdd7cc94c608822a47c67390104', 'request_id': 'req-a7009fa7-e878-4e00-ac8c-49a83ada7ef2'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:55.436436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a7009fa7-e878-4e00-ac8c-49a83ada7ef2 admin admin] The token cache is being invalidate because project 8d009cdd7cc94c608822a47c67390104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:11:55.437222 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a7009fa7-e878-4e00-ac8c-49a83ada7ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:55.438972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a7009fa7-e878-4e00-ac8c-49a83ada7ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:55.441277 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 875/1719] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:11:55 2022] DELETE /identity/v3/projects/8d009cdd7cc94c608822a47c67390104 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:55.442705 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c3de9-d816-4eca-9cc7-11499e97588a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:55.443051 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c3de9-d816-4eca-9cc7-11499e97588a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:55.443350 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c3de9-d816-4eca-9cc7-11499e97588a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:55.514458 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d16c3de9-d816-4eca-9cc7-11499e97588a None None] MFA Rules not processed for user `bdcdc45c27684ac5b0dde8581487e087`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:55.515833 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d16c3de9-d816-4eca-9cc7-11499e97588a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:55.528964 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda09b72-d71c-495e-b24e-a0aa340d8087 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:55.548590 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:55.582157 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:55.649570 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179843c-afe3-463b-be7b-9c910acc141f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:55.650405 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179843c-afe3-463b-be7b-9c910acc141f service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:55.650694 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179843c-afe3-463b-be7b-9c910acc141f service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:55.650973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179843c-afe3-463b-be7b-9c910acc141f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:55.653099 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e179843c-afe3-463b-be7b-9c910acc141f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:55.672758 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 876/1720] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:55 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:55.674443 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafe906-d901-4407-9490-0721a5ca00fb None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:55.674950 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafe906-d901-4407-9490-0721a5ca00fb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:55.675339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bafe906-d901-4407-9490-0721a5ca00fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:55.703183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0bafe906-d901-4407-9490-0721a5ca00fb None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:55.705602 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0bafe906-d901-4407-9490-0721a5ca00fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:55.752149 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179843c-afe3-463b-be7b-9c910acc141f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:55.754232 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179843c-afe3-463b-be7b-9c910acc141f service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:55.767119 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 845/1721] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:55.768341 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179843c-afe3-463b-be7b-9c910acc141f service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:55.769935 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e179843c-afe3-463b-be7b-9c910acc141f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:55.786067 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179843c-afe3-463b-be7b-9c910acc141f service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:55.793120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14064a93-c46f-43fa-ae74-8e9b336db809 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:55.803312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14064a93-c46f-43fa-ae74-8e9b336db809 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:55.803312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14064a93-c46f-43fa-ae74-8e9b336db809 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:55.803312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14064a93-c46f-43fa-ae74-8e9b336db809 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:55.806003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-14064a93-c46f-43fa-ae74-8e9b336db809 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:55.806554 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 877/1722] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:55.808003 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5e764-8630-4912-b4a9-458467418e4f None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:55.808441 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5e764-8630-4912-b4a9-458467418e4f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:55.808733 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5e764-8630-4912-b4a9-458467418e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:55.871045 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-27d5e764-8630-4912-b4a9-458467418e4f None None] MFA Rules not processed for user `1b8154ce6b6b40b4959bf354ccb5c59d`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:55.872807 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-27d5e764-8630-4912-b4a9-458467418e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:55.949286 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14064a93-c46f-43fa-ae74-8e9b336db809 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:55.953297 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14064a93-c46f-43fa-ae74-8e9b336db809 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:55.977543 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 846/1723] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:55.986755 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14064a93-c46f-43fa-ae74-8e9b336db809 service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:55.998977 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-14064a93-c46f-43fa-ae74-8e9b336db809 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:56.073539 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 878/1724] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:56.074799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5e764-8630-4912-b4a9-458467418e4f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:56.076910 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-27d5e764-8630-4912-b4a9-458467418e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:56.157880 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14064a93-c46f-43fa-ae74-8e9b336db809 service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:56.170328 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74dbc8-9026-4994-b74e-550603b672c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:56.173106 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74dbc8-9026-4994-b74e-550603b672c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:56.174028 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74dbc8-9026-4994-b74e-550603b672c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:56.174803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74dbc8-9026-4994-b74e-550603b672c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:56.180545 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-aa74dbc8-9026-4994-b74e-550603b672c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:56.199277 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:56.212110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d5e764-8630-4912-b4a9-458467418e4f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:56.226396 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0b749f-33db-4a1d-ab3b-c129a41866c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:56.227208 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b749f-33db-4a1d-ab3b-c129a41866c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:56.227582 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b749f-33db-4a1d-ab3b-c129a41866c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:56.228908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0b749f-33db-4a1d-ab3b-c129a41866c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:56.238710 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:56.256528 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b749f-33db-4a1d-ab3b-c129a41866c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:56.260559 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0b749f-33db-4a1d-ab3b-c129a41866c2 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:56.318927 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 879/1725] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:56 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:56.326378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0eb7c4-0c52-4651-81c0-310d016e5d13 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:56.326687 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0eb7c4-0c52-4651-81c0-310d016e5d13 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:56.327109 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0eb7c4-0c52-4651-81c0-310d016e5d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:56.374344 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1a0eb7c4-0c52-4651-81c0-310d016e5d13 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:56.376982 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1a0eb7c4-0c52-4651-81c0-310d016e5d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:56.379099 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74dbc8-9026-4994-b74e-550603b672c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:56.381229 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74dbc8-9026-4994-b74e-550603b672c1 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:56.397844 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 847/1726] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:55 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:56.399283 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1625283-1f54-4657-8903-468b20df3942 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:56.400256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1625283-1f54-4657-8903-468b20df3942 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:56.400537 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1625283-1f54-4657-8903-468b20df3942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:56.419944 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 880/1727] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:56.421514 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0eb7c4-0c52-4651-81c0-310d016e5d13 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:56.445058 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b1625283-1f54-4657-8903-468b20df3942 None None] MFA Rules not processed for user `1b8154ce6b6b40b4959bf354ccb5c59d`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:56.446403 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b1625283-1f54-4657-8903-468b20df3942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:56.459539 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0eb7c4-0c52-4651-81c0-310d016e5d13 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:56.460251 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 848/1728] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:56 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:56.476169 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce565a1-e7f3-49eb-b7bf-62a6c72ee7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:56.477097 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce565a1-e7f3-49eb-b7bf-62a6c72ee7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:56.477593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce565a1-e7f3-49eb-b7bf-62a6c72ee7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:56.479031 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1625283-1f54-4657-8903-468b20df3942 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:56.479575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce565a1-e7f3-49eb-b7bf-62a6c72ee7d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:56.481202 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce565a1-e7f3-49eb-b7bf-62a6c72ee7d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:11:56.481525 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce565a1-e7f3-49eb-b7bf-62a6c72ee7d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:56.489459 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce565a1-e7f3-49eb-b7bf-62a6c72ee7d5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:56.509019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1625283-1f54-4657-8903-468b20df3942 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:56.524787 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63aefa-c609-44e7-9fce-6be023dc8a72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:56.525491 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63aefa-c609-44e7-9fce-6be023dc8a72 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:56.526890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63aefa-c609-44e7-9fce-6be023dc8a72 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:56.527187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f63aefa-c609-44e7-9fce-6be023dc8a72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:56.531193 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 881/1729] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:11:56.535890 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce565a1-e7f3-49eb-b7bf-62a6c72ee7d5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:56.552580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63aefa-c609-44e7-9fce-6be023dc8a72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:56.556529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f63aefa-c609-44e7-9fce-6be023dc8a72 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:56.557314 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce565a1-e7f3-49eb-b7bf-62a6c72ee7d5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:56.570624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1759b6-fabf-498a-a7dd-8f4594c8d8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:56.571618 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1759b6-fabf-498a-a7dd-8f4594c8d8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:56.573174 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1759b6-fabf-498a-a7dd-8f4594c8d8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:56.574271 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1759b6-fabf-498a-a7dd-8f4594c8d8f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:56.576664 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1759b6-fabf-498a-a7dd-8f4594c8d8f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:56.588902 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1759b6-fabf-498a-a7dd-8f4594c8d8f8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:56.605208 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 849/1730] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:11:56.610236 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63aefa-c609-44e7-9fce-6be023dc8a72 service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:56.663852 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f63aefa-c609-44e7-9fce-6be023dc8a72 service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:56.670783 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 882/1731] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:56 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:56.675403 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1759b6-fabf-498a-a7dd-8f4594c8d8f8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:56.823765 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217448b-7a95-4b4b-92fd-111c06fef34b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:56.826761 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217448b-7a95-4b4b-92fd-111c06fef34b service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:56.827142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217448b-7a95-4b4b-92fd-111c06fef34b service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:56.828052 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217448b-7a95-4b4b-92fd-111c06fef34b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:56.832490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3217448b-7a95-4b4b-92fd-111c06fef34b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:56.936350 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1759b6-fabf-498a-a7dd-8f4594c8d8f8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:56.958097 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be830516-d97d-487b-9e76-26be260001ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:56.959876 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be830516-d97d-487b-9e76-26be260001ab admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:56.962439 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be830516-d97d-487b-9e76-26be260001ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:56.962905 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be830516-d97d-487b-9e76-26be260001ab admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:56.965019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be830516-d97d-487b-9e76-26be260001ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:56.971896 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be830516-d97d-487b-9e76-26be260001ab admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:56.998029 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217448b-7a95-4b4b-92fd-111c06fef34b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:57.003355 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217448b-7a95-4b4b-92fd-111c06fef34b service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:57.016914 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 883/1732] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:56 2022] POST /identity/v3/users => generated 294 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:57.020495 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be830516-d97d-487b-9e76-26be260001ab admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:57.035878 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 850/1733] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:56 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:57.046062 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be830516-d97d-487b-9e76-26be260001ab admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:57.064106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fc4a2-518e-4073-afa3-4b5ae1469751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:57.064816 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fc4a2-518e-4073-afa3-4b5ae1469751 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:57.065167 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fc4a2-518e-4073-afa3-4b5ae1469751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:57.069988 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497fc4a2-518e-4073-afa3-4b5ae1469751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:57.070820 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fc4a2-518e-4073-afa3-4b5ae1469751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:57.072864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497fc4a2-518e-4073-afa3-4b5ae1469751 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:57.099334 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 884/1734] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:57.100693 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217448b-7a95-4b4b-92fd-111c06fef34b service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:57.130892 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217448b-7a95-4b4b-92fd-111c06fef34b service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:57.140411 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43a30b0-3bda-4bd4-a7bd-891b3af412bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:57.143632 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a30b0-3bda-4bd4-a7bd-891b3af412bd admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:57.143939 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a30b0-3bda-4bd4-a7bd-891b3af412bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:57.144282 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43a30b0-3bda-4bd4-a7bd-891b3af412bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:57.153601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a30b0-3bda-4bd4-a7bd-891b3af412bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:57.163468 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43a30b0-3bda-4bd4-a7bd-891b3af412bd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:57.241832 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 851/1735] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:57.245982 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fc4a2-518e-4073-afa3-4b5ae1469751 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:57.273961 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497fc4a2-518e-4073-afa3-4b5ae1469751 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:57.284492 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73ee713-3f75-43b3-956f-9a80e2febd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:57.285526 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ee713-3f75-43b3-956f-9a80e2febd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:57.285822 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ee713-3f75-43b3-956f-9a80e2febd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:57.286095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73ee713-3f75-43b3-956f-9a80e2febd07 admin admin] PATH_INFO: `/v3/projects/b7d87889d80742cc83fa41ae1e153a71/users/3380570df83543faaead2ff7996f414b/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:57.352655 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ee713-3f75-43b3-956f-9a80e2febd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d87889d80742cc83fa41ae1e153a71, user_id=3380570df83543faaead2ff7996f414b, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:57.362310 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73ee713-3f75-43b3-956f-9a80e2febd07 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:57.417544 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 885/1736] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:57 2022] PUT /identity/v3/projects/b7d87889d80742cc83fa41ae1e153a71/users/3380570df83543faaead2ff7996f414b/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:57.431508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236ff52-c0b8-47b0-9dbc-ebb61f7eef97 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:57.431833 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236ff52-c0b8-47b0-9dbc-ebb61f7eef97 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:57.432120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c236ff52-c0b8-47b0-9dbc-ebb61f7eef97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:57.522641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c236ff52-c0b8-47b0-9dbc-ebb61f7eef97 None None] MFA Rules not processed for user `3380570df83543faaead2ff7996f414b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:57.531683 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c236ff52-c0b8-47b0-9dbc-ebb61f7eef97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:57.657845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff626f00-ac24-4e02-93e3-70a20dc2e181 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:57.658932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff626f00-ac24-4e02-93e3-70a20dc2e181 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:57.658932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff626f00-ac24-4e02-93e3-70a20dc2e181 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:57.660177 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 886/1737] 10.222.0.42 () {54 vars in 912 bytes} [Sun Jul 24 01:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:11:57.677219 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc74c-d30b-4346-8562-b662b108c3cb None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:57.677514 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc74c-d30b-4346-8562-b662b108c3cb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:57.677834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdbc74c-d30b-4346-8562-b662b108c3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:57.688508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:57.766593 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 852/1738] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:57.769371 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236ff52-c0b8-47b0-9dbc-ebb61f7eef97 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:57.817056 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1cdbc74c-d30b-4346-8562-b662b108c3cb None None] MFA Rules not processed for user `a3efd3928e334e78b4c87bb695718299`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:57.818448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1cdbc74c-d30b-4346-8562-b662b108c3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:57.953492 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:57.970880 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 887/1739] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:11:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:11:57.972523 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d2c2d-d23d-45e9-96c6-bb725698ce78 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:57.972977 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d2c2d-d23d-45e9-96c6-bb725698ce78 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:57.973381 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2d2c2d-d23d-45e9-96c6-bb725698ce78 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:57.975074 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 888/1740] 10.222.0.42 () {54 vars in 912 bytes} [Sun Jul 24 01:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:11:57.980490 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0f7fe-b311-45ec-bd83-e86c5fbe54cb None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:57.981575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0f7fe-b311-45ec-bd83-e86c5fbe54cb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:57.981882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e0f7fe-b311-45ec-bd83-e86c5fbe54cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:58.006392 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c1e0f7fe-b311-45ec-bd83-e86c5fbe54cb None None] MFA Rules not processed for user `a3efd3928e334e78b4c87bb695718299`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:58.008041 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c1e0f7fe-b311-45ec-bd83-e86c5fbe54cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:58.014377 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c236ff52-c0b8-47b0-9dbc-ebb61f7eef97 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:58.032561 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa23690-6b69-47a3-8851-e1630e27d914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:58.032561 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa23690-6b69-47a3-8851-e1630e27d914 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:58.032561 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa23690-6b69-47a3-8851-e1630e27d914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:58.032561 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa23690-6b69-47a3-8851-e1630e27d914 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:58.032864 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa23690-6b69-47a3-8851-e1630e27d914 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:58.035067 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa23690-6b69-47a3-8851-e1630e27d914 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:58.041379 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 889/1741] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:11:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:58.044425 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0f7fe-b311-45ec-bd83-e86c5fbe54cb None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:58.050796 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c1e0f7fe-b311-45ec-bd83-e86c5fbe54cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:58.099496 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e0f7fe-b311-45ec-bd83-e86c5fbe54cb None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:58.110246 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33420694-6907-4dc3-a16d-154bf8fb2ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:58.111028 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33420694-6907-4dc3-a16d-154bf8fb2ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:58.113792 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33420694-6907-4dc3-a16d-154bf8fb2ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:58.114868 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33420694-6907-4dc3-a16d-154bf8fb2ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:58.145233 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33420694-6907-4dc3-a16d-154bf8fb2ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:58.152063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33420694-6907-4dc3-a16d-154bf8fb2ed0 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:58.172019 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 853/1742] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:11:57 2022] POST /identity/v3/projects => generated 387 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:58.175865 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa23690-6b69-47a3-8851-e1630e27d914 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:58.196325 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 890/1743] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:11:58.197177 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33420694-6907-4dc3-a16d-154bf8fb2ed0 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:58.219446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33420694-6907-4dc3-a16d-154bf8fb2ed0 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:58.320725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa23690-6b69-47a3-8851-e1630e27d914 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:58.334367 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac4e30-3610-422f-a863-52d3c9ae8581 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:58.335097 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac4e30-3610-422f-a863-52d3c9ae8581 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:58.335406 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac4e30-3610-422f-a863-52d3c9ae8581 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:58.335689 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac4e30-3610-422f-a863-52d3c9ae8581 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:58.362499 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac4e30-3610-422f-a863-52d3c9ae8581 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:58.369469 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac4e30-3610-422f-a863-52d3c9ae8581 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:58.391105 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b261b5f-56af-4093-a875-f54b2fe2f302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:58.391968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b261b5f-56af-4093-a875-f54b2fe2f302 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:58.392344 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b261b5f-56af-4093-a875-f54b2fe2f302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:58.392737 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b261b5f-56af-4093-a875-f54b2fe2f302 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:58.393549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b261b5f-56af-4093-a875-f54b2fe2f302 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:58.399495 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b261b5f-56af-4093-a875-f54b2fe2f302 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:58.413542 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 854/1744] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:11:58.453440 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 891/1745] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:11:58 2022] POST /identity/v3/users => generated 300 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:11:58.457668 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac4e30-3610-422f-a863-52d3c9ae8581 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:58.479225 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac4e30-3610-422f-a863-52d3c9ae8581 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:58.498719 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e78e8-7048-4992-83be-bc83906dbb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:58.499459 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e78e8-7048-4992-83be-bc83906dbb53 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:58.499745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e78e8-7048-4992-83be-bc83906dbb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:58.500022 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e78e8-7048-4992-83be-bc83906dbb53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:58.505894 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e78e8-7048-4992-83be-bc83906dbb53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:58.516588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e78e8-7048-4992-83be-bc83906dbb53 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:58.551975 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 855/1746] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:58.557205 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b261b5f-56af-4093-a875-f54b2fe2f302 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:58.571575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b261b5f-56af-4093-a875-f54b2fe2f302 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:58.595232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134facd-c99a-49e8-b26c-3c29cca14b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:58.596648 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134facd-c99a-49e8-b26c-3c29cca14b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:58.596925 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134facd-c99a-49e8-b26c-3c29cca14b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:58.597365 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134facd-c99a-49e8-b26c-3c29cca14b91 admin admin] PATH_INFO: `/v3/projects/e1ead54cefd1462faac205e80a6e9fc3/users/e364242712ee45b39d11f144040c77b6/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:58.639240 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134facd-c99a-49e8-b26c-3c29cca14b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ead54cefd1462faac205e80a6e9fc3, user_id=e364242712ee45b39d11f144040c77b6, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:58.646281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6134facd-c99a-49e8-b26c-3c29cca14b91 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:58.680618 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 892/1747] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:58 2022] PUT /identity/v3/projects/e1ead54cefd1462faac205e80a6e9fc3/users/e364242712ee45b39d11f144040c77b6/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:58.681734 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e78e8-7048-4992-83be-bc83906dbb53 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:58.696215 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e78e8-7048-4992-83be-bc83906dbb53 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:58.855477 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:58.916131 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2142a-831e-4d84-9e79-16e0f5057b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:58.916845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2142a-831e-4d84-9e79-16e0f5057b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:58.917128 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2142a-831e-4d84-9e79-16e0f5057b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:58.917408 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2142a-831e-4d84-9e79-16e0f5057b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:58.918143 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2142a-831e-4d84-9e79-16e0f5057b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:58.939644 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2142a-831e-4d84-9e79-16e0f5057b38 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:59.024484 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 856/1748] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:11:58 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:11:59.027126 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134facd-c99a-49e8-b26c-3c29cca14b91 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:59.046995 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134facd-c99a-49e8-b26c-3c29cca14b91 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:59.057632 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87199570-cc98-4c81-8466-44f2b64e8c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:59.064248 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87199570-cc98-4c81-8466-44f2b64e8c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:59.064844 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87199570-cc98-4c81-8466-44f2b64e8c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:59.066956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87199570-cc98-4c81-8466-44f2b64e8c8d admin admin] PATH_INFO: `/v3/projects/e1ead54cefd1462faac205e80a6e9fc3/users/e364242712ee45b39d11f144040c77b6/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:59.073716 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87199570-cc98-4c81-8466-44f2b64e8c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1ead54cefd1462faac205e80a6e9fc3, user_id=e364242712ee45b39d11f144040c77b6, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:59.087797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87199570-cc98-4c81-8466-44f2b64e8c8d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:59.134276 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c19276-30e5-424b-9695-559f84e6c4e4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:59.134417 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 893/1749] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:11:59 2022] PUT /identity/v3/projects/e1ead54cefd1462faac205e80a6e9fc3/users/e364242712ee45b39d11f144040c77b6/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:11:59.135330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c19276-30e5-424b-9695-559f84e6c4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:59.135330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c19276-30e5-424b-9695-559f84e6c4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:59.189636 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87199570-cc98-4c81-8466-44f2b64e8c8d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:59.191842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-87199570-cc98-4c81-8466-44f2b64e8c8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:59.236038 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-19c19276-30e5-424b-9695-559f84e6c4e4 None None] MFA Rules not processed for user `e364242712ee45b39d11f144040c77b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:59.240980 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-19c19276-30e5-424b-9695-559f84e6c4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:59.401548 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87199570-cc98-4c81-8466-44f2b64e8c8d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:59.417378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002070cb-9043-43eb-ac8c-99a1e6623cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:59.418568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002070cb-9043-43eb-ac8c-99a1e6623cba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:59.418823 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002070cb-9043-43eb-ac8c-99a1e6623cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:59.419161 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002070cb-9043-43eb-ac8c-99a1e6623cba admin admin] PATH_INFO: `/v3/users/a35cd458a02d42d1b1474d2383677221` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:59.425169 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002070cb-9043-43eb-ac8c-99a1e6623cba admin admin] RBAC: Authorizing `identity:delete_user(user_id=a35cd458a02d42d1b1474d2383677221)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:59.427436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002070cb-9043-43eb-ac8c-99a1e6623cba admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:59.477508 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 857/1750] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:59.494413 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c19276-30e5-424b-9695-559f84e6c4e4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:59.530662 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:59.557543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-002070cb-9043-43eb-ac8c-99a1e6623cba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a35cd458a02d42d1b1474d2383677221'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:59.558340 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-002070cb-9043-43eb-ac8c-99a1e6623cba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a35cd458a02d42d1b1474d2383677221'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:59.572541 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-002070cb-9043-43eb-ac8c-99a1e6623cba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a35cd458a02d42d1b1474d2383677221'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:59.574391 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-002070cb-9043-43eb-ac8c-99a1e6623cba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a35cd458a02d42d1b1474d2383677221'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:59.585398 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-002070cb-9043-43eb-ac8c-99a1e6623cba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a35cd458a02d42d1b1474d2383677221'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:11:59.655039 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 894/1751] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:11:59 2022] DELETE /identity/v3/users/a35cd458a02d42d1b1474d2383677221 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:11:59.659786 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4c96e-e25e-4cbb-a6ef-04b259aed91e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:59.660088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4c96e-e25e-4cbb-a6ef-04b259aed91e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:59.660417 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4c96e-e25e-4cbb-a6ef-04b259aed91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:59.686766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c19276-30e5-424b-9695-559f84e6c4e4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:11:59.716189 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a5e4c96e-e25e-4cbb-a6ef-04b259aed91e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:11:59.717471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a5e4c96e-e25e-4cbb-a6ef-04b259aed91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:59.766434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b46e1-4a8d-406b-91e4-427a99302011 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:11:59.767435 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b46e1-4a8d-406b-91e4-427a99302011 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:11:59.767818 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b46e1-4a8d-406b-91e4-427a99302011 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:11:59.768191 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b46e1-4a8d-406b-91e4-427a99302011 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:11:59.770254 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b62b46e1-4a8d-406b-91e4-427a99302011 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:11:59.892030 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:11:59.921206 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 895/1752] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:11:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:11:59.949814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b46e1-4a8d-406b-91e4-427a99302011 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:11:59.958531 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b46e1-4a8d-406b-91e4-427a99302011 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:11:59.970551 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4c96e-e25e-4cbb-a6ef-04b259aed91e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:11:59.972270 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a5e4c96e-e25e-4cbb-a6ef-04b259aed91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:00.013118 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 858/1753] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:00.120652 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b46e1-4a8d-406b-91e4-427a99302011 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:00.123075 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b62b46e1-4a8d-406b-91e4-427a99302011 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:00.189711 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b46e1-4a8d-406b-91e4-427a99302011 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:00.203736 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e4c96e-e25e-4cbb-a6ef-04b259aed91e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:00.223168 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b8b0a-e599-4e86-8fa1-72554f0b4582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:00.231008 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18200998-c6c3-4640-abb7-cf4c25477fa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:00.232147 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18200998-c6c3-4640-abb7-cf4c25477fa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:00.232454 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18200998-c6c3-4640-abb7-cf4c25477fa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:00.232737 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18200998-c6c3-4640-abb7-cf4c25477fa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:00.235767 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b8b0a-e599-4e86-8fa1-72554f0b4582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:00.236128 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b8b0a-e599-4e86-8fa1-72554f0b4582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:00.236413 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b8b0a-e599-4e86-8fa1-72554f0b4582 admin admin] PATH_INFO: `/v3/users/3380570df83543faaead2ff7996f414b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:00.243811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b8b0a-e599-4e86-8fa1-72554f0b4582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3380570df83543faaead2ff7996f414b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:00.251438 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b8b0a-e599-4e86-8fa1-72554f0b4582 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:00.259271 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18200998-c6c3-4640-abb7-cf4c25477fa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:00.262217 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18200998-c6c3-4640-abb7-cf4c25477fa9 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:00.310440 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 896/1754] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:11:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:12:00.444738 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8d6b8b0a-e599-4e86-8fa1-72554f0b4582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3380570df83543faaead2ff7996f414b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:00.447385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8d6b8b0a-e599-4e86-8fa1-72554f0b4582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3380570df83543faaead2ff7996f414b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:00.449701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8d6b8b0a-e599-4e86-8fa1-72554f0b4582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3380570df83543faaead2ff7996f414b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:00.472195 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8d6b8b0a-e599-4e86-8fa1-72554f0b4582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3380570df83543faaead2ff7996f414b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:00.493249 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8d6b8b0a-e599-4e86-8fa1-72554f0b4582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3380570df83543faaead2ff7996f414b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:00.522748 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856b03b-e4e0-4b12-8f0d-0f0835d24a85 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:00.523033 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856b03b-e4e0-4b12-8f0d-0f0835d24a85 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:00.523649 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e856b03b-e4e0-4b12-8f0d-0f0835d24a85 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:00.525880 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 897/1755] 10.222.0.42 () {54 vars in 961 bytes} [Sun Jul 24 01:12:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:12:00.528304 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 859/1756] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:00 2022] DELETE /identity/v3/users/3380570df83543faaead2ff7996f414b => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:00.532738 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9fcaa-7a83-498c-94cb-123e070d5fa3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:00.533569 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9fcaa-7a83-498c-94cb-123e070d5fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:00.534201 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f9fcaa-7a83-498c-94cb-123e070d5fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:00.538152 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14208b54-2c0e-47e2-8fc2-4d4f4913c6d1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:00.542251 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14208b54-2c0e-47e2-8fc2-4d4f4913c6d1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:00.544357 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14208b54-2c0e-47e2-8fc2-4d4f4913c6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:00.586316 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-74f9fcaa-7a83-498c-94cb-123e070d5fa3 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:00.587593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-74f9fcaa-7a83-498c-94cb-123e070d5fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:00.607081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-14208b54-2c0e-47e2-8fc2-4d4f4913c6d1 None None] MFA Rules not processed for user `333db0711d0f41fe8066ba5b9d91dacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:00.608400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-14208b54-2c0e-47e2-8fc2-4d4f4913c6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:00.720813 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:00.750870 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 898/1757] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:00.774890 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9fcaa-7a83-498c-94cb-123e070d5fa3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:00.776630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-74f9fcaa-7a83-498c-94cb-123e070d5fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:00.787486 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 860/1758] 10.222.0.42 () {58 vars in 1058 bytes} [Sun Jul 24 01:12:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:00.813954 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15963901-066a-4447-b93c-54bf7d6a5c00 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:00.813954 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15963901-066a-4447-b93c-54bf7d6a5c00 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:00.813954 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15963901-066a-4447-b93c-54bf7d6a5c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:00.860988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-15963901-066a-4447-b93c-54bf7d6a5c00 None None] MFA Rules not processed for user `601f4db65bf74587ab9b0080a44b4f79`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:00.864746 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-15963901-066a-4447-b93c-54bf7d6a5c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:00.899102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f9fcaa-7a83-498c-94cb-123e070d5fa3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:00.909734 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bb6b1-ed1b-4547-8ac9-648e43554149 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:00.910750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bb6b1-ed1b-4547-8ac9-648e43554149 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:00.911478 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bb6b1-ed1b-4547-8ac9-648e43554149 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:00.911841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bb6b1-ed1b-4547-8ac9-648e43554149 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:00.923218 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bb6b1-ed1b-4547-8ac9-648e43554149 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:00.924981 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3bb6b1-ed1b-4547-8ac9-648e43554149 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:00.938541 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 899/1759] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:12:00.939838 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bb6b1-ed1b-4547-8ac9-648e43554149 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:00.954346 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bb6b1-ed1b-4547-8ac9-648e43554149 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:00.963819 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25efec4-bf22-4c8e-bf98-d0bc18cd55ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333db0711d0f41fe8066ba5b9d91dacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:00.965252 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25efec4-bf22-4c8e-bf98-d0bc18cd55ad service placement] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:00.965778 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25efec4-bf22-4c8e-bf98-d0bc18cd55ad service placement] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:00.966283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25efec4-bf22-4c8e-bf98-d0bc18cd55ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:00.971321 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f25efec4-bf22-4c8e-bf98-d0bc18cd55ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:00.988891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25efec4-bf22-4c8e-bf98-d0bc18cd55ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:00.990912 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25efec4-bf22-4c8e-bf98-d0bc18cd55ad service placement] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:01.022481 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 900/1760] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:01.038287 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25efec4-bf22-4c8e-bf98-d0bc18cd55ad service placement] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:01.040889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f25efec4-bf22-4c8e-bf98-d0bc18cd55ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:01.072476 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25efec4-bf22-4c8e-bf98-d0bc18cd55ad service placement] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:01.086612 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:01.087672 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:01.089284 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:01.089706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:01.090112 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc admin admin] PATH_INFO: `/v3/projects/08ed8f6df27047bba911721bcea8454c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:01.092766 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ed8f6df27047bba911721bcea8454c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:01.100058 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:01.125832 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 861/1761] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:01.262847 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ed8f6df27047bba911721bcea8454c', 'request_id': 'req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:01.271814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15963901-066a-4447-b93c-54bf7d6a5c00 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:01.272648 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ed8f6df27047bba911721bcea8454c', 'request_id': 'req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:01.272817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-15963901-066a-4447-b93c-54bf7d6a5c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:01.301083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ed8f6df27047bba911721bcea8454c', 'request_id': 'req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:01.310758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15963901-066a-4447-b93c-54bf7d6a5c00 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:01.337882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc admin admin] The token cache is being invalidate because project 08ed8f6df27047bba911721bcea8454c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:01.338347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:01.339719 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:01.349075 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 901/1762] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:01 2022] DELETE /identity/v3/projects/08ed8f6df27047bba911721bcea8454c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:01.354232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:01.361811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:01.551575 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017d19fe-6331-46ae-9d08-962cb060536d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:01.553329 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d19fe-6331-46ae-9d08-962cb060536d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:01.553630 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d19fe-6331-46ae-9d08-962cb060536d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:01.554445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017d19fe-6331-46ae-9d08-962cb060536d admin admin] PATH_INFO: `/v3/users/795354a0681f43c890261ba04626fc87` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:01.556082 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d19fe-6331-46ae-9d08-962cb060536d admin admin] RBAC: Authorizing `identity:delete_user(user_id=795354a0681f43c890261ba04626fc87)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:01.558063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017d19fe-6331-46ae-9d08-962cb060536d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:01.607361 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d4ffb5-88b3-49a0-abb2-cc87d70384cc admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:01.624967 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd0e7f-f26c-4ece-8b2e-1ad15f4f1e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:01.628161 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd0e7f-f26c-4ece-8b2e-1ad15f4f1e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:01.628674 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd0e7f-f26c-4ece-8b2e-1ad15f4f1e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:01.629474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd0e7f-f26c-4ece-8b2e-1ad15f4f1e7c admin admin] PATH_INFO: `/v3/users/bb78dd0cee7e419989974b8d55c3f3dc` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:01.632099 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd0e7f-f26c-4ece-8b2e-1ad15f4f1e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb78dd0cee7e419989974b8d55c3f3dc)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:01.634707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dd0e7f-f26c-4ece-8b2e-1ad15f4f1e7c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:01.664656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:01.731641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-017d19fe-6331-46ae-9d08-962cb060536d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '795354a0681f43c890261ba04626fc87'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:01.733321 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-017d19fe-6331-46ae-9d08-962cb060536d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '795354a0681f43c890261ba04626fc87'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:01.735110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-017d19fe-6331-46ae-9d08-962cb060536d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '795354a0681f43c890261ba04626fc87'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:01.753719 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-017d19fe-6331-46ae-9d08-962cb060536d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '795354a0681f43c890261ba04626fc87'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:01.767225 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-99dd0e7f-f26c-4ece-8b2e-1ad15f4f1e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb78dd0cee7e419989974b8d55c3f3dc'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:01.768390 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-99dd0e7f-f26c-4ece-8b2e-1ad15f4f1e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb78dd0cee7e419989974b8d55c3f3dc'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:01.802111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-99dd0e7f-f26c-4ece-8b2e-1ad15f4f1e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb78dd0cee7e419989974b8d55c3f3dc'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:01.805785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-99dd0e7f-f26c-4ece-8b2e-1ad15f4f1e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb78dd0cee7e419989974b8d55c3f3dc'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:01.821978 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-017d19fe-6331-46ae-9d08-962cb060536d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '795354a0681f43c890261ba04626fc87'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:01.844892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-99dd0e7f-f26c-4ece-8b2e-1ad15f4f1e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb78dd0cee7e419989974b8d55c3f3dc'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:01.904208 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 902/1763] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:01 2022] DELETE /identity/v3/users/bb78dd0cee7e419989974b8d55c3f3dc => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:01.905505 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 862/1764] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:01 2022] DELETE /identity/v3/users/795354a0681f43c890261ba04626fc87 => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:01.906261 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb57e9-c832-4932-a0e7-5d97f0dd2703 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:01.906566 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb57e9-c832-4932-a0e7-5d97f0dd2703 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:01.906853 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb57e9-c832-4932-a0e7-5d97f0dd2703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:01.910101 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9ae38-eb08-4613-8773-ce46a14626e2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:01.913917 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9ae38-eb08-4613-8773-ce46a14626e2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:01.914450 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d9ae38-eb08-4613-8773-ce46a14626e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:01.959077 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-75bb57e9-c832-4932-a0e7-5d97f0dd2703 None None] MFA Rules not processed for user `1b8154ce6b6b40b4959bf354ccb5c59d`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:01.961541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-64d9ae38-eb08-4613-8773-ce46a14626e2 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:01.963096 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-64d9ae38-eb08-4613-8773-ce46a14626e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:01.963245 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-75bb57e9-c832-4932-a0e7-5d97f0dd2703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:02.078821 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 903/1765] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:02.215336 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 863/1766] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:02.292721 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb57e9-c832-4932-a0e7-5d97f0dd2703 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:02.294422 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-75bb57e9-c832-4932-a0e7-5d97f0dd2703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:02.438026 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb57e9-c832-4932-a0e7-5d97f0dd2703 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:02.470878 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dce6c-ccb5-48b6-bb61-ced89d2ac40a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:02.472434 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dce6c-ccb5-48b6-bb61-ced89d2ac40a service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:02.474214 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dce6c-ccb5-48b6-bb61-ced89d2ac40a service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:02.475150 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06dce6c-ccb5-48b6-bb61-ced89d2ac40a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:02.520627 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06dce6c-ccb5-48b6-bb61-ced89d2ac40a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:02.541567 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06dce6c-ccb5-48b6-bb61-ced89d2ac40a service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:02.590559 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 904/1767] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:02.827412 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a2342-1c39-4df9-b8d6-6e1ccb182631 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:02.830120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a2342-1c39-4df9-b8d6-6e1ccb182631 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:02.830743 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a2342-1c39-4df9-b8d6-6e1ccb182631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:02.874966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6f5a2342-1c39-4df9-b8d6-6e1ccb182631 None None] MFA Rules not processed for user `1e7d0f401530454ba0cae0f5e9d6e0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:02.879553 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6f5a2342-1c39-4df9-b8d6-6e1ccb182631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:02.893037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:03.043475 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dce6c-ccb5-48b6-bb61-ced89d2ac40a service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:03.045794 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c06dce6c-ccb5-48b6-bb61-ced89d2ac40a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:03.086081 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06dce6c-ccb5-48b6-bb61-ced89d2ac40a service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:03.095665 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:03.097759 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:03.100587 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:03.101456 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250 admin admin] PATH_INFO: `/v3/projects/b7d87889d80742cc83fa41ae1e153a71` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:03.116466 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d87889d80742cc83fa41ae1e153a71)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:03.130122 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:03.176948 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 864/1768] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:03.217528 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:03.256788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d87889d80742cc83fa41ae1e153a71', 'request_id': 'req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:03.278226 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d87889d80742cc83fa41ae1e153a71', 'request_id': 'req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:03.285588 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d87889d80742cc83fa41ae1e153a71', 'request_id': 'req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:03.313430 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250 admin admin] The token cache is being invalidate because project b7d87889d80742cc83fa41ae1e153a71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:03.313731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:03.325474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:03.331573 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a2342-1c39-4df9-b8d6-6e1ccb182631 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:03.333144 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 905/1769] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:03 2022] DELETE /identity/v3/projects/b7d87889d80742cc83fa41ae1e153a71 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:03.343425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a2342-1c39-4df9-b8d6-6e1ccb182631 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:03.452789 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb4def-7c4f-4fa0-beb0-49688dd76d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:03.453768 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb4def-7c4f-4fa0-beb0-49688dd76d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:03.454087 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb4def-7c4f-4fa0-beb0-49688dd76d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:03.454327 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb4def-7c4f-4fa0-beb0-49688dd76d6b admin admin] PATH_INFO: `/v3/users/e364242712ee45b39d11f144040c77b6` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:03.455686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb4def-7c4f-4fa0-beb0-49688dd76d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e364242712ee45b39d11f144040c77b6)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:03.457951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb4def-7c4f-4fa0-beb0-49688dd76d6b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:03.622803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14fb4def-7c4f-4fa0-beb0-49688dd76d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e364242712ee45b39d11f144040c77b6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:03.624027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14fb4def-7c4f-4fa0-beb0-49688dd76d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e364242712ee45b39d11f144040c77b6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:03.624763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14fb4def-7c4f-4fa0-beb0-49688dd76d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e364242712ee45b39d11f144040c77b6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:03.651516 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14fb4def-7c4f-4fa0-beb0-49688dd76d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e364242712ee45b39d11f144040c77b6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:03.699623 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-14fb4def-7c4f-4fa0-beb0-49688dd76d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e364242712ee45b39d11f144040c77b6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:03.743105 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 865/1770] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:03 2022] DELETE /identity/v3/users/e364242712ee45b39d11f144040c77b6 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:03.929409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:03.931240 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:03.960974 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7c4bd2-0dab-4a03-9d57-fdbae5d40250 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:04.058688 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:04.059928 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:04.060225 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:04.060637 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37 admin admin] PATH_INFO: `/v3/projects/b0d6c3c693f34ad08e914d9dcc3a2588` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:04.062398 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0d6c3c693f34ad08e914d9dcc3a2588)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:04.065661 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:04.163087 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0d6c3c693f34ad08e914d9dcc3a2588', 'request_id': 'req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.177921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0d6c3c693f34ad08e914d9dcc3a2588', 'request_id': 'req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.188155 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0d6c3c693f34ad08e914d9dcc3a2588', 'request_id': 'req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.231185 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37 admin admin] The token cache is being invalidate because project b0d6c3c693f34ad08e914d9dcc3a2588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:04.235132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.238697 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.246468 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 906/1771] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:03 2022] DELETE /identity/v3/projects/b0d6c3c693f34ad08e914d9dcc3a2588 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:04.249256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb4def-7c4f-4fa0-beb0-49688dd76d6b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:04.256646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-14fb4def-7c4f-4fa0-beb0-49688dd76d6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:04.326346 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:04.327850 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:04.342786 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb4def-7c4f-4fa0-beb0-49688dd76d6b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:04.454934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:04.467786 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:04.492888 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff8ac2-5592-4e8c-980b-77d83d9a9f37 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:04.516746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ee018-29f6-4957-9fdb-00b677bf4d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:04.518063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ee018-29f6-4957-9fdb-00b677bf4d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:04.518496 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ee018-29f6-4957-9fdb-00b677bf4d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:04.519000 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ee018-29f6-4957-9fdb-00b677bf4d9f admin admin] PATH_INFO: `/v3/projects/c1ff44ea591c46458194a94f0e6bbff9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:04.521669 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ee018-29f6-4957-9fdb-00b677bf4d9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1ff44ea591c46458194a94f0e6bbff9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:04.527613 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ee018-29f6-4957-9fdb-00b677bf4d9f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:04.602398 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66971917-0d7c-4619-9239-e147a0b5c712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:04.609222 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66971917-0d7c-4619-9239-e147a0b5c712 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:04.609682 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66971917-0d7c-4619-9239-e147a0b5c712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:04.613434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66971917-0d7c-4619-9239-e147a0b5c712 admin admin] PATH_INFO: `/v3/users/0873ddfe031d4140b1c5b9c4a6636b06` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:04.624718 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-762ee018-29f6-4957-9fdb-00b677bf4d9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1ff44ea591c46458194a94f0e6bbff9', 'request_id': 'req-762ee018-29f6-4957-9fdb-00b677bf4d9f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.625072 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66971917-0d7c-4619-9239-e147a0b5c712 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0873ddfe031d4140b1c5b9c4a6636b06)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:04.640269 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66971917-0d7c-4619-9239-e147a0b5c712 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:04.642074 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-762ee018-29f6-4957-9fdb-00b677bf4d9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1ff44ea591c46458194a94f0e6bbff9', 'request_id': 'req-762ee018-29f6-4957-9fdb-00b677bf4d9f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.658154 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-762ee018-29f6-4957-9fdb-00b677bf4d9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1ff44ea591c46458194a94f0e6bbff9', 'request_id': 'req-762ee018-29f6-4957-9fdb-00b677bf4d9f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.698750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-762ee018-29f6-4957-9fdb-00b677bf4d9f admin admin] The token cache is being invalidate because project c1ff44ea591c46458194a94f0e6bbff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:04.700781 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-762ee018-29f6-4957-9fdb-00b677bf4d9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.703966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-762ee018-29f6-4957-9fdb-00b677bf4d9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.710665 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 907/1772] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:04 2022] DELETE /identity/v3/projects/c1ff44ea591c46458194a94f0e6bbff9 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:04.716172 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079c94f-f5f9-4d4d-bdf0-71fb22308f97 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:04.717515 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079c94f-f5f9-4d4d-bdf0-71fb22308f97 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:04.719943 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079c94f-f5f9-4d4d-bdf0-71fb22308f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:04.785078 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-66971917-0d7c-4619-9239-e147a0b5c712 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0873ddfe031d4140b1c5b9c4a6636b06'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.785479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9079c94f-f5f9-4d4d-bdf0-71fb22308f97 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:04.788633 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-66971917-0d7c-4619-9239-e147a0b5c712 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0873ddfe031d4140b1c5b9c4a6636b06'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.790732 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-66971917-0d7c-4619-9239-e147a0b5c712 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0873ddfe031d4140b1c5b9c4a6636b06'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.808583 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9079c94f-f5f9-4d4d-bdf0-71fb22308f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:04.847055 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-66971917-0d7c-4619-9239-e147a0b5c712 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0873ddfe031d4140b1c5b9c4a6636b06'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.916080 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-66971917-0d7c-4619-9239-e147a0b5c712 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0873ddfe031d4140b1c5b9c4a6636b06'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:04.959431 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 866/1773] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:04 2022] DELETE /identity/v3/users/0873ddfe031d4140b1c5b9c4a6636b06 => generated 0 bytes in 710 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:05.014095 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 908/1774] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:05.025098 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83ea53-19b7-4dd6-abd1-28672ba506b8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:05.025892 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83ea53-19b7-4dd6-abd1-28672ba506b8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:05.026397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83ea53-19b7-4dd6-abd1-28672ba506b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:05.087963 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2d83ea53-19b7-4dd6-abd1-28672ba506b8 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:05.091691 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2d83ea53-19b7-4dd6-abd1-28672ba506b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:05.304265 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 867/1775] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:05.308592 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079c94f-f5f9-4d4d-bdf0-71fb22308f97 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:05.328513 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079c94f-f5f9-4d4d-bdf0-71fb22308f97 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:05.345239 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8d2ce-0b44-463a-90dc-05fe711af016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:05.347251 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8d2ce-0b44-463a-90dc-05fe711af016 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:05.348099 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8d2ce-0b44-463a-90dc-05fe711af016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:05.365726 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8d2ce-0b44-463a-90dc-05fe711af016 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:05.369812 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8d2ce-0b44-463a-90dc-05fe711af016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:05.371546 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8d2ce-0b44-463a-90dc-05fe711af016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:05.375580 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8d2ce-0b44-463a-90dc-05fe711af016 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:05.383306 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83ea53-19b7-4dd6-abd1-28672ba506b8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:05.385071 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2d83ea53-19b7-4dd6-abd1-28672ba506b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:05.409423 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 909/1776] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:05.414027 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8d2ce-0b44-463a-90dc-05fe711af016 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:05.419334 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83ea53-19b7-4dd6-abd1-28672ba506b8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:05.432394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766e9f2-439c-455a-9512-df126d7b562b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:05.434174 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766e9f2-439c-455a-9512-df126d7b562b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:05.434643 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766e9f2-439c-455a-9512-df126d7b562b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:05.435754 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766e9f2-439c-455a-9512-df126d7b562b admin admin] PATH_INFO: `/v3/projects/e1ead54cefd1462faac205e80a6e9fc3` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:05.438182 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766e9f2-439c-455a-9512-df126d7b562b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1ead54cefd1462faac205e80a6e9fc3)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:05.443191 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8d2ce-0b44-463a-90dc-05fe711af016 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:05.446546 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766e9f2-439c-455a-9512-df126d7b562b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:05.449887 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111320e0-5dca-4583-b0fc-a592aa976061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:05.450868 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111320e0-5dca-4583-b0fc-a592aa976061 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:05.451404 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111320e0-5dca-4583-b0fc-a592aa976061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:05.452057 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111320e0-5dca-4583-b0fc-a592aa976061 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:05.452986 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111320e0-5dca-4583-b0fc-a592aa976061 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:05.456245 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111320e0-5dca-4583-b0fc-a592aa976061 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:05.498724 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 910/1777] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:05 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:05.503837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111320e0-5dca-4583-b0fc-a592aa976061 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:05.592018 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:05.594628 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f766e9f2-439c-455a-9512-df126d7b562b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1ead54cefd1462faac205e80a6e9fc3', 'request_id': 'req-f766e9f2-439c-455a-9512-df126d7b562b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:05.618669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f766e9f2-439c-455a-9512-df126d7b562b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1ead54cefd1462faac205e80a6e9fc3', 'request_id': 'req-f766e9f2-439c-455a-9512-df126d7b562b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:05.630622 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f766e9f2-439c-455a-9512-df126d7b562b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1ead54cefd1462faac205e80a6e9fc3', 'request_id': 'req-f766e9f2-439c-455a-9512-df126d7b562b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:05.663407 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f766e9f2-439c-455a-9512-df126d7b562b admin admin] The token cache is being invalidate because project e1ead54cefd1462faac205e80a6e9fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:05.664010 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f766e9f2-439c-455a-9512-df126d7b562b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:05.664676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f766e9f2-439c-455a-9512-df126d7b562b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:05.672414 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 868/1778] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:05 2022] DELETE /identity/v3/projects/e1ead54cefd1462faac205e80a6e9fc3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:05.674385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebe16c-dfd4-436a-92d8-ebb485ea8cff None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:05.674663 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebe16c-dfd4-436a-92d8-ebb485ea8cff None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:05.674941 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ebe16c-dfd4-436a-92d8-ebb485ea8cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:05.677761 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:05.719314 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-21ebe16c-dfd4-436a-92d8-ebb485ea8cff None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:05.721810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-21ebe16c-dfd4-436a-92d8-ebb485ea8cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:05.757628 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111320e0-5dca-4583-b0fc-a592aa976061 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:05.919036 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 869/1779] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:05.920449 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0b53c-fba1-4d1c-8b2f-3a46d50b8921 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:05.927852 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0b53c-fba1-4d1c-8b2f-3a46d50b8921 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:05.928217 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0b53c-fba1-4d1c-8b2f-3a46d50b8921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:05.957679 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53571eb-0576-42d7-ae87-fcdc38366ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:05.958925 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53571eb-0576-42d7-ae87-fcdc38366ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:05.959348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53571eb-0576-42d7-ae87-fcdc38366ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:05.959729 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53571eb-0576-42d7-ae87-fcdc38366ca0 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:05.960907 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53571eb-0576-42d7-ae87-fcdc38366ca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:05.966157 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53571eb-0576-42d7-ae87-fcdc38366ca0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:06.012116 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 911/1780] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:05 2022] POST /identity/v3/users => generated 294 bytes in 509 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:06.014795 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366c551-41f7-4a38-8774-52f27cb4dead None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:06.015349 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366c551-41f7-4a38-8774-52f27cb4dead None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:06.015805 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f366c551-41f7-4a38-8774-52f27cb4dead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:06.048120 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f366c551-41f7-4a38-8774-52f27cb4dead None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:06.050507 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f366c551-41f7-4a38-8774-52f27cb4dead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:06.099489 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 912/1781] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:06.102024 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366c551-41f7-4a38-8774-52f27cb4dead None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:06.103329 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d7b0b53c-fba1-4d1c-8b2f-3a46d50b8921 None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:06.104549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d7b0b53c-fba1-4d1c-8b2f-3a46d50b8921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:06.108512 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f366c551-41f7-4a38-8774-52f27cb4dead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:06.131591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f366c551-41f7-4a38-8774-52f27cb4dead None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:06.137164 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9a3b5-131b-4601-9f44-693fa74d5c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:06.137681 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9a3b5-131b-4601-9f44-693fa74d5c59 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:06.139049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9a3b5-131b-4601-9f44-693fa74d5c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:06.139529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9a3b5-131b-4601-9f44-693fa74d5c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:06.140509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9a3b5-131b-4601-9f44-693fa74d5c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:06.142780 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9a3b5-131b-4601-9f44-693fa74d5c59 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:06.156006 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 913/1782] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:06.156899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9a3b5-131b-4601-9f44-693fa74d5c59 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:06.170891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9a3b5-131b-4601-9f44-693fa74d5c59 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:06.180280 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32813b2d-7ba9-4645-aba4-c11bf16b4df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:06.183672 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32813b2d-7ba9-4645-aba4-c11bf16b4df2 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:06.184175 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32813b2d-7ba9-4645-aba4-c11bf16b4df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:06.186403 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32813b2d-7ba9-4645-aba4-c11bf16b4df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:06.187474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32813b2d-7ba9-4645-aba4-c11bf16b4df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:06.187975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32813b2d-7ba9-4645-aba4-c11bf16b4df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:06.189832 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32813b2d-7ba9-4645-aba4-c11bf16b4df2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:06.209832 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 914/1783] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:06.212331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32813b2d-7ba9-4645-aba4-c11bf16b4df2 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:06.276205 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32813b2d-7ba9-4645-aba4-c11bf16b4df2 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:06.317612 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f673f6-a74c-486c-9734-63df3b9dbfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:06.322378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f673f6-a74c-486c-9734-63df3b9dbfc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:06.324496 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f673f6-a74c-486c-9734-63df3b9dbfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:06.327249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f673f6-a74c-486c-9734-63df3b9dbfc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:06.328209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f673f6-a74c-486c-9734-63df3b9dbfc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:06.356154 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f673f6-a74c-486c-9734-63df3b9dbfc5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:06.409565 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 915/1784] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:06.414600 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f673f6-a74c-486c-9734-63df3b9dbfc5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:06.416342 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 870/1785] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:12:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 497 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:06.419063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0b53c-fba1-4d1c-8b2f-3a46d50b8921 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:06.457714 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f673f6-a74c-486c-9734-63df3b9dbfc5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:06.469221 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0b53c-fba1-4d1c-8b2f-3a46d50b8921 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:06.485825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f07498-6c7b-4eef-b429-38674d0c7917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:06.488554 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f07498-6c7b-4eef-b429-38674d0c7917 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:06.488554 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f07498-6c7b-4eef-b429-38674d0c7917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:06.497175 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f07498-6c7b-4eef-b429-38674d0c7917 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:06.498165 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e88ced-c49d-4af5-83de-acd2f517964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:06.499100 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f07498-6c7b-4eef-b429-38674d0c7917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:06.504496 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e88ced-c49d-4af5-83de-acd2f517964f admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:06.507588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e88ced-c49d-4af5-83de-acd2f517964f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:06.508171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e88ced-c49d-4af5-83de-acd2f517964f admin admin] PATH_INFO: `/v3/projects/5c3ea856d9104cb9b814bd832195f6f1/users/b261b853e1a44edcacfb20c5340a5088/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:06.508966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f07498-6c7b-4eef-b429-38674d0c7917 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:06.572612 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e88ced-c49d-4af5-83de-acd2f517964f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c3ea856d9104cb9b814bd832195f6f1, user_id=b261b853e1a44edcacfb20c5340a5088, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:06.578606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e88ced-c49d-4af5-83de-acd2f517964f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:06.618458 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 916/1786] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:06 2022] POST /identity/v3/projects => generated 377 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:06.625200 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f07498-6c7b-4eef-b429-38674d0c7917 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:06.635891 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 871/1787] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:06 2022] PUT /identity/v3/projects/5c3ea856d9104cb9b814bd832195f6f1/users/b261b853e1a44edcacfb20c5340a5088/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:06.647811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d667-28c2-4ae9-b082-a70bc154260c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:06.648129 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d667-28c2-4ae9-b082-a70bc154260c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:06.648411 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935d667-28c2-4ae9-b082-a70bc154260c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:06.734348 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b935d667-28c2-4ae9-b082-a70bc154260c None None] MFA Rules not processed for user `b261b853e1a44edcacfb20c5340a5088`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:06.737301 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b935d667-28c2-4ae9-b082-a70bc154260c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:06.763527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:06.840764 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f07498-6c7b-4eef-b429-38674d0c7917 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:06.869233 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c1d59-6cc6-44fc-a6af-289f94d4db2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:06.870057 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c1d59-6cc6-44fc-a6af-289f94d4db2e admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:06.870275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c1d59-6cc6-44fc-a6af-289f94d4db2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:06.870562 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c1d59-6cc6-44fc-a6af-289f94d4db2e admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:06.871286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c1d59-6cc6-44fc-a6af-289f94d4db2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:06.878145 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c1d59-6cc6-44fc-a6af-289f94d4db2e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:06.961768 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 917/1788] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:06 2022] POST /identity/v3/users => generated 289 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:06.964659 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c1d59-6cc6-44fc-a6af-289f94d4db2e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:06.974854 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-dd5c1d59-6cc6-44fc-a6af-289f94d4db2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:06.990242 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:06.994591 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 872/1789] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:06.996480 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d667-28c2-4ae9-b082-a70bc154260c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:07.039071 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935d667-28c2-4ae9-b082-a70bc154260c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:07.058648 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a491ff9-b083-4dc5-815f-29261d571f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:07.060470 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a491ff9-b083-4dc5-815f-29261d571f63 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:07.062210 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a491ff9-b083-4dc5-815f-29261d571f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:07.064430 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a491ff9-b083-4dc5-815f-29261d571f63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:07.065710 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a491ff9-b083-4dc5-815f-29261d571f63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:07.074491 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a491ff9-b083-4dc5-815f-29261d571f63 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:07.123670 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 873/1790] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:06 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:07.127815 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a491ff9-b083-4dc5-815f-29261d571f63 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:07.169648 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a491ff9-b083-4dc5-815f-29261d571f63 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:07.197534 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bced02-df4d-43a5-ad26-2d0e57e7c06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:07.198228 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bced02-df4d-43a5-ad26-2d0e57e7c06c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:07.198608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bced02-df4d-43a5-ad26-2d0e57e7c06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:07.198908 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bced02-df4d-43a5-ad26-2d0e57e7c06c admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:07.200217 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bced02-df4d-43a5-ad26-2d0e57e7c06c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:07.209602 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bced02-df4d-43a5-ad26-2d0e57e7c06c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:07.343807 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 874/1791] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:07 2022] POST /identity/v3/projects => generated 387 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:07.344889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bced02-df4d-43a5-ad26-2d0e57e7c06c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:07.376675 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c1d59-6cc6-44fc-a6af-289f94d4db2e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:07.516094 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a127d4-6bd8-48c9-8f6f-2a46e3c4e9d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:07.517197 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a127d4-6bd8-48c9-8f6f-2a46e3c4e9d2 service swift] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:07.517593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a127d4-6bd8-48c9-8f6f-2a46e3c4e9d2 service swift] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:07.518127 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a127d4-6bd8-48c9-8f6f-2a46e3c4e9d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:07.556691 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bced02-df4d-43a5-ad26-2d0e57e7c06c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:07.587851 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0acd1-5dac-4b73-9ffe-d9cf73e9aed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:07.588889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0acd1-5dac-4b73-9ffe-d9cf73e9aed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:07.589124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0acd1-5dac-4b73-9ffe-d9cf73e9aed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:07.589406 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0acd1-5dac-4b73-9ffe-d9cf73e9aed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:07.592533 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a127d4-6bd8-48c9-8f6f-2a46e3c4e9d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:07.596039 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a127d4-6bd8-48c9-8f6f-2a46e3c4e9d2 service swift] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:07.596961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0acd1-5dac-4b73-9ffe-d9cf73e9aed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:07.603635 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0acd1-5dac-4b73-9ffe-d9cf73e9aed0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:07.642172 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 918/1792] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:12:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 680 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:07.643164 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a127d4-6bd8-48c9-8f6f-2a46e3c4e9d2 service swift] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:07.646335 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-36a127d4-6bd8-48c9-8f6f-2a46e3c4e9d2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:07.657284 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 875/1793] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:07.658267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0acd1-5dac-4b73-9ffe-d9cf73e9aed0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:07.699016 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0acd1-5dac-4b73-9ffe-d9cf73e9aed0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:07.740116 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b52c4-246b-49a3-a0c0-e8a318e47890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:07.743561 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b52c4-246b-49a3-a0c0-e8a318e47890 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:07.746040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b52c4-246b-49a3-a0c0-e8a318e47890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:07.746624 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b52c4-246b-49a3-a0c0-e8a318e47890 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:07.749424 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b52c4-246b-49a3-a0c0-e8a318e47890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:07.757749 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b52c4-246b-49a3-a0c0-e8a318e47890 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:07.772153 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a127d4-6bd8-48c9-8f6f-2a46e3c4e9d2 service swift] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:07.832295 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c3cd71-59cf-4a4e-8ba5-551c6c20ef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:07.833335 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3cd71-59cf-4a4e-8ba5-551c6c20ef85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:07.833633 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3cd71-59cf-4a4e-8ba5-551c6c20ef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:07.841844 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3cd71-59cf-4a4e-8ba5-551c6c20ef85 admin admin] PATH_INFO: `/v3/projects/efc30aea41424085a13498818da651da` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:07.875849 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 876/1794] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:07 2022] POST /identity/v3/users => generated 294 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:07.877906 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b52c4-246b-49a3-a0c0-e8a318e47890 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:07.881238 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3cd71-59cf-4a4e-8ba5-551c6c20ef85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc30aea41424085a13498818da651da)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:07.887235 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c3cd71-59cf-4a4e-8ba5-551c6c20ef85 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:07.936363 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b52c4-246b-49a3-a0c0-e8a318e47890 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:07.979991 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490424a1-2220-4e7e-b7c9-e0e0d3b824f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:07.982041 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490424a1-2220-4e7e-b7c9-e0e0d3b824f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:07.984192 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490424a1-2220-4e7e-b7c9-e0e0d3b824f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:07.987950 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490424a1-2220-4e7e-b7c9-e0e0d3b824f2 admin admin] PATH_INFO: `/v3/projects/0144af33572d46ac9db8d475298bbcb0/users/df71ddf05f07423ba5c0a7a8881ae737/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:07.988524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:08.037707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490424a1-2220-4e7e-b7c9-e0e0d3b824f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0144af33572d46ac9db8d475298bbcb0, user_id=df71ddf05f07423ba5c0a7a8881ae737, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:08.040803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490424a1-2220-4e7e-b7c9-e0e0d3b824f2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:08.073149 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 877/1795] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:07 2022] PUT /identity/v3/projects/0144af33572d46ac9db8d475298bbcb0/users/df71ddf05f07423ba5c0a7a8881ae737/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:08.074294 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490424a1-2220-4e7e-b7c9-e0e0d3b824f2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:08.090382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-98c3cd71-59cf-4a4e-8ba5-551c6c20ef85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc30aea41424085a13498818da651da', 'request_id': 'req-98c3cd71-59cf-4a4e-8ba5-551c6c20ef85'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:08.112518 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-98c3cd71-59cf-4a4e-8ba5-551c6c20ef85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc30aea41424085a13498818da651da', 'request_id': 'req-98c3cd71-59cf-4a4e-8ba5-551c6c20ef85'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:08.125836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-98c3cd71-59cf-4a4e-8ba5-551c6c20ef85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc30aea41424085a13498818da651da', 'request_id': 'req-98c3cd71-59cf-4a4e-8ba5-551c6c20ef85'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:08.171529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-98c3cd71-59cf-4a4e-8ba5-551c6c20ef85 admin admin] The token cache is being invalidate because project efc30aea41424085a13498818da651da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:08.175069 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-98c3cd71-59cf-4a4e-8ba5-551c6c20ef85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:08.177264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-98c3cd71-59cf-4a4e-8ba5-551c6c20ef85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:08.183684 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 919/1796] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:07 2022] DELETE /identity/v3/projects/efc30aea41424085a13498818da651da => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:08.190320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53a86-6652-4aa6-b685-3cc65af2cf50 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:08.190614 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53a86-6652-4aa6-b685-3cc65af2cf50 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:08.191158 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc53a86-6652-4aa6-b685-3cc65af2cf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:08.236359 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:08.312770 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490424a1-2220-4e7e-b7c9-e0e0d3b824f2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:08.323033 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b02a7-1b3e-459c-8da2-44a61eaf03f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:08.323911 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b02a7-1b3e-459c-8da2-44a61eaf03f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:08.324198 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b02a7-1b3e-459c-8da2-44a61eaf03f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:08.324476 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b02a7-1b3e-459c-8da2-44a61eaf03f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:08.325061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4cc53a86-6652-4aa6-b685-3cc65af2cf50 None None] MFA Rules not processed for user `df71ddf05f07423ba5c0a7a8881ae737`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:08.325221 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b02a7-1b3e-459c-8da2-44a61eaf03f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:08.326401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4cc53a86-6652-4aa6-b685-3cc65af2cf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:08.326961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b02a7-1b3e-459c-8da2-44a61eaf03f5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:08.363398 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 878/1797] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:08.367364 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3808f5c-4635-463f-bddd-9b4b6df07ddd None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:08.367739 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3808f5c-4635-463f-bddd-9b4b6df07ddd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:08.368047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3808f5c-4635-463f-bddd-9b4b6df07ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:08.418685 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b3808f5c-4635-463f-bddd-9b4b6df07ddd None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:08.427113 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b3808f5c-4635-463f-bddd-9b4b6df07ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:08.452649 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 879/1798] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:08.453564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3808f5c-4635-463f-bddd-9b4b6df07ddd None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:08.462873 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b3808f5c-4635-463f-bddd-9b4b6df07ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:08.549447 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3808f5c-4635-463f-bddd-9b4b6df07ddd None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:08.551878 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 920/1799] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:08 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:08.553343 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367e12-4a4c-4626-a9d1-b99447c4359e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:08.557690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367e12-4a4c-4626-a9d1-b99447c4359e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:08.558215 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6367e12-4a4c-4626-a9d1-b99447c4359e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:08.570085 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d2303-6e92-4984-ba34-92eafb9c8a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:08.570802 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d2303-6e92-4984-ba34-92eafb9c8a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:08.571090 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d2303-6e92-4984-ba34-92eafb9c8a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:08.571730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d2303-6e92-4984-ba34-92eafb9c8a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:08.577224 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d2303-6e92-4984-ba34-92eafb9c8a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:08.595967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d2303-6e92-4984-ba34-92eafb9c8a91 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:08.605595 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a6367e12-4a4c-4626-a9d1-b99447c4359e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:08.606448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a6367e12-4a4c-4626-a9d1-b99447c4359e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:08.658198 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 921/1801] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:08.659418 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 880/1801] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:08.660092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6367e12-4a4c-4626-a9d1-b99447c4359e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:08.660388 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d2303-6e92-4984-ba34-92eafb9c8a91 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:08.665651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a6367e12-4a4c-4626-a9d1-b99447c4359e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:08.719723 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d2303-6e92-4984-ba34-92eafb9c8a91 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:08.748209 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e3615-0c06-4bd7-bcef-71d1c5f4a84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:08.750266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e3615-0c06-4bd7-bcef-71d1c5f4a84c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:08.750545 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e3615-0c06-4bd7-bcef-71d1c5f4a84c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:08.750830 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e3615-0c06-4bd7-bcef-71d1c5f4a84c admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:08.759122 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e3615-0c06-4bd7-bcef-71d1c5f4a84c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:08.759471 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e3615-0c06-4bd7-bcef-71d1c5f4a84c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:08.777749 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e3615-0c06-4bd7-bcef-71d1c5f4a84c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:08.842065 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 881/1802] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:08.849263 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e3615-0c06-4bd7-bcef-71d1c5f4a84c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:08.877879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6367e12-4a4c-4626-a9d1-b99447c4359e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:08.888169 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f1b1d-d6c2-4c84-8078-e30f11343deb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbdf910e67d4185a0ae14edf34ee3b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:08.889075 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f1b1d-d6c2-4c84-8078-e30f11343deb service glance] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:08.889574 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f1b1d-d6c2-4c84-8078-e30f11343deb service glance] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:08.889988 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f1b1d-d6c2-4c84-8078-e30f11343deb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:08.902023 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e3615-0c06-4bd7-bcef-71d1c5f4a84c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:08.911330 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f1b1d-d6c2-4c84-8078-e30f11343deb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:08.913223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f1b1d-d6c2-4c84-8078-e30f11343deb service glance] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:08.925055 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04568-b73c-40bf-98dc-523fab99343e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:08.926056 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04568-b73c-40bf-98dc-523fab99343e admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:08.926401 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04568-b73c-40bf-98dc-523fab99343e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:08.926571 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04568-b73c-40bf-98dc-523fab99343e admin admin] PATH_INFO: `/v3/projects/9b68ac368e524477885ae3874017d9ee/users/154f59e7070647089bfc274f554ca13c/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:08.960923 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 922/1803] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:08.975790 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb04568-b73c-40bf-98dc-523fab99343e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b68ac368e524477885ae3874017d9ee, user_id=154f59e7070647089bfc274f554ca13c, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:08.978324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f1b1d-d6c2-4c84-8078-e30f11343deb service glance] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:08.978672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb04568-b73c-40bf-98dc-523fab99343e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:09.019754 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f1b1d-d6c2-4c84-8078-e30f11343deb service glance] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:09.039187 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 882/1804] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:08 2022] PUT /identity/v3/projects/9b68ac368e524477885ae3874017d9ee/users/154f59e7070647089bfc274f554ca13c/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:09.043956 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3d6e1-f9f0-4845-958e-6e5d84e8ac33 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:09.044186 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3d6e1-f9f0-4845-958e-6e5d84e8ac33 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:09.044478 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba3d6e1-f9f0-4845-958e-6e5d84e8ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:09.098682 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:09.106671 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9ba3d6e1-f9f0-4845-958e-6e5d84e8ac33 None None] MFA Rules not processed for user `a3efd3928e334e78b4c87bb695718299`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:09.112187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9ba3d6e1-f9f0-4845-958e-6e5d84e8ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:09.221284 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0892ed77-b6d4-4b0d-85be-820aa2382831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:09.222507 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892ed77-b6d4-4b0d-85be-820aa2382831 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:09.222797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892ed77-b6d4-4b0d-85be-820aa2382831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:09.223114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0892ed77-b6d4-4b0d-85be-820aa2382831 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:09.224348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892ed77-b6d4-4b0d-85be-820aa2382831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:09.235926 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0892ed77-b6d4-4b0d-85be-820aa2382831 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:09.295987 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 923/1805] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:08 2022] POST /identity/v3/projects => generated 391 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:09.296356 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1fe75-f1c4-4401-af47-32721ca944b2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:09.296671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1fe75-f1c4-4401-af47-32721ca944b2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:09.299582 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1fe75-f1c4-4401-af47-32721ca944b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:09.375253 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a1f1fe75-f1c4-4401-af47-32721ca944b2 None None] MFA Rules not processed for user `154f59e7070647089bfc274f554ca13c`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:09.382465 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a1f1fe75-f1c4-4401-af47-32721ca944b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:09.415482 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 883/1806] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Jul 24 01:12:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:09.416899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3d6e1-f9f0-4845-958e-6e5d84e8ac33 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:09.447771 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba3d6e1-f9f0-4845-958e-6e5d84e8ac33 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:09.588364 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44198a4f-638f-40b6-a5ef-fa0a4813842b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:09.590697 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44198a4f-638f-40b6-a5ef-fa0a4813842b admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:09.591669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44198a4f-638f-40b6-a5ef-fa0a4813842b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:09.592722 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44198a4f-638f-40b6-a5ef-fa0a4813842b admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:09.593965 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44198a4f-638f-40b6-a5ef-fa0a4813842b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:09.601397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44198a4f-638f-40b6-a5ef-fa0a4813842b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:09.627732 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 924/1807] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:09.628779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1fe75-f1c4-4401-af47-32721ca944b2 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:09.638688 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a1f1fe75-f1c4-4401-af47-32721ca944b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:09.672671 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 884/1808] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:09 2022] POST /identity/v3/users => generated 296 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:09.679646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44198a4f-638f-40b6-a5ef-fa0a4813842b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:09.717079 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44198a4f-638f-40b6-a5ef-fa0a4813842b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:09.740009 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f565b2-2c0b-4ca0-bd29-b3188cd68e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:09.740752 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f565b2-2c0b-4ca0-bd29-b3188cd68e64 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:09.741038 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f565b2-2c0b-4ca0-bd29-b3188cd68e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:09.741353 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f565b2-2c0b-4ca0-bd29-b3188cd68e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:09.750989 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f565b2-2c0b-4ca0-bd29-b3188cd68e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:09.765402 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f565b2-2c0b-4ca0-bd29-b3188cd68e64 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:09.848596 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:09.899154 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 885/1809] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:09 2022] POST /identity/v3/projects => generated 383 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:09.900348 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f565b2-2c0b-4ca0-bd29-b3188cd68e64 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:09.905306 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1fe75-f1c4-4401-af47-32721ca944b2 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:10.037090 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f565b2-2c0b-4ca0-bd29-b3188cd68e64 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:10.046596 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad250b1-f945-4aa9-b0c4-7323e527300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:10.047365 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad250b1-f945-4aa9-b0c4-7323e527300f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.047658 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad250b1-f945-4aa9-b0c4-7323e527300f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.047938 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad250b1-f945-4aa9-b0c4-7323e527300f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.048750 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad250b1-f945-4aa9-b0c4-7323e527300f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:10.051242 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad250b1-f945-4aa9-b0c4-7323e527300f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:10.071543 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 886/1810] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:10.071543 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad250b1-f945-4aa9-b0c4-7323e527300f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:10.090252 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad250b1-f945-4aa9-b0c4-7323e527300f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:10.099608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b82f8-54d5-41bd-be2d-ac72254a2bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:10.100553 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b82f8-54d5-41bd-be2d-ac72254a2bfb admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.100784 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b82f8-54d5-41bd-be2d-ac72254a2bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.101099 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b82f8-54d5-41bd-be2d-ac72254a2bfb admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.101890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b82f8-54d5-41bd-be2d-ac72254a2bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:10.103869 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b82f8-54d5-41bd-be2d-ac72254a2bfb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:10.122559 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:10.141533 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 887/1811] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:10 2022] POST /identity/v3/users => generated 298 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:10.142703 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b82f8-54d5-41bd-be2d-ac72254a2bfb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:10.156313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b82f8-54d5-41bd-be2d-ac72254a2bfb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:10.160061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceafab8-8fcb-4768-9f1d-3869dcbecfd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:10.160748 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceafab8-8fcb-4768-9f1d-3869dcbecfd0 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.161071 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceafab8-8fcb-4768-9f1d-3869dcbecfd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.161529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceafab8-8fcb-4768-9f1d-3869dcbecfd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.162905 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a82334-8038-4f09-ae3f-d51a6905fc30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:10.163860 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a82334-8038-4f09-ae3f-d51a6905fc30 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.164312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a82334-8038-4f09-ae3f-d51a6905fc30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.164732 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a82334-8038-4f09-ae3f-d51a6905fc30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.165631 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a82334-8038-4f09-ae3f-d51a6905fc30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:10.168382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a82334-8038-4f09-ae3f-d51a6905fc30 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:10.187665 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 888/1812] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:10.189666 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a82334-8038-4f09-ae3f-d51a6905fc30 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:10.214628 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceafab8-8fcb-4768-9f1d-3869dcbecfd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:10.216258 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceafab8-8fcb-4768-9f1d-3869dcbecfd0 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:10.228943 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a82334-8038-4f09-ae3f-d51a6905fc30 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:10.242711 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6f5ec-520a-4abf-a1fa-7ee29f6ddbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:10.244702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6f5ec-520a-4abf-a1fa-7ee29f6ddbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.245319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6f5ec-520a-4abf-a1fa-7ee29f6ddbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.249162 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6f5ec-520a-4abf-a1fa-7ee29f6ddbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.249162 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6f5ec-520a-4abf-a1fa-7ee29f6ddbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:10.257120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6f5ec-520a-4abf-a1fa-7ee29f6ddbc0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:10.273822 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 925/1813] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:10.275017 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceafab8-8fcb-4768-9f1d-3869dcbecfd0 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:10.282869 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 889/1814] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:10.286932 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6f5ec-520a-4abf-a1fa-7ee29f6ddbc0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:10.314365 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6f5ec-520a-4abf-a1fa-7ee29f6ddbc0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:10.322253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe86bc-09f1-40a6-86f7-1918a586a27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:10.323287 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe86bc-09f1-40a6-86f7-1918a586a27a admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.323592 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe86bc-09f1-40a6-86f7-1918a586a27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.323875 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe86bc-09f1-40a6-86f7-1918a586a27a admin admin] PATH_INFO: `/v3/projects/dc07ac771b284a67a03dae4074197512/users/fd1a8f3896564d58afe71c4460dcd60b/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.356871 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceafab8-8fcb-4768-9f1d-3869dcbecfd0 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:10.378264 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe86bc-09f1-40a6-86f7-1918a586a27a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc07ac771b284a67a03dae4074197512, user_id=fd1a8f3896564d58afe71c4460dcd60b, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:10.383072 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b023bdb-c262-4707-a133-0fcdfa81c398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:10.384273 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b023bdb-c262-4707-a133-0fcdfa81c398 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.386460 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fe86bc-09f1-40a6-86f7-1918a586a27a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:10.388322 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b023bdb-c262-4707-a133-0fcdfa81c398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.389448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b023bdb-c262-4707-a133-0fcdfa81c398 admin admin] PATH_INFO: `/v3/projects/429c66e8d73043e1809af23a7fb07110/users/5d5b161a7eec4d1e8c085abc1d9cb826/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.433723 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 890/1815] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:10 2022] PUT /identity/v3/projects/dc07ac771b284a67a03dae4074197512/users/fd1a8f3896564d58afe71c4460dcd60b/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:10.438128 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe86bc-09f1-40a6-86f7-1918a586a27a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:10.444130 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b023bdb-c262-4707-a133-0fcdfa81c398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=429c66e8d73043e1809af23a7fb07110, user_id=5d5b161a7eec4d1e8c085abc1d9cb826, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:10.448781 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b023bdb-c262-4707-a133-0fcdfa81c398 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:10.480883 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 926/1816] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:10 2022] PUT /identity/v3/projects/429c66e8d73043e1809af23a7fb07110/users/5d5b161a7eec4d1e8c085abc1d9cb826/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:10.491351 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941bdcf-b94d-43ba-b43f-8cce64d1cf15 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.491760 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941bdcf-b94d-43ba-b43f-8cce64d1cf15 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.492043 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941bdcf-b94d-43ba-b43f-8cce64d1cf15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.536620 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6941bdcf-b94d-43ba-b43f-8cce64d1cf15 None None] MFA Rules not processed for user `5d5b161a7eec4d1e8c085abc1d9cb826`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:10.538609 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6941bdcf-b94d-43ba-b43f-8cce64d1cf15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:10.545501 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe86bc-09f1-40a6-86f7-1918a586a27a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:10.607519 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:10.663794 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 927/1817] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:10.666886 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941bdcf-b94d-43ba-b43f-8cce64d1cf15 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:10.695480 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f186dfb-4840-4e51-9493-531a3cbd426d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:10.699499 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f186dfb-4840-4e51-9493-531a3cbd426d admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.701852 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f186dfb-4840-4e51-9493-531a3cbd426d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.702536 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f186dfb-4840-4e51-9493-531a3cbd426d admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.706844 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f186dfb-4840-4e51-9493-531a3cbd426d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:10.710804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f186dfb-4840-4e51-9493-531a3cbd426d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:10.792549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941bdcf-b94d-43ba-b43f-8cce64d1cf15 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:10.795566 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 891/1818] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:10.797333 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f186dfb-4840-4e51-9493-531a3cbd426d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:10.822562 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5be088-202b-4899-8383-8928feb036ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:10.827216 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5be088-202b-4899-8383-8928feb036ba admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.828112 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5be088-202b-4899-8383-8928feb036ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.828405 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5be088-202b-4899-8383-8928feb036ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.830778 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5be088-202b-4899-8383-8928feb036ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:10.837886 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5be088-202b-4899-8383-8928feb036ba admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:10.841939 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f186dfb-4840-4e51-9493-531a3cbd426d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:10.856562 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9fed68-780a-4c13-9835-3453d9d07f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:10.859331 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fed68-780a-4c13-9835-3453d9d07f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.860899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fed68-780a-4c13-9835-3453d9d07f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.862128 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9fed68-780a-4c13-9835-3453d9d07f81 admin admin] PATH_INFO: `/v3/projects/dc07ac771b284a67a03dae4074197512/users/fd1a8f3896564d58afe71c4460dcd60b/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.869247 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9fed68-780a-4c13-9835-3453d9d07f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc07ac771b284a67a03dae4074197512, user_id=fd1a8f3896564d58afe71c4460dcd60b, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:10.880357 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9fed68-780a-4c13-9835-3453d9d07f81 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:10.926332 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 892/1819] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:10 2022] PUT /identity/v3/projects/dc07ac771b284a67a03dae4074197512/users/fd1a8f3896564d58afe71c4460dcd60b/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:10.948224 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2d588-ffd1-4bc2-8daa-132ef3a22cd0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:10.948398 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2d588-ffd1-4bc2-8daa-132ef3a22cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:10.948681 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c2d588-ffd1-4bc2-8daa-132ef3a22cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:10.949231 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 928/1820] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:10 2022] POST /identity/v3/projects => generated 391 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:10.954324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5be088-202b-4899-8383-8928feb036ba admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:11.027601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-36c2d588-ffd1-4bc2-8daa-132ef3a22cd0 None None] MFA Rules not processed for user `fd1a8f3896564d58afe71c4460dcd60b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:11.029010 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-36c2d588-ffd1-4bc2-8daa-132ef3a22cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:11.205438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:11.262891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5be088-202b-4899-8383-8928feb036ba admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:11.280320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d770d-5d96-4b57-959f-40e93d16fbfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:11.283956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d770d-5d96-4b57-959f-40e93d16fbfc admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:11.284947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d770d-5d96-4b57-959f-40e93d16fbfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:11.285370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d770d-5d96-4b57-959f-40e93d16fbfc admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:11.287597 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d770d-5d96-4b57-959f-40e93d16fbfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:11.289590 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d770d-5d96-4b57-959f-40e93d16fbfc admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:11.310169 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 893/1821] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:10 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:11.314503 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46685fc1-e253-4b96-b2a0-57183a1f1995 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:11.315014 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46685fc1-e253-4b96-b2a0-57183a1f1995 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:11.315553 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46685fc1-e253-4b96-b2a0-57183a1f1995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:11.349620 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 929/1822] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:10 2022] POST /identity/v3/users => generated 302 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:11.353929 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d770d-5d96-4b57-959f-40e93d16fbfc admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:11.355395 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-46685fc1-e253-4b96-b2a0-57183a1f1995 None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:11.356551 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-46685fc1-e253-4b96-b2a0-57183a1f1995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:11.358473 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f74d770d-5d96-4b57-959f-40e93d16fbfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:11.577696 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 894/1823] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:12:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 24 01:12:11.581726 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46685fc1-e253-4b96-b2a0-57183a1f1995 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:11.620486 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46685fc1-e253-4b96-b2a0-57183a1f1995 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:11.654004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049ad83-b308-4297-bc28-0b08a0badd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:11.654962 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049ad83-b308-4297-bc28-0b08a0badd50 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:11.655207 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049ad83-b308-4297-bc28-0b08a0badd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:11.655570 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7049ad83-b308-4297-bc28-0b08a0badd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:11.656439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049ad83-b308-4297-bc28-0b08a0badd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:11.658376 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7049ad83-b308-4297-bc28-0b08a0badd50 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:11.669092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d770d-5d96-4b57-959f-40e93d16fbfc admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:11.681879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a399c3-9d46-47af-b79c-a1b70cc48594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:11.690065 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 895/1824] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:11.691212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049ad83-b308-4297-bc28-0b08a0badd50 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:11.695663 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7049ad83-b308-4297-bc28-0b08a0badd50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:11.713666 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a399c3-9d46-47af-b79c-a1b70cc48594 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:11.714921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a399c3-9d46-47af-b79c-a1b70cc48594 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:11.716044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a399c3-9d46-47af-b79c-a1b70cc48594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:11.738051 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a399c3-9d46-47af-b79c-a1b70cc48594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:11.743110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a399c3-9d46-47af-b79c-a1b70cc48594 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:11.768664 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 930/1825] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:11 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:11.771366 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a399c3-9d46-47af-b79c-a1b70cc48594 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:11.802595 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a399c3-9d46-47af-b79c-a1b70cc48594 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:11.829459 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e702f7-1b1d-45f2-b6ee-00b7656b7a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:11.835114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e702f7-1b1d-45f2-b6ee-00b7656b7a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:11.842829 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:11.847657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e702f7-1b1d-45f2-b6ee-00b7656b7a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:11.848088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e702f7-1b1d-45f2-b6ee-00b7656b7a2b admin admin] PATH_INFO: `/v3/projects/89cbd2cc77d74f1694e88c79933cbdc3/users/13f49eac298e41059bedc4ec36c6e974/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:11.945928 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e702f7-1b1d-45f2-b6ee-00b7656b7a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89cbd2cc77d74f1694e88c79933cbdc3, user_id=13f49eac298e41059bedc4ec36c6e974, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:11.961209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e702f7-1b1d-45f2-b6ee-00b7656b7a2b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:12.019058 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7049ad83-b308-4297-bc28-0b08a0badd50 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:12.047376 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 931/1826] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:11 2022] PUT /identity/v3/projects/89cbd2cc77d74f1694e88c79933cbdc3/users/13f49eac298e41059bedc4ec36c6e974/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:12.060224 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e702f7-1b1d-45f2-b6ee-00b7656b7a2b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:12.342953 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca4525-44ed-4d51-b37e-e9120a853a72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:12.345029 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca4525-44ed-4d51-b37e-e9120a853a72 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:12.345029 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca4525-44ed-4d51-b37e-e9120a853a72 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:12.345754 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deca4525-44ed-4d51-b37e-e9120a853a72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:12.357951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e702f7-1b1d-45f2-b6ee-00b7656b7a2b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:12.390811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd4c75-d489-4e66-a5ad-8160d7e4491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:12.392780 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd4c75-d489-4e66-a5ad-8160d7e4491f admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:12.396181 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd4c75-d489-4e66-a5ad-8160d7e4491f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:12.403393 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd4c75-d489-4e66-a5ad-8160d7e4491f admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:12.404304 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd4c75-d489-4e66-a5ad-8160d7e4491f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:12.405985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd4c75-d489-4e66-a5ad-8160d7e4491f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:12.472002 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 932/1827] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:12.472859 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd4c75-d489-4e66-a5ad-8160d7e4491f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:12.530052 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd4c75-d489-4e66-a5ad-8160d7e4491f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:12.544608 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a26708-91ea-459e-aa8e-7eee8dbbe837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:12.547755 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a26708-91ea-459e-aa8e-7eee8dbbe837 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:12.548071 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a26708-91ea-459e-aa8e-7eee8dbbe837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:12.548331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a26708-91ea-459e-aa8e-7eee8dbbe837 admin admin] PATH_INFO: `/v3/projects/89cbd2cc77d74f1694e88c79933cbdc3/users/13f49eac298e41059bedc4ec36c6e974/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:12.552893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a26708-91ea-459e-aa8e-7eee8dbbe837 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89cbd2cc77d74f1694e88c79933cbdc3, user_id=13f49eac298e41059bedc4ec36c6e974, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:12.560909 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a26708-91ea-459e-aa8e-7eee8dbbe837 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:12.602660 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca4525-44ed-4d51-b37e-e9120a853a72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:12.604858 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deca4525-44ed-4d51-b37e-e9120a853a72 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:12.623547 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 933/1828] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:12 2022] PUT /identity/v3/projects/89cbd2cc77d74f1694e88c79933cbdc3/users/13f49eac298e41059bedc4ec36c6e974/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:12.625930 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd41ad-14e1-45a7-9bbf-05265983d453 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:12.626229 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd41ad-14e1-45a7-9bbf-05265983d453 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:12.626513 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cd41ad-14e1-45a7-9bbf-05265983d453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:12.669326 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 896/1829] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:12:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 978 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:12:12.701428 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f0cd41ad-14e1-45a7-9bbf-05265983d453 None None] MFA Rules not processed for user `13f49eac298e41059bedc4ec36c6e974`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:12.709280 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f0cd41ad-14e1-45a7-9bbf-05265983d453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:12.772167 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:13.005123 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 934/1830] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:13.019713 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca4525-44ed-4d51-b37e-e9120a853a72 service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:13.200071 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deca4525-44ed-4d51-b37e-e9120a853a72 service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:13.297448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:13.359472 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd41ad-14e1-45a7-9bbf-05265983d453 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:13.363758 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f0cd41ad-14e1-45a7-9bbf-05265983d453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:13.382872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cd41ad-14e1-45a7-9bbf-05265983d453 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:13.383826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c19cd5-7203-4de1-8317-9eb9c02e3d18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:13.384917 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c19cd5-7203-4de1-8317-9eb9c02e3d18 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:13.385382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c19cd5-7203-4de1-8317-9eb9c02e3d18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:13.385967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c19cd5-7203-4de1-8317-9eb9c02e3d18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:13.389514 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c012ce-5509-48b3-be70-39b77e604413 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:13.390229 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c012ce-5509-48b3-be70-39b77e604413 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:13.390511 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c012ce-5509-48b3-be70-39b77e604413 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:13.390817 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c012ce-5509-48b3-be70-39b77e604413 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:13.393011 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-34c012ce-5509-48b3-be70-39b77e604413 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:13.423093 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c19cd5-7203-4de1-8317-9eb9c02e3d18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:13.424741 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c19cd5-7203-4de1-8317-9eb9c02e3d18 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:13.475864 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 897/1831] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:13.614631 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c012ce-5509-48b3-be70-39b77e604413 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:13.634829 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c012ce-5509-48b3-be70-39b77e604413 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:13.679250 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 935/1832] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:13.719849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c19cd5-7203-4de1-8317-9eb9c02e3d18 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:13.731815 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c19cd5-7203-4de1-8317-9eb9c02e3d18 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:13.751640 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94eedd27-fa32-437a-a872-6fa11f880394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:13.752476 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eedd27-fa32-437a-a872-6fa11f880394 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:13.752836 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eedd27-fa32-437a-a872-6fa11f880394 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:13.753183 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94eedd27-fa32-437a-a872-6fa11f880394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:13.993663 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eedd27-fa32-437a-a872-6fa11f880394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:14.002554 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94eedd27-fa32-437a-a872-6fa11f880394 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:14.038405 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 898/1833] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:13 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:17.935923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feebf9b-0f58-4788-adde-33e7ec6b752b None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:17.936520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feebf9b-0f58-4788-adde-33e7ec6b752b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:17.936520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feebf9b-0f58-4788-adde-33e7ec6b752b None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:17.937894 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 936/1834] 10.222.0.42 () {54 vars in 921 bytes} [Sun Jul 24 01:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:12:18.026076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8bbac-7fd2-481c-b655-fb2f25a3fc52 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:18.026557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8bbac-7fd2-481c-b655-fb2f25a3fc52 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:18.026658 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab8bbac-7fd2-481c-b655-fb2f25a3fc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:18.064385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3ab8bbac-7fd2-481c-b655-fb2f25a3fc52 None None] MFA Rules not processed for user `6c32c443ee1a421e98e7656e8e86e27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:18.071232 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3ab8bbac-7fd2-481c-b655-fb2f25a3fc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:18.281848 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 899/1835] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Jul 24 01:12:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:19.799532 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feebf9b-0f58-4788-adde-33e7ec6b752b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:19.818834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feebf9b-0f58-4788-adde-33e7ec6b752b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:19.838625 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e371-3412-442d-8570-a2c571cd2221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:19.840737 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e371-3412-442d-8570-a2c571cd2221 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:19.841229 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e371-3412-442d-8570-a2c571cd2221 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:19.841865 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41e371-3412-442d-8570-a2c571cd2221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:19.991162 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41e371-3412-442d-8570-a2c571cd2221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:19.992979 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41e371-3412-442d-8570-a2c571cd2221 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:20.016893 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 937/1836] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:20.267512 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8bbac-7fd2-481c-b655-fb2f25a3fc52 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:20.270282 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3ab8bbac-7fd2-481c-b655-fb2f25a3fc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:20.303200 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab8bbac-7fd2-481c-b655-fb2f25a3fc52 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:20.313891 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb903c-d34a-4d7a-8d5a-bee487d88627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:20.315060 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb903c-d34a-4d7a-8d5a-bee487d88627 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:20.315751 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb903c-d34a-4d7a-8d5a-bee487d88627 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:20.316174 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb903c-d34a-4d7a-8d5a-bee487d88627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:20.333084 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb903c-d34a-4d7a-8d5a-bee487d88627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:20.336030 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb903c-d34a-4d7a-8d5a-bee487d88627 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:20.375460 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 900/1837] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:20.570227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e371-3412-442d-8570-a2c571cd2221 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:20.788934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:20.822021 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41e371-3412-442d-8570-a2c571cd2221 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:20.829405 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec10ab8-077b-466b-a388-493febf98927 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:20.829701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec10ab8-077b-466b-a388-493febf98927 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:20.830007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec10ab8-077b-466b-a388-493febf98927 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:20.834006 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 901/1838] 10.222.0.42 () {54 vars in 921 bytes} [Sun Jul 24 01:12:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:12:20.873901 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a6307-3c6c-4dff-a4bf-99ebbcfdda2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:20.875228 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a6307-3c6c-4dff-a4bf-99ebbcfdda2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:20.875553 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a6307-3c6c-4dff-a4bf-99ebbcfdda2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:20.875877 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a6307-3c6c-4dff-a4bf-99ebbcfdda2c admin admin] PATH_INFO: `/v3/users/5d5b161a7eec4d1e8c085abc1d9cb826` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:20.882614 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a6307-3c6c-4dff-a4bf-99ebbcfdda2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d5b161a7eec4d1e8c085abc1d9cb826)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:20.893750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a6307-3c6c-4dff-a4bf-99ebbcfdda2c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:20.898747 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14828288-b25c-40ea-9488-87f240625f11 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:20.899910 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14828288-b25c-40ea-9488-87f240625f11 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:20.900380 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14828288-b25c-40ea-9488-87f240625f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:20.942611 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-14828288-b25c-40ea-9488-87f240625f11 None None] MFA Rules not processed for user `6c32c443ee1a421e98e7656e8e86e27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:20.948890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-14828288-b25c-40ea-9488-87f240625f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:21.004095 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 902/1839] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Jul 24 01:12:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:21.043856 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-420a6307-3c6c-4dff-a4bf-99ebbcfdda2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d5b161a7eec4d1e8c085abc1d9cb826'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:21.045231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-420a6307-3c6c-4dff-a4bf-99ebbcfdda2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d5b161a7eec4d1e8c085abc1d9cb826'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:21.076140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-420a6307-3c6c-4dff-a4bf-99ebbcfdda2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d5b161a7eec4d1e8c085abc1d9cb826'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:21.077412 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-420a6307-3c6c-4dff-a4bf-99ebbcfdda2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d5b161a7eec4d1e8c085abc1d9cb826'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:21.100841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-420a6307-3c6c-4dff-a4bf-99ebbcfdda2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d5b161a7eec4d1e8c085abc1d9cb826'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:21.160448 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 938/1840] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:20 2022] DELETE /identity/v3/users/5d5b161a7eec4d1e8c085abc1d9cb826 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:21.161804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6455b-7c28-45ed-bd51-3b2a5e21b16b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:21.162348 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6455b-7c28-45ed-bd51-3b2a5e21b16b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:21.162834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f6455b-7c28-45ed-bd51-3b2a5e21b16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:21.218431 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-37f6455b-7c28-45ed-bd51-3b2a5e21b16b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:21.220357 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-37f6455b-7c28-45ed-bd51-3b2a5e21b16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:21.335694 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:21.372022 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 903/1841] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:21.417609 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a6307-3c6c-4dff-a4bf-99ebbcfdda2c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:21.420508 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-420a6307-3c6c-4dff-a4bf-99ebbcfdda2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:21.452189 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a6307-3c6c-4dff-a4bf-99ebbcfdda2c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:21.460111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645bdb7-403d-4e97-801e-6615fec9b582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:21.461608 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645bdb7-403d-4e97-801e-6615fec9b582 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:21.462084 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645bdb7-403d-4e97-801e-6615fec9b582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:21.462773 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645bdb7-403d-4e97-801e-6615fec9b582 admin admin] PATH_INFO: `/v3/users/229483b90aa5441d89dc13536d9bd7f0` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:21.465943 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645bdb7-403d-4e97-801e-6615fec9b582 admin admin] RBAC: Authorizing `identity:delete_user(user_id=229483b90aa5441d89dc13536d9bd7f0)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:21.468457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645bdb7-403d-4e97-801e-6615fec9b582 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:21.469192 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6455b-7c28-45ed-bd51-3b2a5e21b16b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:21.470862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-37f6455b-7c28-45ed-bd51-3b2a5e21b16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:21.599788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6645bdb7-403d-4e97-801e-6615fec9b582 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229483b90aa5441d89dc13536d9bd7f0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:21.600507 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6645bdb7-403d-4e97-801e-6615fec9b582 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229483b90aa5441d89dc13536d9bd7f0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:21.620623 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6645bdb7-403d-4e97-801e-6615fec9b582 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229483b90aa5441d89dc13536d9bd7f0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:21.621283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6645bdb7-403d-4e97-801e-6615fec9b582 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229483b90aa5441d89dc13536d9bd7f0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:21.640635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6645bdb7-403d-4e97-801e-6615fec9b582 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229483b90aa5441d89dc13536d9bd7f0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:21.696685 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 939/1842] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:21 2022] DELETE /identity/v3/users/229483b90aa5441d89dc13536d9bd7f0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:21.701934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a78d0-c274-47c1-abfd-7192414dbbb7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:21.702284 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a78d0-c274-47c1-abfd-7192414dbbb7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:21.702624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a78d0-c274-47c1-abfd-7192414dbbb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:21.713544 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f6455b-7c28-45ed-bd51-3b2a5e21b16b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:21.771438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-708a78d0-c274-47c1-abfd-7192414dbbb7 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:21.776464 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-708a78d0-c274-47c1-abfd-7192414dbbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:21.878632 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a8653-092e-45c3-9abc-23afb3847996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:21.880324 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a8653-092e-45c3-9abc-23afb3847996 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:21.880793 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a8653-092e-45c3-9abc-23afb3847996 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:21.881567 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8a8653-092e-45c3-9abc-23afb3847996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:21.884103 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6d8a8653-092e-45c3-9abc-23afb3847996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:21.912087 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:21.951417 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 940/1843] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:21.975286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a78d0-c274-47c1-abfd-7192414dbbb7 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:21.977661 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-708a78d0-c274-47c1-abfd-7192414dbbb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:22.012797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a78d0-c274-47c1-abfd-7192414dbbb7 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:22.028070 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a8653-092e-45c3-9abc-23afb3847996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:22.028257 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0aeab-74d9-451a-ad77-632418316356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:22.029256 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0aeab-74d9-451a-ad77-632418316356 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:22.029427 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0aeab-74d9-451a-ad77-632418316356 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:22.030445 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0aeab-74d9-451a-ad77-632418316356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:22.051372 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8a8653-092e-45c3-9abc-23afb3847996 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:22.070420 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0aeab-74d9-451a-ad77-632418316356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:22.072265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0aeab-74d9-451a-ad77-632418316356 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:22.083520 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 904/1844] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:22.084523 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a8653-092e-45c3-9abc-23afb3847996 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:22.092117 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6d8a8653-092e-45c3-9abc-23afb3847996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:22.111464 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 941/1845] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:12:22.227197 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:22.251110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8a8653-092e-45c3-9abc-23afb3847996 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:22.258744 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76756f85-b4b3-496a-8919-40b23b0e2dbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:22.260099 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76756f85-b4b3-496a-8919-40b23b0e2dbc service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:22.260969 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76756f85-b4b3-496a-8919-40b23b0e2dbc service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:22.261271 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76756f85-b4b3-496a-8919-40b23b0e2dbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:22.263109 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-76756f85-b4b3-496a-8919-40b23b0e2dbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:22.277076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76756f85-b4b3-496a-8919-40b23b0e2dbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:22.278759 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76756f85-b4b3-496a-8919-40b23b0e2dbc service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:22.290777 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 905/1846] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:22.785719 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0aeab-74d9-451a-ad77-632418316356 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:22.787275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-07b0aeab-74d9-451a-ad77-632418316356 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:22.829775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0aeab-74d9-451a-ad77-632418316356 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:22.836203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76756f85-b4b3-496a-8919-40b23b0e2dbc service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:22.837592 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-76756f85-b4b3-496a-8919-40b23b0e2dbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:22.840008 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d8b88-6d51-44c4-ba46-de075085414f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:22.840926 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d8b88-6d51-44c4-ba46-de075085414f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:22.841714 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d8b88-6d51-44c4-ba46-de075085414f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:22.842014 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d8b88-6d51-44c4-ba46-de075085414f admin admin] PATH_INFO: `/v3/projects/429c66e8d73043e1809af23a7fb07110` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:22.843288 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d8b88-6d51-44c4-ba46-de075085414f admin admin] RBAC: Authorizing `identity:delete_project(project_id=429c66e8d73043e1809af23a7fb07110)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:22.845417 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d8b88-6d51-44c4-ba46-de075085414f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:22.851811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76756f85-b4b3-496a-8919-40b23b0e2dbc service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:22.867802 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:22.869133 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:22.869578 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:22.870028 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7 admin admin] PATH_INFO: `/v3/projects/da11855c351a48d6a68c1f4c157ab1c1` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:22.871992 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da11855c351a48d6a68c1f4c157ab1c1)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:22.875021 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:22.907862 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3b5d8b88-6d51-44c4-ba46-de075085414f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '429c66e8d73043e1809af23a7fb07110', 'request_id': 'req-3b5d8b88-6d51-44c4-ba46-de075085414f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:22.915131 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3b5d8b88-6d51-44c4-ba46-de075085414f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '429c66e8d73043e1809af23a7fb07110', 'request_id': 'req-3b5d8b88-6d51-44c4-ba46-de075085414f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:22.922747 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3b5d8b88-6d51-44c4-ba46-de075085414f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '429c66e8d73043e1809af23a7fb07110', 'request_id': 'req-3b5d8b88-6d51-44c4-ba46-de075085414f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:22.938559 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da11855c351a48d6a68c1f4c157ab1c1', 'request_id': 'req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:22.945706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3b5d8b88-6d51-44c4-ba46-de075085414f admin admin] The token cache is being invalidate because project 429c66e8d73043e1809af23a7fb07110 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:22.946513 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3b5d8b88-6d51-44c4-ba46-de075085414f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:22.947325 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3b5d8b88-6d51-44c4-ba46-de075085414f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:22.949069 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 942/1847] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:22 2022] DELETE /identity/v3/projects/429c66e8d73043e1809af23a7fb07110 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:22.952199 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da11855c351a48d6a68c1f4c157ab1c1', 'request_id': 'req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:22.954261 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d8b88-6d51-44c4-ba46-de075085414f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:22.957176 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3b5d8b88-6d51-44c4-ba46-de075085414f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:22.959187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da11855c351a48d6a68c1f4c157ab1c1', 'request_id': 'req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:22.977110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7 admin admin] The token cache is being invalidate because project da11855c351a48d6a68c1f4c157ab1c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:22.977510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:22.978313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:22.980679 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 906/1848] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:22 2022] DELETE /identity/v3/projects/da11855c351a48d6a68c1f4c157ab1c1 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:22.984334 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:22.985825 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:23.028317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d8b88-6d51-44c4-ba46-de075085414f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:23.058842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6104d624-2dd1-47ce-adb4-84ce2b68e2d7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:23.066852 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5c88e-48df-4556-b4cb-c3b8dd1a0a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:23.067894 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5c88e-48df-4556-b4cb-c3b8dd1a0a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:23.068347 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5c88e-48df-4556-b4cb-c3b8dd1a0a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:23.068775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f5c88e-48df-4556-b4cb-c3b8dd1a0a1b admin admin] PATH_INFO: `/v3/users/bdcdc45c27684ac5b0dde8581487e087` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:23.070717 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5c88e-48df-4556-b4cb-c3b8dd1a0a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdcdc45c27684ac5b0dde8581487e087)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:23.073127 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f5c88e-48df-4556-b4cb-c3b8dd1a0a1b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:23.135538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c08f3-0586-474a-82c6-6d7e9cb0505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:23.138315 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c08f3-0586-474a-82c6-6d7e9cb0505f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:23.140388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c08f3-0586-474a-82c6-6d7e9cb0505f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:23.140780 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49c08f3-0586-474a-82c6-6d7e9cb0505f admin admin] PATH_INFO: `/v3/users/13f49eac298e41059bedc4ec36c6e974` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:23.146605 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c08f3-0586-474a-82c6-6d7e9cb0505f admin admin] RBAC: Authorizing `identity:delete_user(user_id=13f49eac298e41059bedc4ec36c6e974)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:23.149369 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49c08f3-0586-474a-82c6-6d7e9cb0505f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:23.162813 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:23.168194 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-22f5c88e-48df-4556-b4cb-c3b8dd1a0a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdcdc45c27684ac5b0dde8581487e087'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.168985 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-22f5c88e-48df-4556-b4cb-c3b8dd1a0a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdcdc45c27684ac5b0dde8581487e087'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.169617 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-22f5c88e-48df-4556-b4cb-c3b8dd1a0a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdcdc45c27684ac5b0dde8581487e087'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.181456 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-22f5c88e-48df-4556-b4cb-c3b8dd1a0a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdcdc45c27684ac5b0dde8581487e087'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.191191 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:23.196591 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-22f5c88e-48df-4556-b4cb-c3b8dd1a0a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdcdc45c27684ac5b0dde8581487e087'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.217305 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 907/1849] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:22 2022] DELETE /identity/v3/users/bdcdc45c27684ac5b0dde8581487e087 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:23.244245 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b49c08f3-0586-474a-82c6-6d7e9cb0505f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13f49eac298e41059bedc4ec36c6e974'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.245299 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b49c08f3-0586-474a-82c6-6d7e9cb0505f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13f49eac298e41059bedc4ec36c6e974'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.256920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b49c08f3-0586-474a-82c6-6d7e9cb0505f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13f49eac298e41059bedc4ec36c6e974'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.257857 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b49c08f3-0586-474a-82c6-6d7e9cb0505f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13f49eac298e41059bedc4ec36c6e974'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.267401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b49c08f3-0586-474a-82c6-6d7e9cb0505f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13f49eac298e41059bedc4ec36c6e974'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.299480 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 943/1850] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:22 2022] DELETE /identity/v3/users/13f49eac298e41059bedc4ec36c6e974 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:23.431481 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5c88e-48df-4556-b4cb-c3b8dd1a0a1b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:23.433068 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-22f5c88e-48df-4556-b4cb-c3b8dd1a0a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:23.548934 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f5c88e-48df-4556-b4cb-c3b8dd1a0a1b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:23.625996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3a02d6-a153-402c-be4e-0b7e4b528ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:23.626980 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a02d6-a153-402c-be4e-0b7e4b528ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:23.627229 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a02d6-a153-402c-be4e-0b7e4b528ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:23.627597 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3a02d6-a153-402c-be4e-0b7e4b528ee6 admin admin] PATH_INFO: `/v3/users/b261b853e1a44edcacfb20c5340a5088` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:23.629127 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a02d6-a153-402c-be4e-0b7e4b528ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b261b853e1a44edcacfb20c5340a5088)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:23.631682 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3a02d6-a153-402c-be4e-0b7e4b528ee6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:23.697733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-eb3a02d6-a153-402c-be4e-0b7e4b528ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b261b853e1a44edcacfb20c5340a5088'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.698414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-eb3a02d6-a153-402c-be4e-0b7e4b528ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b261b853e1a44edcacfb20c5340a5088'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.699022 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-eb3a02d6-a153-402c-be4e-0b7e4b528ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b261b853e1a44edcacfb20c5340a5088'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.708807 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-eb3a02d6-a153-402c-be4e-0b7e4b528ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b261b853e1a44edcacfb20c5340a5088'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.726388 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-eb3a02d6-a153-402c-be4e-0b7e4b528ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b261b853e1a44edcacfb20c5340a5088'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.731623 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c08f3-0586-474a-82c6-6d7e9cb0505f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:23.733546 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b49c08f3-0586-474a-82c6-6d7e9cb0505f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:23.751401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49c08f3-0586-474a-82c6-6d7e9cb0505f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:23.757257 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b482521-2cd0-48d8-9110-521ef23168aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:23.758491 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b482521-2cd0-48d8-9110-521ef23168aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:23.758882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b482521-2cd0-48d8-9110-521ef23168aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:23.759260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b482521-2cd0-48d8-9110-521ef23168aa admin admin] PATH_INFO: `/v3/projects/89cbd2cc77d74f1694e88c79933cbdc3` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:23.760780 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b482521-2cd0-48d8-9110-521ef23168aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=89cbd2cc77d74f1694e88c79933cbdc3)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:23.763227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b482521-2cd0-48d8-9110-521ef23168aa admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:23.763970 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 908/1851] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:23 2022] DELETE /identity/v3/users/b261b853e1a44edcacfb20c5340a5088 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:23.766007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ace82-533e-4f5e-a92c-179376bcea61 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:23.766289 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ace82-533e-4f5e-a92c-179376bcea61 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:23.766647 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920ace82-533e-4f5e-a92c-179376bcea61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:23.789739 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-920ace82-533e-4f5e-a92c-179376bcea61 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:23.791119 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-920ace82-533e-4f5e-a92c-179376bcea61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:23.796075 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:23.860079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5b482521-2cd0-48d8-9110-521ef23168aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89cbd2cc77d74f1694e88c79933cbdc3', 'request_id': 'req-5b482521-2cd0-48d8-9110-521ef23168aa'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.867048 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5b482521-2cd0-48d8-9110-521ef23168aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89cbd2cc77d74f1694e88c79933cbdc3', 'request_id': 'req-5b482521-2cd0-48d8-9110-521ef23168aa'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.874092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5b482521-2cd0-48d8-9110-521ef23168aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89cbd2cc77d74f1694e88c79933cbdc3', 'request_id': 'req-5b482521-2cd0-48d8-9110-521ef23168aa'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.878291 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 909/1852] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:23.889299 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ace82-533e-4f5e-a92c-179376bcea61 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:23.892210 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5b482521-2cd0-48d8-9110-521ef23168aa admin admin] The token cache is being invalidate because project 89cbd2cc77d74f1694e88c79933cbdc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:23.892403 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5b482521-2cd0-48d8-9110-521ef23168aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.893150 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5b482521-2cd0-48d8-9110-521ef23168aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:23.893257 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-920ace82-533e-4f5e-a92c-179376bcea61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:23.894963 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 944/1853] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:23 2022] DELETE /identity/v3/projects/89cbd2cc77d74f1694e88c79933cbdc3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:23.899872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58713b-8ce0-4684-bda7-ff085bafa554 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:23.900164 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58713b-8ce0-4684-bda7-ff085bafa554 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:23.900449 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b58713b-8ce0-4684-bda7-ff085bafa554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:23.922316 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-8b58713b-8ce0-4684-bda7-ff085bafa554 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:23.931313 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8b58713b-8ce0-4684-bda7-ff085bafa554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:23.991463 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920ace82-533e-4f5e-a92c-179376bcea61 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.022962 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 945/1854] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:24.024230 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58713b-8ce0-4684-bda7-ff085bafa554 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.025709 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8b58713b-8ce0-4684-bda7-ff085bafa554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:24.038149 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b58713b-8ce0-4684-bda7-ff085bafa554 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.043052 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60178130-ab15-426a-9c1e-159c0d600a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.043968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60178130-ab15-426a-9c1e-159c0d600a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.044258 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60178130-ab15-426a-9c1e-159c0d600a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.044540 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60178130-ab15-426a-9c1e-159c0d600a44 admin admin] PATH_INFO: `/v3/projects/efc40d483a13492d8c5a71f60eb6ee92` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.046217 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60178130-ab15-426a-9c1e-159c0d600a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc40d483a13492d8c5a71f60eb6ee92)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.048272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60178130-ab15-426a-9c1e-159c0d600a44 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.055773 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:24.056926 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f01b53-ea2f-47bb-b110-c44a21f80360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.057750 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f01b53-ea2f-47bb-b110-c44a21f80360 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.057860 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f01b53-ea2f-47bb-b110-c44a21f80360 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.058211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f01b53-ea2f-47bb-b110-c44a21f80360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.061209 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-84f01b53-ea2f-47bb-b110-c44a21f80360 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:24.074055 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f01b53-ea2f-47bb-b110-c44a21f80360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.075545 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f01b53-ea2f-47bb-b110-c44a21f80360 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.085692 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 910/1855] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:24.086925 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339db9d6-a4d0-49ca-bfee-81e00093b183 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.087220 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339db9d6-a4d0-49ca-bfee-81e00093b183 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.087548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339db9d6-a4d0-49ca-bfee-81e00093b183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.101444 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-60178130-ab15-426a-9c1e-159c0d600a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc40d483a13492d8c5a71f60eb6ee92', 'request_id': 'req-60178130-ab15-426a-9c1e-159c0d600a44'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:24.105580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-339db9d6-a4d0-49ca-bfee-81e00093b183 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:24.106926 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-339db9d6-a4d0-49ca-bfee-81e00093b183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:24.108762 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-60178130-ab15-426a-9c1e-159c0d600a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc40d483a13492d8c5a71f60eb6ee92', 'request_id': 'req-60178130-ab15-426a-9c1e-159c0d600a44'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:24.115270 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-60178130-ab15-426a-9c1e-159c0d600a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc40d483a13492d8c5a71f60eb6ee92', 'request_id': 'req-60178130-ab15-426a-9c1e-159c0d600a44'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:24.146383 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-60178130-ab15-426a-9c1e-159c0d600a44 admin admin] The token cache is being invalidate because project efc40d483a13492d8c5a71f60eb6ee92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:24.146757 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-60178130-ab15-426a-9c1e-159c0d600a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:24.152383 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-60178130-ab15-426a-9c1e-159c0d600a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:24.156984 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 946/1856] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:24 2022] DELETE /identity/v3/projects/efc40d483a13492d8c5a71f60eb6ee92 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:24.161011 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3581db-2636-46b2-b7f4-afdd1ce1de74 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.161425 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3581db-2636-46b2-b7f4-afdd1ce1de74 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.161810 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3581db-2636-46b2-b7f4-afdd1ce1de74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.184582 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3b3581db-2636-46b2-b7f4-afdd1ce1de74 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:24.185821 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3b3581db-2636-46b2-b7f4-afdd1ce1de74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:24.212123 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 911/1857] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:24.216760 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339db9d6-a4d0-49ca-bfee-81e00093b183 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.226346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339db9d6-a4d0-49ca-bfee-81e00093b183 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.231693 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a340812-6d89-48fa-8370-2bd6fb6381d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.232496 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a340812-6d89-48fa-8370-2bd6fb6381d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.232885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a340812-6d89-48fa-8370-2bd6fb6381d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.233036 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a340812-6d89-48fa-8370-2bd6fb6381d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.233805 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a340812-6d89-48fa-8370-2bd6fb6381d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:24.234109 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a340812-6d89-48fa-8370-2bd6fb6381d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.235805 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a340812-6d89-48fa-8370-2bd6fb6381d8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.238527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:24.252507 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 912/1858] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:12:24.255343 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 947/1859] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:24.256861 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a340812-6d89-48fa-8370-2bd6fb6381d8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.262406 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bde33-e5eb-4151-be6e-ec727614a206 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.262772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bde33-e5eb-4151-be6e-ec727614a206 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.263119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bde33-e5eb-4151-be6e-ec727614a206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.267664 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a340812-6d89-48fa-8370-2bd6fb6381d8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.272814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d8953-0eec-47f7-8cc2-f0a415d39f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.273529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d8953-0eec-47f7-8cc2-f0a415d39f01 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.273908 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d8953-0eec-47f7-8cc2-f0a415d39f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.274254 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068d8953-0eec-47f7-8cc2-f0a415d39f01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.275170 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d8953-0eec-47f7-8cc2-f0a415d39f01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.277404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068d8953-0eec-47f7-8cc2-f0a415d39f01 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.281589 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-051bde33-e5eb-4151-be6e-ec727614a206 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:24.282935 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-051bde33-e5eb-4151-be6e-ec727614a206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:24.292324 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 948/1860] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:24.296274 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bde33-e5eb-4151-be6e-ec727614a206 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.306422 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bde33-e5eb-4151-be6e-ec727614a206 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.311455 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0406c67-95aa-4013-ae71-77c162d873ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.312029 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 913/1861] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:24 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:12:24.312462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0406c67-95aa-4013-ae71-77c162d873ba admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.312640 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0406c67-95aa-4013-ae71-77c162d873ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.313006 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0406c67-95aa-4013-ae71-77c162d873ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.313805 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0406c67-95aa-4013-ae71-77c162d873ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:24.314176 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0406c67-95aa-4013-ae71-77c162d873ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.315729 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d8953-0eec-47f7-8cc2-f0a415d39f01 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.316317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0406c67-95aa-4013-ae71-77c162d873ba admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.333579 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 949/1862] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:12:24.334574 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0406c67-95aa-4013-ae71-77c162d873ba admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.346497 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0406c67-95aa-4013-ae71-77c162d873ba admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.421830 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068d8953-0eec-47f7-8cc2-f0a415d39f01 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.429293 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e33c0b-a59c-4f09-9fbe-a4d1f00d5f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.430282 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e33c0b-a59c-4f09-9fbe-a4d1f00d5f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.430832 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e33c0b-a59c-4f09-9fbe-a4d1f00d5f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.431288 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e33c0b-a59c-4f09-9fbe-a4d1f00d5f00 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.432123 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e33c0b-a59c-4f09-9fbe-a4d1f00d5f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.433969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f1a3-aac0-4e26-8657-8fa4c8415ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.434404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e33c0b-a59c-4f09-9fbe-a4d1f00d5f00 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.434706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f1a3-aac0-4e26-8657-8fa4c8415ff2 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.437285 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f1a3-aac0-4e26-8657-8fa4c8415ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.437285 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62f1a3-aac0-4e26-8657-8fa4c8415ff2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.437285 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62f1a3-aac0-4e26-8657-8fa4c8415ff2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.438919 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a62f1a3-aac0-4e26-8657-8fa4c8415ff2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.456527 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:24.468497 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 914/1863] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:24 2022] POST /identity/v3/users => generated 305 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:12:24.472681 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e33c0b-a59c-4f09-9fbe-a4d1f00d5f00 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.482978 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 950/1864] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:24 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:12:24.487399 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f1a3-aac0-4e26-8657-8fa4c8415ff2 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.491224 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e33c0b-a59c-4f09-9fbe-a4d1f00d5f00 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.575433 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62f1a3-aac0-4e26-8657-8fa4c8415ff2 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.581984 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13efbd9-dd3e-46d2-a709-05e692656e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.582623 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13efbd9-dd3e-46d2-a709-05e692656e5b admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.582887 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13efbd9-dd3e-46d2-a709-05e692656e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.583246 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13efbd9-dd3e-46d2-a709-05e692656e5b admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.584235 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13efbd9-dd3e-46d2-a709-05e692656e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.585126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd011dc8-44d1-4fc0-a534-8402114ac9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.585984 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd011dc8-44d1-4fc0-a534-8402114ac9ad admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.586313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd011dc8-44d1-4fc0-a534-8402114ac9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.586661 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd011dc8-44d1-4fc0-a534-8402114ac9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.587324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13efbd9-dd3e-46d2-a709-05e692656e5b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.587615 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd011dc8-44d1-4fc0-a534-8402114ac9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.589323 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd011dc8-44d1-4fc0-a534-8402114ac9ad admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.613254 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 951/1865] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:24 2022] POST /identity/v3/users => generated 285 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:12:24.614462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13efbd9-dd3e-46d2-a709-05e692656e5b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.618577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a13efbd9-dd3e-46d2-a709-05e692656e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:24.619260 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 915/1866] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:24.620498 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd011dc8-44d1-4fc0-a534-8402114ac9ad admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.631145 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13efbd9-dd3e-46d2-a709-05e692656e5b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.632515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd011dc8-44d1-4fc0-a534-8402114ac9ad admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.636097 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f69c3-25fa-4c7b-a26b-b68781835be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.636984 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f69c3-25fa-4c7b-a26b-b68781835be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.637270 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f69c3-25fa-4c7b-a26b-b68781835be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.637582 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f69c3-25fa-4c7b-a26b-b68781835be5 admin admin] PATH_INFO: `/v3/projects/5c3ea856d9104cb9b814bd832195f6f1` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.638813 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f69c3-25fa-4c7b-a26b-b68781835be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c3ea856d9104cb9b814bd832195f6f1)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.639679 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec458996-2037-41fd-b0af-59d1dd0b1f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.640512 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec458996-2037-41fd-b0af-59d1dd0b1f69 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.640761 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f69c3-25fa-4c7b-a26b-b68781835be5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.641094 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec458996-2037-41fd-b0af-59d1dd0b1f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.641544 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec458996-2037-41fd-b0af-59d1dd0b1f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.642413 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec458996-2037-41fd-b0af-59d1dd0b1f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.644467 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec458996-2037-41fd-b0af-59d1dd0b1f69 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.657075 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 916/1867] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:24.658296 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec458996-2037-41fd-b0af-59d1dd0b1f69 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.682947 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec458996-2037-41fd-b0af-59d1dd0b1f69 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.693584 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f0434-b3d4-4185-9a0c-e5b7b4319498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.694277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f0434-b3d4-4185-9a0c-e5b7b4319498 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.694566 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f0434-b3d4-4185-9a0c-e5b7b4319498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.694846 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79f0434-b3d4-4185-9a0c-e5b7b4319498 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.695617 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f0434-b3d4-4185-9a0c-e5b7b4319498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.697244 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79f0434-b3d4-4185-9a0c-e5b7b4319498 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.708406 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-bc3f69c3-25fa-4c7b-a26b-b68781835be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c3ea856d9104cb9b814bd832195f6f1', 'request_id': 'req-bc3f69c3-25fa-4c7b-a26b-b68781835be5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:24.708722 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 917/1868] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:24.709525 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f0434-b3d4-4185-9a0c-e5b7b4319498 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.718456 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-bc3f69c3-25fa-4c7b-a26b-b68781835be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c3ea856d9104cb9b814bd832195f6f1', 'request_id': 'req-bc3f69c3-25fa-4c7b-a26b-b68781835be5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:24.718970 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79f0434-b3d4-4185-9a0c-e5b7b4319498 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.724925 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-bc3f69c3-25fa-4c7b-a26b-b68781835be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c3ea856d9104cb9b814bd832195f6f1', 'request_id': 'req-bc3f69c3-25fa-4c7b-a26b-b68781835be5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:24.738303 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-bc3f69c3-25fa-4c7b-a26b-b68781835be5 admin admin] The token cache is being invalidate because project 5c3ea856d9104cb9b814bd832195f6f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:24.738592 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-bc3f69c3-25fa-4c7b-a26b-b68781835be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:24.739275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-bc3f69c3-25fa-4c7b-a26b-b68781835be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:24.740886 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 952/1869] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:24 2022] DELETE /identity/v3/projects/5c3ea856d9104cb9b814bd832195f6f1 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:24.741615 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f69c3-25fa-4c7b-a26b-b68781835be5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.742904 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bc3f69c3-25fa-4c7b-a26b-b68781835be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:24.754028 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:24.778564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885946f-ab9a-433c-adc8-112802ff43d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.779378 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885946f-ab9a-433c-adc8-112802ff43d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.779667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885946f-ab9a-433c-adc8-112802ff43d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.779944 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4885946f-ab9a-433c-adc8-112802ff43d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.780677 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885946f-ab9a-433c-adc8-112802ff43d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.782438 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4885946f-ab9a-433c-adc8-112802ff43d5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.796263 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 918/1870] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:24 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:24.796263 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885946f-ab9a-433c-adc8-112802ff43d5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.796263 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4885946f-ab9a-433c-adc8-112802ff43d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:24.809534 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4885946f-ab9a-433c-adc8-112802ff43d5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.811572 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f69c3-25fa-4c7b-a26b-b68781835be5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.814286 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad94201-e2a1-4d79-976a-b851b98972b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.815233 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad94201-e2a1-4d79-976a-b851b98972b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.815557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad94201-e2a1-4d79-976a-b851b98972b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.815838 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad94201-e2a1-4d79-976a-b851b98972b2 admin admin] PATH_INFO: `/v3/users/154f59e7070647089bfc274f554ca13c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.816264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d886d-710f-4ca4-9643-029b1a0d9f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:24.817202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad94201-e2a1-4d79-976a-b851b98972b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=154f59e7070647089bfc274f554ca13c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.817840 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d886d-710f-4ca4-9643-029b1a0d9f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.817840 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d886d-710f-4ca4-9643-029b1a0d9f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.818000 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d886d-710f-4ca4-9643-029b1a0d9f87 admin admin] PATH_INFO: `/v3/projects/b1a33991cb9049b993bfd80219f5d402/users/b3a783a787624362a82a36583e9b832d/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.819171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad94201-e2a1-4d79-976a-b851b98972b2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.830227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:24.834121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d886d-710f-4ca4-9643-029b1a0d9f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a33991cb9049b993bfd80219f5d402, user_id=b3a783a787624362a82a36583e9b832d, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:24.836982 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d886d-710f-4ca4-9643-029b1a0d9f87 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:24.854219 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 953/1871] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:24 2022] PUT /identity/v3/projects/b1a33991cb9049b993bfd80219f5d402/users/b3a783a787624362a82a36583e9b832d/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:24.863329 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d886d-710f-4ca4-9643-029b1a0d9f87 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:24.863329 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-df0d886d-710f-4ca4-9643-029b1a0d9f87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:24.878817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3ad94201-e2a1-4d79-976a-b851b98972b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '154f59e7070647089bfc274f554ca13c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:24.879556 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3ad94201-e2a1-4d79-976a-b851b98972b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '154f59e7070647089bfc274f554ca13c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:24.880170 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3ad94201-e2a1-4d79-976a-b851b98972b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '154f59e7070647089bfc274f554ca13c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:24.887257 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3ad94201-e2a1-4d79-976a-b851b98972b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '154f59e7070647089bfc274f554ca13c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:24.899882 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3ad94201-e2a1-4d79-976a-b851b98972b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '154f59e7070647089bfc274f554ca13c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:24.913753 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 919/1872] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:24 2022] DELETE /identity/v3/users/154f59e7070647089bfc274f554ca13c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:24.915035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327b208-2f4c-4ade-ae77-9e290bd5c8e4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:24.915319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327b208-2f4c-4ade-ae77-9e290bd5c8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:24.915619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327b208-2f4c-4ade-ae77-9e290bd5c8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:24.922925 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d886d-710f-4ca4-9643-029b1a0d9f87 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:24.944859 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3327b208-2f4c-4ade-ae77-9e290bd5c8e4 None None] MFA Rules not processed for user `b3a783a787624362a82a36583e9b832d`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:24.946437 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3327b208-2f4c-4ade-ae77-9e290bd5c8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:25.000232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f1d0c7-730d-40ec-a0ce-cfb5506bd57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:25.001451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1d0c7-730d-40ec-a0ce-cfb5506bd57b admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.001829 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1d0c7-730d-40ec-a0ce-cfb5506bd57b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.002207 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f1d0c7-730d-40ec-a0ce-cfb5506bd57b admin admin] PATH_INFO: `/v3/projects/5fe958308d3c43a089f5eabe2196860e/users/c737c83002584707ab47ce17d7f37222/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.020672 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1d0c7-730d-40ec-a0ce-cfb5506bd57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe958308d3c43a089f5eabe2196860e, user_id=c737c83002584707ab47ce17d7f37222, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:25.023488 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f1d0c7-730d-40ec-a0ce-cfb5506bd57b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:25.051778 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 954/1873] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:24 2022] PUT /identity/v3/projects/5fe958308d3c43a089f5eabe2196860e/users/c737c83002584707ab47ce17d7f37222/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:25.055564 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 920/1874] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:25.055695 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921d7ee-fcec-436e-8a2b-0b0392ce7d17 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.057814 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921d7ee-fcec-436e-8a2b-0b0392ce7d17 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.057814 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921d7ee-fcec-436e-8a2b-0b0392ce7d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.063636 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327b208-2f4c-4ade-ae77-9e290bd5c8e4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:25.073635 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3327b208-2f4c-4ade-ae77-9e290bd5c8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:25.093684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327b208-2f4c-4ade-ae77-9e290bd5c8e4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:25.110550 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4921d7ee-fcec-436e-8a2b-0b0392ce7d17 None None] MFA Rules not processed for user `c737c83002584707ab47ce17d7f37222`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:25.113513 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4921d7ee-fcec-436e-8a2b-0b0392ce7d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:25.152552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:25.188994 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802872e-aa42-42fa-9331-caef8c7209cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:25.189946 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802872e-aa42-42fa-9331-caef8c7209cc admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.190387 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802872e-aa42-42fa-9331-caef8c7209cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.190833 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802872e-aa42-42fa-9331-caef8c7209cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.191570 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802872e-aa42-42fa-9331-caef8c7209cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:25.193706 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7802872e-aa42-42fa-9331-caef8c7209cc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:25.215892 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 955/1875] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:25.218117 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921d7ee-fcec-436e-8a2b-0b0392ce7d17 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:25.220202 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4921d7ee-fcec-436e-8a2b-0b0392ce7d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:25.229561 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 921/1876] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:25 2022] POST /identity/v3/projects => generated 409 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:25.231458 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802872e-aa42-42fa-9331-caef8c7209cc admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:25.235937 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921d7ee-fcec-436e-8a2b-0b0392ce7d17 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:25.245033 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:25.300466 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c0d1b-32c2-4302-aa8b-ed3b3da8d408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:25.302250 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c0d1b-32c2-4302-aa8b-ed3b3da8d408 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.302797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c0d1b-32c2-4302-aa8b-ed3b3da8d408 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.303175 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577c0d1b-32c2-4302-aa8b-ed3b3da8d408 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.304383 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c0d1b-32c2-4302-aa8b-ed3b3da8d408 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:25.305563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7802872e-aa42-42fa-9331-caef8c7209cc admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:25.306535 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577c0d1b-32c2-4302-aa8b-ed3b3da8d408 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:25.310629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b93640-be59-493a-a72f-8e6cab49c48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:25.312434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b93640-be59-493a-a72f-8e6cab49c48e admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.313362 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b93640-be59-493a-a72f-8e6cab49c48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.313651 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b93640-be59-493a-a72f-8e6cab49c48e admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.314393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b93640-be59-493a-a72f-8e6cab49c48e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:25.316816 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b93640-be59-493a-a72f-8e6cab49c48e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:25.339835 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 956/1877] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:25 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:25.341331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c0d1b-32c2-4302-aa8b-ed3b3da8d408 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:25.345545 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 922/1878] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:25 2022] POST /identity/v3/users => generated 311 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:25.346657 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b93640-be59-493a-a72f-8e6cab49c48e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:25.357560 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b93640-be59-493a-a72f-8e6cab49c48e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:25.445135 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577c0d1b-32c2-4302-aa8b-ed3b3da8d408 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:25.453033 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a4f48-fca4-4abc-8625-bed0cebf14b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:25.453842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a4f48-fca4-4abc-8625-bed0cebf14b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.454136 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a4f48-fca4-4abc-8625-bed0cebf14b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.454412 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a4f48-fca4-4abc-8625-bed0cebf14b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.455156 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a4f48-fca4-4abc-8625-bed0cebf14b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:25.456822 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34a4f48-fca4-4abc-8625-bed0cebf14b3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:25.458387 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c4714-ad5a-45ed-bf5c-297687c1c7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:25.459129 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c4714-ad5a-45ed-bf5c-297687c1c7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.459477 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c4714-ad5a-45ed-bf5c-297687c1c7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.459762 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c4714-ad5a-45ed-bf5c-297687c1c7b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.460476 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c4714-ad5a-45ed-bf5c-297687c1c7b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:25.462484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521c4714-ad5a-45ed-bf5c-297687c1c7b1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:25.472051 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 923/1879] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:25.472051 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a4f48-fca4-4abc-8625-bed0cebf14b3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:25.472051 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c34a4f48-fca4-4abc-8625-bed0cebf14b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:25.484587 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a4f48-fca4-4abc-8625-bed0cebf14b3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:25.490497 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 957/1880] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:25 2022] POST /identity/v3/users => generated 290 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:25.490497 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c4714-ad5a-45ed-bf5c-297687c1c7b1 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:25.490688 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ad92c-e1a2-449b-9102-1cd43b857711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:25.490688 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ad92c-e1a2-449b-9102-1cd43b857711 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.490858 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ad92c-e1a2-449b-9102-1cd43b857711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.491031 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ad92c-e1a2-449b-9102-1cd43b857711 admin admin] PATH_INFO: `/v3/projects/9b68ac368e524477885ae3874017d9ee` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.492269 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ad92c-e1a2-449b-9102-1cd43b857711 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b68ac368e524477885ae3874017d9ee)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:25.494427 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ad92c-e1a2-449b-9102-1cd43b857711 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:25.498951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521c4714-ad5a-45ed-bf5c-297687c1c7b1 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:25.503968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadc660-f19b-43ae-9000-e6796c1523e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:25.504941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadc660-f19b-43ae-9000-e6796c1523e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.505227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadc660-f19b-43ae-9000-e6796c1523e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.505501 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadc660-f19b-43ae-9000-e6796c1523e3 admin admin] PATH_INFO: `/v3/projects/dc5b2347909548d582ebe862f5ac15ee/users/cc87cf4f847442de9ddadad83591e31a/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.522266 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dadc660-f19b-43ae-9000-e6796c1523e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5b2347909548d582ebe862f5ac15ee, user_id=cc87cf4f847442de9ddadad83591e31a, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:25.525972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dadc660-f19b-43ae-9000-e6796c1523e3 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:25.546208 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 958/1881] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:25 2022] PUT /identity/v3/projects/dc5b2347909548d582ebe862f5ac15ee/users/cc87cf4f847442de9ddadad83591e31a/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:25.546208 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadc660-f19b-43ae-9000-e6796c1523e3 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:25.554320 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:25.561380 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-305ad92c-e1a2-449b-9102-1cd43b857711 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b68ac368e524477885ae3874017d9ee', 'request_id': 'req-305ad92c-e1a2-449b-9102-1cd43b857711'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:25.570140 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-305ad92c-e1a2-449b-9102-1cd43b857711 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b68ac368e524477885ae3874017d9ee', 'request_id': 'req-305ad92c-e1a2-449b-9102-1cd43b857711'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:25.576141 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-305ad92c-e1a2-449b-9102-1cd43b857711 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b68ac368e524477885ae3874017d9ee', 'request_id': 'req-305ad92c-e1a2-449b-9102-1cd43b857711'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:25.589391 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-305ad92c-e1a2-449b-9102-1cd43b857711 admin admin] The token cache is being invalidate because project 9b68ac368e524477885ae3874017d9ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:25.589758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-305ad92c-e1a2-449b-9102-1cd43b857711 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:25.590490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-305ad92c-e1a2-449b-9102-1cd43b857711 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:25.592164 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 924/1882] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:25 2022] DELETE /identity/v3/projects/9b68ac368e524477885ae3874017d9ee => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:25.593005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ad92c-e1a2-449b-9102-1cd43b857711 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:25.594296 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-305ad92c-e1a2-449b-9102-1cd43b857711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:25.612512 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dadc660-f19b-43ae-9000-e6796c1523e3 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:25.618627 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:25.659638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ad92c-e1a2-449b-9102-1cd43b857711 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:25.664319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e6d6c-31b6-4ecc-8d03-78d1b8b34749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:25.664998 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e6d6c-31b6-4ecc-8d03-78d1b8b34749 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.665282 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e6d6c-31b6-4ecc-8d03-78d1b8b34749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.665610 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e6d6c-31b6-4ecc-8d03-78d1b8b34749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.666353 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e6d6c-31b6-4ecc-8d03-78d1b8b34749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:25.668016 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e6d6c-31b6-4ecc-8d03-78d1b8b34749 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:25.671164 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1d93e-69c5-4ce2-827a-7c35a5892584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:25.672031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d93e-69c5-4ce2-827a-7c35a5892584 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.672381 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d93e-69c5-4ce2-827a-7c35a5892584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.672727 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1d93e-69c5-4ce2-827a-7c35a5892584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.673533 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1d93e-69c5-4ce2-827a-7c35a5892584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:25.675275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1d93e-69c5-4ce2-827a-7c35a5892584 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:25.678147 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 925/1883] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:25.679637 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e6d6c-31b6-4ecc-8d03-78d1b8b34749 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:25.681307 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b75e6d6c-31b6-4ecc-8d03-78d1b8b34749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:25.689610 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 959/1884] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:25 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:25.691427 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1d93e-69c5-4ce2-827a-7c35a5892584 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:25.695398 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e6d6c-31b6-4ecc-8d03-78d1b8b34749 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:25.701035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed910edf-89e4-4e51-b38b-f6e4ae3b1730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:25.701730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910edf-89e4-4e51-b38b-f6e4ae3b1730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.701878 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910edf-89e4-4e51-b38b-f6e4ae3b1730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.702218 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed910edf-89e4-4e51-b38b-f6e4ae3b1730 admin admin] PATH_INFO: `/v3/users/fd1a8f3896564d58afe71c4460dcd60b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.704728 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1d93e-69c5-4ce2-827a-7c35a5892584 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:25.705448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed910edf-89e4-4e51-b38b-f6e4ae3b1730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd1a8f3896564d58afe71c4460dcd60b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:25.707857 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed910edf-89e4-4e51-b38b-f6e4ae3b1730 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:25.713523 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43ee05-67ba-4023-b3c0-c38480d2629d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:25.715449 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43ee05-67ba-4023-b3c0-c38480d2629d admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.715739 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43ee05-67ba-4023-b3c0-c38480d2629d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.716028 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43ee05-67ba-4023-b3c0-c38480d2629d admin admin] PATH_INFO: `/v3/projects/dc5b2347909548d582ebe862f5ac15ee/users/cc87cf4f847442de9ddadad83591e31a/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.723146 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43ee05-67ba-4023-b3c0-c38480d2629d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc5b2347909548d582ebe862f5ac15ee, user_id=cc87cf4f847442de9ddadad83591e31a, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:25.725923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43ee05-67ba-4023-b3c0-c38480d2629d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:25.745043 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 960/1885] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:25 2022] PUT /identity/v3/projects/dc5b2347909548d582ebe862f5ac15ee/users/cc87cf4f847442de9ddadad83591e31a/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:25.746145 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43ee05-67ba-4023-b3c0-c38480d2629d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:25.750111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0c43ee05-67ba-4023-b3c0-c38480d2629d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:25.782895 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed910edf-89e4-4e51-b38b-f6e4ae3b1730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd1a8f3896564d58afe71c4460dcd60b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:25.783598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed910edf-89e4-4e51-b38b-f6e4ae3b1730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd1a8f3896564d58afe71c4460dcd60b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:25.784261 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed910edf-89e4-4e51-b38b-f6e4ae3b1730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd1a8f3896564d58afe71c4460dcd60b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:25.792563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed910edf-89e4-4e51-b38b-f6e4ae3b1730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd1a8f3896564d58afe71c4460dcd60b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:25.807379 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed910edf-89e4-4e51-b38b-f6e4ae3b1730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd1a8f3896564d58afe71c4460dcd60b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:25.826506 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 926/1886] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:25 2022] DELETE /identity/v3/users/fd1a8f3896564d58afe71c4460dcd60b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:25.840817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a02e97-3f85-4c86-a19a-82a04eb92a68 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.841115 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a02e97-3f85-4c86-a19a-82a04eb92a68 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.841402 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a02e97-3f85-4c86-a19a-82a04eb92a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.841510 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43ee05-67ba-4023-b3c0-c38480d2629d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:25.877235 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-20a02e97-3f85-4c86-a19a-82a04eb92a68 None None] MFA Rules not processed for user `cc87cf4f847442de9ddadad83591e31a`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:25.878880 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-20a02e97-3f85-4c86-a19a-82a04eb92a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:25.912953 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:25.919889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b689d9-1e14-4b12-a4af-24fa405ae048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:25.921398 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b689d9-1e14-4b12-a4af-24fa405ae048 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:25.921731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b689d9-1e14-4b12-a4af-24fa405ae048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:25.922012 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b689d9-1e14-4b12-a4af-24fa405ae048 admin admin] PATH_INFO: `/v3/projects/14a759139dc446d7938e55fd46cecb7c/users/014db475df5149b8820c7bdf2f979935/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:25.946430 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b689d9-1e14-4b12-a4af-24fa405ae048 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a759139dc446d7938e55fd46cecb7c, user_id=014db475df5149b8820c7bdf2f979935, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:25.951001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b689d9-1e14-4b12-a4af-24fa405ae048 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:25.991639 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 927/1887] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:26.001348 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 961/1888] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:25 2022] PUT /identity/v3/projects/14a759139dc446d7938e55fd46cecb7c/users/014db475df5149b8820c7bdf2f979935/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:26.003813 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a02e97-3f85-4c86-a19a-82a04eb92a68 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:26.005596 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-20a02e97-3f85-4c86-a19a-82a04eb92a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:26.006440 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b689d9-1e14-4b12-a4af-24fa405ae048 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:26.008834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-75b689d9-1e14-4b12-a4af-24fa405ae048 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:26.039976 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:26.073509 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a02e97-3f85-4c86-a19a-82a04eb92a68 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:26.086513 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b689d9-1e14-4b12-a4af-24fa405ae048 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:26.092503 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2a62f-e9e0-44fb-a5d3-e0fec464f166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:26.093400 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2a62f-e9e0-44fb-a5d3-e0fec464f166 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.093838 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2a62f-e9e0-44fb-a5d3-e0fec464f166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.094381 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2a62f-e9e0-44fb-a5d3-e0fec464f166 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.095418 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2a62f-e9e0-44fb-a5d3-e0fec464f166 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:26.097978 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2a62f-e9e0-44fb-a5d3-e0fec464f166 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:26.109824 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 962/1889] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:12:26.114092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2a62f-e9e0-44fb-a5d3-e0fec464f166 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:26.124951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2a62f-e9e0-44fb-a5d3-e0fec464f166 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:26.129346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c3889-409b-4c46-a05a-43e7d9909715 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:26.129835 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7e57c6-569c-4870-a720-50453b170973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:26.130301 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c3889-409b-4c46-a05a-43e7d9909715 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.130590 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c3889-409b-4c46-a05a-43e7d9909715 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.130872 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c3889-409b-4c46-a05a-43e7d9909715 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.130978 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e57c6-569c-4870-a720-50453b170973 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.131307 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e57c6-569c-4870-a720-50453b170973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.131653 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7e57c6-569c-4870-a720-50453b170973 admin admin] PATH_INFO: `/v3/projects/14a759139dc446d7938e55fd46cecb7c/users/014db475df5149b8820c7bdf2f979935/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.133707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e57c6-569c-4870-a720-50453b170973 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a759139dc446d7938e55fd46cecb7c, user_id=014db475df5149b8820c7bdf2f979935, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:26.136860 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7e57c6-569c-4870-a720-50453b170973 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:26.153372 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 963/1890] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:26 2022] PUT /identity/v3/projects/14a759139dc446d7938e55fd46cecb7c/users/014db475df5149b8820c7bdf2f979935/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:26.163412 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01958e0c-05fe-4418-8864-6d625e5bda19 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.163712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01958e0c-05fe-4418-8864-6d625e5bda19 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.164611 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01958e0c-05fe-4418-8864-6d625e5bda19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.201276 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-01958e0c-05fe-4418-8864-6d625e5bda19 None None] MFA Rules not processed for user `014db475df5149b8820c7bdf2f979935`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:26.202549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-01958e0c-05fe-4418-8864-6d625e5bda19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:26.203153 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c3889-409b-4c46-a05a-43e7d9909715 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:26.204894 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c3889-409b-4c46-a05a-43e7d9909715 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:26.219572 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 928/1891] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:26 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:26.220665 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c3889-409b-4c46-a05a-43e7d9909715 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:26.222449 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1c7c3889-409b-4c46-a05a-43e7d9909715 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:26.238118 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c3889-409b-4c46-a05a-43e7d9909715 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:26.298449 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:26.308717 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 964/1892] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:26 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:26.321594 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01958e0c-05fe-4418-8864-6d625e5bda19 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:26.342602 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3868d-67b0-4f5f-970f-fc274cf69479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:26.343545 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3868d-67b0-4f5f-970f-fc274cf69479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.343834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3868d-67b0-4f5f-970f-fc274cf69479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.344118 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3868d-67b0-4f5f-970f-fc274cf69479 admin admin] PATH_INFO: `/v3/projects/dc07ac771b284a67a03dae4074197512` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.346136 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3868d-67b0-4f5f-970f-fc274cf69479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc07ac771b284a67a03dae4074197512)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:26.348591 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3868d-67b0-4f5f-970f-fc274cf69479 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:26.389886 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01958e0c-05fe-4418-8864-6d625e5bda19 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:26.393858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f218a-4844-47d0-9426-dfd8c7f47acf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:26.394595 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f218a-4844-47d0-9426-dfd8c7f47acf service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.394958 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f218a-4844-47d0-9426-dfd8c7f47acf service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.395261 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63f218a-4844-47d0-9426-dfd8c7f47acf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.409008 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f218a-4844-47d0-9426-dfd8c7f47acf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:26.413135 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63f218a-4844-47d0-9426-dfd8c7f47acf service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:26.415187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-64c3868d-67b0-4f5f-970f-fc274cf69479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc07ac771b284a67a03dae4074197512', 'request_id': 'req-64c3868d-67b0-4f5f-970f-fc274cf69479'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:26.424650 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 965/1893] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:26 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:12:26.425495 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f218a-4844-47d0-9426-dfd8c7f47acf service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:26.427156 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c63f218a-4844-47d0-9426-dfd8c7f47acf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:26.432812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-64c3868d-67b0-4f5f-970f-fc274cf69479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc07ac771b284a67a03dae4074197512', 'request_id': 'req-64c3868d-67b0-4f5f-970f-fc274cf69479'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:26.439608 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63f218a-4844-47d0-9426-dfd8c7f47acf service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:26.443002 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-64c3868d-67b0-4f5f-970f-fc274cf69479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc07ac771b284a67a03dae4074197512', 'request_id': 'req-64c3868d-67b0-4f5f-970f-fc274cf69479'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:26.465035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-64c3868d-67b0-4f5f-970f-fc274cf69479 admin admin] The token cache is being invalidate because project dc07ac771b284a67a03dae4074197512 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:26.467434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-64c3868d-67b0-4f5f-970f-fc274cf69479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:26.468564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-64c3868d-67b0-4f5f-970f-fc274cf69479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:26.470997 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 929/1894] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:26 2022] DELETE /identity/v3/projects/dc07ac771b284a67a03dae4074197512 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:26.478580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33b013-4d14-44f9-989b-6afd3760490d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.480075 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33b013-4d14-44f9-989b-6afd3760490d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.480526 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b33b013-4d14-44f9-989b-6afd3760490d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.492765 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:26.507400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9b33b013-4d14-44f9-989b-6afd3760490d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:26.509163 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9b33b013-4d14-44f9-989b-6afd3760490d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:26.517591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89174cc-449e-4569-9831-31b8c0f76db3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:26.518265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89174cc-449e-4569-9831-31b8c0f76db3 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.518549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89174cc-449e-4569-9831-31b8c0f76db3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.518830 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89174cc-449e-4569-9831-31b8c0f76db3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.520873 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f89174cc-449e-4569-9831-31b8c0f76db3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:26.574858 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 930/1895] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:26.575882 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33b013-4d14-44f9-989b-6afd3760490d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:26.577280 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9b33b013-4d14-44f9-989b-6afd3760490d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:26.590873 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b33b013-4d14-44f9-989b-6afd3760490d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:26.595475 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830c015-875c-4c03-b194-3e7af9ef26f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:26.596880 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830c015-875c-4c03-b194-3e7af9ef26f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.597354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830c015-875c-4c03-b194-3e7af9ef26f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.598306 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89174cc-449e-4569-9831-31b8c0f76db3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:26.598665 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a830c015-875c-4c03-b194-3e7af9ef26f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.599826 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89174cc-449e-4569-9831-31b8c0f76db3 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:26.601062 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a830c015-875c-4c03-b194-3e7af9ef26f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:26.613139 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 966/1896] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:26 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:26.615362 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642873b-4967-4161-87e2-cc3bd2ffd1ad None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.615862 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642873b-4967-4161-87e2-cc3bd2ffd1ad None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.616235 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f642873b-4967-4161-87e2-cc3bd2ffd1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.637715 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f642873b-4967-4161-87e2-cc3bd2ffd1ad None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:26.639492 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f642873b-4967-4161-87e2-cc3bd2ffd1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:26.648721 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 967/1897] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:26.653037 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642873b-4967-4161-87e2-cc3bd2ffd1ad None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:26.662627 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f642873b-4967-4161-87e2-cc3bd2ffd1ad None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:26.684191 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd93c9-1afc-4ffb-87ef-f1ddde096769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:26.684886 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd93c9-1afc-4ffb-87ef-f1ddde096769 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.685249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd93c9-1afc-4ffb-87ef-f1ddde096769 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.685531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd93c9-1afc-4ffb-87ef-f1ddde096769 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.686277 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd93c9-1afc-4ffb-87ef-f1ddde096769 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:26.686583 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd93c9-1afc-4ffb-87ef-f1ddde096769 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:26.688263 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd93c9-1afc-4ffb-87ef-f1ddde096769 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:26.697191 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830c015-875c-4c03-b194-3e7af9ef26f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:26.698918 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a830c015-875c-4c03-b194-3e7af9ef26f9 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:26.703783 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 968/1898] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:26.703919 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:26.704931 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd93c9-1afc-4ffb-87ef-f1ddde096769 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:26.710478 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 931/1899] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:26 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:26.717111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd93c9-1afc-4ffb-87ef-f1ddde096769 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:26.721988 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753043bc-31e6-4daf-8972-c0073823ffd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:26.722966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753043bc-31e6-4daf-8972-c0073823ffd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.723374 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753043bc-31e6-4daf-8972-c0073823ffd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.723659 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753043bc-31e6-4daf-8972-c0073823ffd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.724358 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753043bc-31e6-4daf-8972-c0073823ffd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:26.727060 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753043bc-31e6-4daf-8972-c0073823ffd0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:26.758995 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 969/1900] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:26 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:26.763132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830c015-875c-4c03-b194-3e7af9ef26f9 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:26.774701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a830c015-875c-4c03-b194-3e7af9ef26f9 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:26.877987 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5757cb-5234-4c69-8462-f6bdb1cd91ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:26.879973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5757cb-5234-4c69-8462-f6bdb1cd91ab admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.880527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5757cb-5234-4c69-8462-f6bdb1cd91ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.880527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5757cb-5234-4c69-8462-f6bdb1cd91ab admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.881493 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5757cb-5234-4c69-8462-f6bdb1cd91ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:26.883940 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5757cb-5234-4c69-8462-f6bdb1cd91ab admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:26.908395 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 932/1901] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:26 2022] POST /identity/v3/users => generated 300 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:26.913437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753043bc-31e6-4daf-8972-c0073823ffd0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:26.938796 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753043bc-31e6-4daf-8972-c0073823ffd0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:26.944839 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee5fba-2c9b-4f36-877f-9e2607408362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:26.945526 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee5fba-2c9b-4f36-877f-9e2607408362 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:26.945811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee5fba-2c9b-4f36-877f-9e2607408362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:26.946211 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee5fba-2c9b-4f36-877f-9e2607408362 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:26.947121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee5fba-2c9b-4f36-877f-9e2607408362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:26.948817 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee5fba-2c9b-4f36-877f-9e2607408362 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:26.960727 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 970/1902] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:26.969479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5757cb-5234-4c69-8462-f6bdb1cd91ab admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:26.985400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5757cb-5234-4c69-8462-f6bdb1cd91ab admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:27.031196 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf51c54-2c2b-486d-8fd3-54174fb56af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:27.034176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf51c54-2c2b-486d-8fd3-54174fb56af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.034594 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf51c54-2c2b-486d-8fd3-54174fb56af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.034984 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf51c54-2c2b-486d-8fd3-54174fb56af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.037772 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf51c54-2c2b-486d-8fd3-54174fb56af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:27.046697 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf51c54-2c2b-486d-8fd3-54174fb56af6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:27.073570 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 933/1903] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:27.082242 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee5fba-2c9b-4f36-877f-9e2607408362 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:27.103951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee5fba-2c9b-4f36-877f-9e2607408362 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:27.114607 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5006d-1ef4-44a8-929b-ad63c8113a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:27.115627 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5006d-1ef4-44a8-929b-ad63c8113a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.116111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5006d-1ef4-44a8-929b-ad63c8113a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.116386 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5006d-1ef4-44a8-929b-ad63c8113a7f admin admin] PATH_INFO: `/v3/projects/fc6cfce9e1704cc3a5deb3dffd62a846/users/3f4ad0cda0734c4886f3c715171f84a7/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.155780 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5006d-1ef4-44a8-929b-ad63c8113a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc6cfce9e1704cc3a5deb3dffd62a846, user_id=3f4ad0cda0734c4886f3c715171f84a7, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:27.158370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5006d-1ef4-44a8-929b-ad63c8113a7f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:27.179260 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 971/1904] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:27 2022] PUT /identity/v3/projects/fc6cfce9e1704cc3a5deb3dffd62a846/users/3f4ad0cda0734c4886f3c715171f84a7/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:27.193124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0a751-a80f-45bf-af6a-4445013c1e75 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.193491 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0a751-a80f-45bf-af6a-4445013c1e75 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.193727 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0a751-a80f-45bf-af6a-4445013c1e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.239603 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-91b0a751-a80f-45bf-af6a-4445013c1e75 None None] MFA Rules not processed for user `3f4ad0cda0734c4886f3c715171f84a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:27.241761 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-91b0a751-a80f-45bf-af6a-4445013c1e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:27.310939 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 934/1905] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:27.315635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5006d-1ef4-44a8-929b-ad63c8113a7f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:27.387557 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5006d-1ef4-44a8-929b-ad63c8113a7f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:27.392650 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f61939-d627-4ed5-aa3a-4b48bbb16b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:27.393918 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f61939-d627-4ed5-aa3a-4b48bbb16b45 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.394211 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f61939-d627-4ed5-aa3a-4b48bbb16b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.394489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f61939-d627-4ed5-aa3a-4b48bbb16b45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.395441 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f61939-d627-4ed5-aa3a-4b48bbb16b45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:27.397442 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f61939-d627-4ed5-aa3a-4b48bbb16b45 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:27.414520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:27.435882 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 972/1906] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:27 2022] POST /identity/v3/projects => generated 401 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:27.438964 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0a751-a80f-45bf-af6a-4445013c1e75 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:27.452406 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0a751-a80f-45bf-af6a-4445013c1e75 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:27.528742 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf82c6c-ab06-4118-a0c2-f5f2d0c6b8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:27.529616 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf82c6c-ab06-4118-a0c2-f5f2d0c6b8dc admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.530004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf82c6c-ab06-4118-a0c2-f5f2d0c6b8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.530382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf82c6c-ab06-4118-a0c2-f5f2d0c6b8dc admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.531234 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf82c6c-ab06-4118-a0c2-f5f2d0c6b8dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:27.533369 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf82c6c-ab06-4118-a0c2-f5f2d0c6b8dc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:27.544656 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:27.566729 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 935/1907] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:27 2022] POST /identity/v3/users => generated 307 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:27.569510 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f61939-d627-4ed5-aa3a-4b48bbb16b45 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:27.580587 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f61939-d627-4ed5-aa3a-4b48bbb16b45 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:27.585455 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc980eb1-043a-4115-8717-343d351c54ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:27.586122 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc980eb1-043a-4115-8717-343d351c54ee admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.586465 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc980eb1-043a-4115-8717-343d351c54ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.586779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc980eb1-043a-4115-8717-343d351c54ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.587543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc980eb1-043a-4115-8717-343d351c54ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:27.589203 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc980eb1-043a-4115-8717-343d351c54ee admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:27.600761 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 973/1908] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:27.605018 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf82c6c-ab06-4118-a0c2-f5f2d0c6b8dc admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:27.617613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf82c6c-ab06-4118-a0c2-f5f2d0c6b8dc admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:27.623822 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc9a30-8094-4e81-8c38-dbca36ab3843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:27.624303 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc9a30-8094-4e81-8c38-dbca36ab3843 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.624751 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc9a30-8094-4e81-8c38-dbca36ab3843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.625143 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bc9a30-8094-4e81-8c38-dbca36ab3843 admin admin] PATH_INFO: `/v3/projects/7ebc5f7f1e3d432f86854f2d7c0eb00f/users/124c14f860cf4e828882294e7aa7dab7/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.643361 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc9a30-8094-4e81-8c38-dbca36ab3843 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebc5f7f1e3d432f86854f2d7c0eb00f, user_id=124c14f860cf4e828882294e7aa7dab7, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:27.646100 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bc9a30-8094-4e81-8c38-dbca36ab3843 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:27.665874 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 936/1909] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:27 2022] PUT /identity/v3/projects/7ebc5f7f1e3d432f86854f2d7c0eb00f/users/124c14f860cf4e828882294e7aa7dab7/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:27.667552 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc980eb1-043a-4115-8717-343d351c54ee admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:27.679010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc980eb1-043a-4115-8717-343d351c54ee admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:27.756825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fb169f-a46d-47ee-9fab-248020cb193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:27.757777 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb169f-a46d-47ee-9fab-248020cb193f admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.758156 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb169f-a46d-47ee-9fab-248020cb193f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.758523 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fb169f-a46d-47ee-9fab-248020cb193f admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.760184 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb169f-a46d-47ee-9fab-248020cb193f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:27.762109 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fb169f-a46d-47ee-9fab-248020cb193f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:27.776672 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 974/1910] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:12:27.780677 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc9a30-8094-4e81-8c38-dbca36ab3843 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:27.799141 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bc9a30-8094-4e81-8c38-dbca36ab3843 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:27.806803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437693f2-0d63-418c-a203-5e67f1548002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:27.807921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437693f2-0d63-418c-a203-5e67f1548002 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.808208 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437693f2-0d63-418c-a203-5e67f1548002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.808486 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437693f2-0d63-418c-a203-5e67f1548002 admin admin] PATH_INFO: `/v3/projects/7ebc5f7f1e3d432f86854f2d7c0eb00f/users/124c14f860cf4e828882294e7aa7dab7/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.810511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437693f2-0d63-418c-a203-5e67f1548002 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ebc5f7f1e3d432f86854f2d7c0eb00f, user_id=124c14f860cf4e828882294e7aa7dab7, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:27.813425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437693f2-0d63-418c-a203-5e67f1548002 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:27.826531 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 937/1911] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:27 2022] PUT /identity/v3/projects/7ebc5f7f1e3d432f86854f2d7c0eb00f/users/124c14f860cf4e828882294e7aa7dab7/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:27.837231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3eef9-38b3-4d95-87f1-dd89340dbfd8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:27.837536 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3eef9-38b3-4d95-87f1-dd89340dbfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:27.837817 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce3eef9-38b3-4d95-87f1-dd89340dbfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:27.887765 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-cce3eef9-38b3-4d95-87f1-dd89340dbfd8 None None] MFA Rules not processed for user `124c14f860cf4e828882294e7aa7dab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:27.889030 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cce3eef9-38b3-4d95-87f1-dd89340dbfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:27.975815 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 975/1912] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:27 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:27.988259 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437693f2-0d63-418c-a203-5e67f1548002 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:27.991864 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-437693f2-0d63-418c-a203-5e67f1548002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:28.061054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437693f2-0d63-418c-a203-5e67f1548002 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:28.065170 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f905619-4191-48ca-8f87-3e9795ef8179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:28.065926 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f905619-4191-48ca-8f87-3e9795ef8179 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:28.066170 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f905619-4191-48ca-8f87-3e9795ef8179 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:28.066454 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f905619-4191-48ca-8f87-3e9795ef8179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:28.076253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f905619-4191-48ca-8f87-3e9795ef8179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:28.077730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f905619-4191-48ca-8f87-3e9795ef8179 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:28.087879 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 938/1913] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:27 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:28.169803 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3eef9-38b3-4d95-87f1-dd89340dbfd8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:28.179890 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce3eef9-38b3-4d95-87f1-dd89340dbfd8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:28.183593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c89e72-3697-4c52-bf0c-2e33fe53e619 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:28.184322 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c89e72-3697-4c52-bf0c-2e33fe53e619 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:28.184605 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c89e72-3697-4c52-bf0c-2e33fe53e619 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:28.184881 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c89e72-3697-4c52-bf0c-2e33fe53e619 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:28.244952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c89e72-3697-4c52-bf0c-2e33fe53e619 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:28.246839 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c89e72-3697-4c52-bf0c-2e33fe53e619 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:28.258988 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 976/1914] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:28 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:30.283847 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f905619-4191-48ca-8f87-3e9795ef8179 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:30.285556 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2f905619-4191-48ca-8f87-3e9795ef8179 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:30.363415 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f905619-4191-48ca-8f87-3e9795ef8179 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:30.369971 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021fb15-4dbd-4e87-8649-34ed9f9e56b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:30.371009 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021fb15-4dbd-4e87-8649-34ed9f9e56b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:30.371387 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021fb15-4dbd-4e87-8649-34ed9f9e56b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:30.371944 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d021fb15-4dbd-4e87-8649-34ed9f9e56b1 admin admin] PATH_INFO: `/v3/users/c737c83002584707ab47ce17d7f37222` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:30.373911 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021fb15-4dbd-4e87-8649-34ed9f9e56b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c737c83002584707ab47ce17d7f37222)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:30.376154 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d021fb15-4dbd-4e87-8649-34ed9f9e56b1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:30.442923 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d021fb15-4dbd-4e87-8649-34ed9f9e56b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c737c83002584707ab47ce17d7f37222'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:30.443728 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d021fb15-4dbd-4e87-8649-34ed9f9e56b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c737c83002584707ab47ce17d7f37222'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:30.444356 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d021fb15-4dbd-4e87-8649-34ed9f9e56b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c737c83002584707ab47ce17d7f37222'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:30.452672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d021fb15-4dbd-4e87-8649-34ed9f9e56b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c737c83002584707ab47ce17d7f37222'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:30.459622 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:30.471623 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d021fb15-4dbd-4e87-8649-34ed9f9e56b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c737c83002584707ab47ce17d7f37222'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:30.491347 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 939/1915] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:30 2022] DELETE /identity/v3/users/c737c83002584707ab47ce17d7f37222 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:30.495694 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020a75f-4391-4600-bc08-f85176ba0179 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:30.496190 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020a75f-4391-4600-bc08-f85176ba0179 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:30.496269 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3020a75f-4391-4600-bc08-f85176ba0179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:30.504468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:30.516922 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3020a75f-4391-4600-bc08-f85176ba0179 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:30.518162 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3020a75f-4391-4600-bc08-f85176ba0179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:30.619336 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 977/1916] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:30.628828 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021fb15-4dbd-4e87-8649-34ed9f9e56b1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:30.630332 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d021fb15-4dbd-4e87-8649-34ed9f9e56b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:30.693723 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d021fb15-4dbd-4e87-8649-34ed9f9e56b1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:30.697615 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc5c70-744e-4bf4-a52a-ccdb28aa6edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:30.698282 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc5c70-744e-4bf4-a52a-ccdb28aa6edc service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:30.698617 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc5c70-744e-4bf4-a52a-ccdb28aa6edc service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:30.698901 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc5c70-744e-4bf4-a52a-ccdb28aa6edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:30.708243 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc5c70-744e-4bf4-a52a-ccdb28aa6edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:30.709830 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc5c70-744e-4bf4-a52a-ccdb28aa6edc service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:30.720764 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 940/1917] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:31.085886 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020a75f-4391-4600-bc08-f85176ba0179 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:31.088108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3020a75f-4391-4600-bc08-f85176ba0179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:31.110595 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3020a75f-4391-4600-bc08-f85176ba0179 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:31.117202 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdf949-6f42-4550-82e9-afe22d4a7dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:31.118666 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdf949-6f42-4550-82e9-afe22d4a7dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:31.119466 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdf949-6f42-4550-82e9-afe22d4a7dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:31.120121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bdf949-6f42-4550-82e9-afe22d4a7dca admin admin] PATH_INFO: `/v3/projects/5fe958308d3c43a089f5eabe2196860e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:31.121865 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdf949-6f42-4550-82e9-afe22d4a7dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe958308d3c43a089f5eabe2196860e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:31.124153 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bdf949-6f42-4550-82e9-afe22d4a7dca admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:31.175680 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c4bdf949-6f42-4550-82e9-afe22d4a7dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe958308d3c43a089f5eabe2196860e', 'request_id': 'req-c4bdf949-6f42-4550-82e9-afe22d4a7dca'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:31.182459 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c4bdf949-6f42-4550-82e9-afe22d4a7dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe958308d3c43a089f5eabe2196860e', 'request_id': 'req-c4bdf949-6f42-4550-82e9-afe22d4a7dca'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:31.189314 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c4bdf949-6f42-4550-82e9-afe22d4a7dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe958308d3c43a089f5eabe2196860e', 'request_id': 'req-c4bdf949-6f42-4550-82e9-afe22d4a7dca'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:31.203617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c4bdf949-6f42-4550-82e9-afe22d4a7dca admin admin] The token cache is being invalidate because project 5fe958308d3c43a089f5eabe2196860e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:31.203917 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c4bdf949-6f42-4550-82e9-afe22d4a7dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:31.207724 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c4bdf949-6f42-4550-82e9-afe22d4a7dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:31.209377 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 978/1918] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:31 2022] DELETE /identity/v3/projects/5fe958308d3c43a089f5eabe2196860e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:31.213303 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc5c70-744e-4bf4-a52a-ccdb28aa6edc service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:31.222804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc5c70-744e-4bf4-a52a-ccdb28aa6edc service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:31.279066 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d869b-cb9a-4676-815d-9079c512c9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:31.279990 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d869b-cb9a-4676-815d-9079c512c9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:31.280298 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d869b-cb9a-4676-815d-9079c512c9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:31.280574 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d869b-cb9a-4676-815d-9079c512c9a2 admin admin] PATH_INFO: `/v3/users/014db475df5149b8820c7bdf2f979935` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:31.282005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d869b-cb9a-4676-815d-9079c512c9a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=014db475df5149b8820c7bdf2f979935)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:31.283831 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d869b-cb9a-4676-815d-9079c512c9a2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:31.332155 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed8d869b-cb9a-4676-815d-9079c512c9a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '014db475df5149b8820c7bdf2f979935'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:31.333027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed8d869b-cb9a-4676-815d-9079c512c9a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '014db475df5149b8820c7bdf2f979935'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:31.333739 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed8d869b-cb9a-4676-815d-9079c512c9a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '014db475df5149b8820c7bdf2f979935'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:31.341163 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed8d869b-cb9a-4676-815d-9079c512c9a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '014db475df5149b8820c7bdf2f979935'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:31.352899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ed8d869b-cb9a-4676-815d-9079c512c9a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '014db475df5149b8820c7bdf2f979935'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:31.366783 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 941/1919] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:31 2022] DELETE /identity/v3/users/014db475df5149b8820c7bdf2f979935 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:31.657825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdf949-6f42-4550-82e9-afe22d4a7dca admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:31.659249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c4bdf949-6f42-4550-82e9-afe22d4a7dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:31.674606 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bdf949-6f42-4550-82e9-afe22d4a7dca admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:31.736075 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7dcfb-70b5-49ef-96ea-e4faac67bc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:31.737069 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7dcfb-70b5-49ef-96ea-e4faac67bc7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:31.737423 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7dcfb-70b5-49ef-96ea-e4faac67bc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:31.737765 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7dcfb-70b5-49ef-96ea-e4faac67bc7c admin admin] PATH_INFO: `/v3/projects/14a759139dc446d7938e55fd46cecb7c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:31.738992 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7dcfb-70b5-49ef-96ea-e4faac67bc7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a759139dc446d7938e55fd46cecb7c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:31.741278 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7dcfb-70b5-49ef-96ea-e4faac67bc7c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:31.775958 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:31.792580 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c3b7dcfb-70b5-49ef-96ea-e4faac67bc7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a759139dc446d7938e55fd46cecb7c', 'request_id': 'req-c3b7dcfb-70b5-49ef-96ea-e4faac67bc7c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:31.805908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c3b7dcfb-70b5-49ef-96ea-e4faac67bc7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a759139dc446d7938e55fd46cecb7c', 'request_id': 'req-c3b7dcfb-70b5-49ef-96ea-e4faac67bc7c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:31.823874 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c3b7dcfb-70b5-49ef-96ea-e4faac67bc7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a759139dc446d7938e55fd46cecb7c', 'request_id': 'req-c3b7dcfb-70b5-49ef-96ea-e4faac67bc7c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:31.850000 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c3b7dcfb-70b5-49ef-96ea-e4faac67bc7c admin admin] The token cache is being invalidate because project 14a759139dc446d7938e55fd46cecb7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:31.850294 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c3b7dcfb-70b5-49ef-96ea-e4faac67bc7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:31.850918 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c3b7dcfb-70b5-49ef-96ea-e4faac67bc7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:31.852583 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 979/1920] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:31 2022] DELETE /identity/v3/projects/14a759139dc446d7938e55fd46cecb7c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:31.857631 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e6ec1-276a-4c10-8316-da0d64c05abc None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:31.857927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e6ec1-276a-4c10-8316-da0d64c05abc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:31.858211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e6ec1-276a-4c10-8316-da0d64c05abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:31.864696 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:31.880240 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-715e6ec1-276a-4c10-8316-da0d64c05abc None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:31.882180 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-715e6ec1-276a-4c10-8316-da0d64c05abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:31.945796 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 942/1921] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:31.953937 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb860d-cf6a-4f90-86cb-4f9eeb94e211 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:31.954231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb860d-cf6a-4f90-86cb-4f9eeb94e211 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:31.954509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb860d-cf6a-4f90-86cb-4f9eeb94e211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:31.979579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fefb860d-cf6a-4f90-86cb-4f9eeb94e211 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:31.980799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fefb860d-cf6a-4f90-86cb-4f9eeb94e211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:31.991824 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 980/1922] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:32.003701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e6ec1-276a-4c10-8316-da0d64c05abc None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.007617 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e6ec1-276a-4c10-8316-da0d64c05abc None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:32.012354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7285e16-4245-464c-b48c-82eadd4c8c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:32.013029 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7285e16-4245-464c-b48c-82eadd4c8c99 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.013313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7285e16-4245-464c-b48c-82eadd4c8c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.013762 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7285e16-4245-464c-b48c-82eadd4c8c99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.014533 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7285e16-4245-464c-b48c-82eadd4c8c99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:32.014843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7285e16-4245-464c-b48c-82eadd4c8c99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:32.016503 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7285e16-4245-464c-b48c-82eadd4c8c99 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:32.029563 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 943/1923] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:32.034496 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb860d-cf6a-4f90-86cb-4f9eeb94e211 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.044568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb860d-cf6a-4f90-86cb-4f9eeb94e211 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:32.049390 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8156b-5099-43b9-a716-b233a64b6cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:32.050072 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8156b-5099-43b9-a716-b233a64b6cfd admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.050364 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8156b-5099-43b9-a716-b233a64b6cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.050631 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8156b-5099-43b9-a716-b233a64b6cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.051374 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8156b-5099-43b9-a716-b233a64b6cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:32.053684 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8156b-5099-43b9-a716-b233a64b6cfd admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:32.083057 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 981/1924] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:32 2022] POST /identity/v3/projects => generated 367 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:32.087449 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7285e16-4245-464c-b48c-82eadd4c8c99 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.098653 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7285e16-4245-464c-b48c-82eadd4c8c99 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:32.170085 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86089c23-f31d-4ef5-a46f-6b4460917add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:32.170777 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86089c23-f31d-4ef5-a46f-6b4460917add admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.171114 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86089c23-f31d-4ef5-a46f-6b4460917add admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.171400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86089c23-f31d-4ef5-a46f-6b4460917add admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.172146 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86089c23-f31d-4ef5-a46f-6b4460917add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:32.174373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86089c23-f31d-4ef5-a46f-6b4460917add admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:32.203000 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 944/1925] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:32 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:32.207272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8156b-5099-43b9-a716-b233a64b6cfd admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.217526 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8156b-5099-43b9-a716-b233a64b6cfd admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:32.222098 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba8327-5264-41d8-8c7a-5358c199d819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:32.222706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba8327-5264-41d8-8c7a-5358c199d819 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.222989 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba8327-5264-41d8-8c7a-5358c199d819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.223263 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba8327-5264-41d8-8c7a-5358c199d819 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.224063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba8327-5264-41d8-8c7a-5358c199d819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:32.225756 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba8327-5264-41d8-8c7a-5358c199d819 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:32.236110 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 982/1926] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:12:32.240083 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86089c23-f31d-4ef5-a46f-6b4460917add admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.250404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86089c23-f31d-4ef5-a46f-6b4460917add admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:32.255363 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13909435-9615-4c83-806c-60b0c591e810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:32.256445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13909435-9615-4c83-806c-60b0c591e810 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.256736 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13909435-9615-4c83-806c-60b0c591e810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.257016 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13909435-9615-4c83-806c-60b0c591e810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.258171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13909435-9615-4c83-806c-60b0c591e810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:32.259587 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13909435-9615-4c83-806c-60b0c591e810 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:32.272456 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 945/1927] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:32.276873 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba8327-5264-41d8-8c7a-5358c199d819 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.287879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba8327-5264-41d8-8c7a-5358c199d819 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:32.293449 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3f1fd-c28e-4fe3-b4bd-1bc6570e1f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:32.294431 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3f1fd-c28e-4fe3-b4bd-1bc6570e1f62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.294752 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3f1fd-c28e-4fe3-b4bd-1bc6570e1f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.295018 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3f1fd-c28e-4fe3-b4bd-1bc6570e1f62 admin admin] PATH_INFO: `/v3/projects/88aee93f28ac4b4ea0fb5720e8c3551f/users/e14ad1d26a31489e94ec626bc5973f61/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.311107 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3f1fd-c28e-4fe3-b4bd-1bc6570e1f62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88aee93f28ac4b4ea0fb5720e8c3551f, user_id=e14ad1d26a31489e94ec626bc5973f61, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:32.313819 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3f1fd-c28e-4fe3-b4bd-1bc6570e1f62 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:32.327676 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 983/1928] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:32 2022] PUT /identity/v3/projects/88aee93f28ac4b4ea0fb5720e8c3551f/users/e14ad1d26a31489e94ec626bc5973f61/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:32.339439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30ab39-8d1e-4c06-ab3d-d951029d3366 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.339952 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30ab39-8d1e-4c06-ab3d-d951029d3366 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.340064 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c30ab39-8d1e-4c06-ab3d-d951029d3366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.371319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3c30ab39-8d1e-4c06-ab3d-d951029d3366 None None] MFA Rules not processed for user `e14ad1d26a31489e94ec626bc5973f61`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:32.372587 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3c30ab39-8d1e-4c06-ab3d-d951029d3366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:32.439385 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3f1fd-c28e-4fe3-b4bd-1bc6570e1f62 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.441297 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5cd3f1fd-c28e-4fe3-b4bd-1bc6570e1f62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:32.443064 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:32.455205 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 946/1929] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:32 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:32.459775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30ab39-8d1e-4c06-ab3d-d951029d3366 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.530032 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3f1fd-c28e-4fe3-b4bd-1bc6570e1f62 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:32.535089 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02836e8-4a7a-422d-b865-a3982189b7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:32.536215 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02836e8-4a7a-422d-b865-a3982189b7b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.536594 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02836e8-4a7a-422d-b865-a3982189b7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.536718 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c30ab39-8d1e-4c06-ab3d-d951029d3366 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:32.537046 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02836e8-4a7a-422d-b865-a3982189b7b9 admin admin] PATH_INFO: `/v3/users/3f4ad0cda0734c4886f3c715171f84a7` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.538367 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02836e8-4a7a-422d-b865-a3982189b7b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f4ad0cda0734c4886f3c715171f84a7)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:32.540557 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02836e8-4a7a-422d-b865-a3982189b7b9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:32.541729 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6282b-2b59-4e6a-b87d-e2bf619b4dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:32.542987 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6282b-2b59-4e6a-b87d-e2bf619b4dc6 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.543713 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6282b-2b59-4e6a-b87d-e2bf619b4dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.544117 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b6282b-2b59-4e6a-b87d-e2bf619b4dc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.544976 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6282b-2b59-4e6a-b87d-e2bf619b4dc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:32.547598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b6282b-2b59-4e6a-b87d-e2bf619b4dc6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:32.575458 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 947/1930] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:32 2022] POST /identity/v3/projects => generated 365 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:12:32.579447 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6282b-2b59-4e6a-b87d-e2bf619b4dc6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.590823 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f02836e8-4a7a-422d-b865-a3982189b7b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f4ad0cda0734c4886f3c715171f84a7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:32.591534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f02836e8-4a7a-422d-b865-a3982189b7b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f4ad0cda0734c4886f3c715171f84a7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:32.599190 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f02836e8-4a7a-422d-b865-a3982189b7b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f4ad0cda0734c4886f3c715171f84a7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:32.600008 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f02836e8-4a7a-422d-b865-a3982189b7b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f4ad0cda0734c4886f3c715171f84a7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:32.602464 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:32.609212 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f02836e8-4a7a-422d-b865-a3982189b7b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f4ad0cda0734c4886f3c715171f84a7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:32.636871 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 984/1931] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:32 2022] DELETE /identity/v3/users/3f4ad0cda0734c4886f3c715171f84a7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:32.641659 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd0878-5e2e-4710-ab87-0cf753ecacd5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.642052 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd0878-5e2e-4710-ab87-0cf753ecacd5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.642409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd0878-5e2e-4710-ab87-0cf753ecacd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.653257 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b6282b-2b59-4e6a-b87d-e2bf619b4dc6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:32.660188 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-00dd0878-5e2e-4710-ab87-0cf753ecacd5 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:32.661477 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-00dd0878-5e2e-4710-ab87-0cf753ecacd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:32.711535 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b6928-cb6d-4333-8ed0-d933371818c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:32.712226 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b6928-cb6d-4333-8ed0-d933371818c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.712548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b6928-cb6d-4333-8ed0-d933371818c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.712826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08b6928-cb6d-4333-8ed0-d933371818c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.713528 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b6928-cb6d-4333-8ed0-d933371818c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:32.715497 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08b6928-cb6d-4333-8ed0-d933371818c9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:32.720348 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 985/1932] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:32.731077 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd0878-5e2e-4710-ab87-0cf753ecacd5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.733041 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-00dd0878-5e2e-4710-ab87-0cf753ecacd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:32.736702 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 948/1933] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:32 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:12:32.740735 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b6928-cb6d-4333-8ed0-d933371818c9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.742194 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e08b6928-cb6d-4333-8ed0-d933371818c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:32.753637 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08b6928-cb6d-4333-8ed0-d933371818c9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:32.759765 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b3428-6780-4ef4-b21b-e3d449d0d24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:32.760725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b3428-6780-4ef4-b21b-e3d449d0d24c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.761138 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b3428-6780-4ef4-b21b-e3d449d0d24c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.761544 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b3428-6780-4ef4-b21b-e3d449d0d24c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.762650 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b3428-6780-4ef4-b21b-e3d449d0d24c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:32.765175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b3428-6780-4ef4-b21b-e3d449d0d24c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:32.779882 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 949/1934] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:12:32.784266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b3428-6780-4ef4-b21b-e3d449d0d24c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.793350 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd0878-5e2e-4710-ab87-0cf753ecacd5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:32.794817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b3428-6780-4ef4-b21b-e3d449d0d24c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:32.797461 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5badef-4465-4b0c-9290-2f9db01feff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:32.798157 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5badef-4465-4b0c-9290-2f9db01feff1 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.798436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5badef-4465-4b0c-9290-2f9db01feff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.798709 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5badef-4465-4b0c-9290-2f9db01feff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.799830 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fda09-b918-450d-93af-2ebdac8d384b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:32.800732 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fda09-b918-450d-93af-2ebdac8d384b admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.801019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fda09-b918-450d-93af-2ebdac8d384b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.801295 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844fda09-b918-450d-93af-2ebdac8d384b admin admin] PATH_INFO: `/v3/projects/11942ff9e7aa4b65a9d0a5c44c5c3494/users/719f906e19ae4b5b991e0b37e15deaca/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.805123 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:32.809264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5badef-4465-4b0c-9290-2f9db01feff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:32.810730 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5badef-4465-4b0c-9290-2f9db01feff1 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:32.820153 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fda09-b918-450d-93af-2ebdac8d384b admin admin] RBAC: Authorizing `identity:create_grant(project_id=11942ff9e7aa4b65a9d0a5c44c5c3494, user_id=719f906e19ae4b5b991e0b37e15deaca, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:32.823051 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844fda09-b918-450d-93af-2ebdac8d384b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:32.825778 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 986/1935] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:12:32.841458 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 950/1936] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:32 2022] PUT /identity/v3/projects/11942ff9e7aa4b65a9d0a5c44c5c3494/users/719f906e19ae4b5b991e0b37e15deaca/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:32.846417 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5badef-4465-4b0c-9290-2f9db01feff1 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.857972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5badef-4465-4b0c-9290-2f9db01feff1 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:32.967948 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b989e-d311-4806-a06f-643830a1c821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:32.968732 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b989e-d311-4806-a06f-643830a1c821 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:32.969091 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b989e-d311-4806-a06f-643830a1c821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:32.969475 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b989e-d311-4806-a06f-643830a1c821 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:32.970339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b989e-d311-4806-a06f-643830a1c821 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:32.972115 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b989e-d311-4806-a06f-643830a1c821 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:32.984631 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 987/1937] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:32 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:32.988071 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fda09-b918-450d-93af-2ebdac8d384b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:32.998651 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844fda09-b918-450d-93af-2ebdac8d384b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:33.004732 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f1f6e-e15b-4864-9511-f15e14e3e3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:33.005952 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f1f6e-e15b-4864-9511-f15e14e3e3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:33.007389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f1f6e-e15b-4864-9511-f15e14e3e3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:33.008390 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f1f6e-e15b-4864-9511-f15e14e3e3ec admin admin] PATH_INFO: `/v3/projects/11942ff9e7aa4b65a9d0a5c44c5c3494/users/719f906e19ae4b5b991e0b37e15deaca/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:33.011895 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f1f6e-e15b-4864-9511-f15e14e3e3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=11942ff9e7aa4b65a9d0a5c44c5c3494, user_id=719f906e19ae4b5b991e0b37e15deaca, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:33.015736 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55f1f6e-e15b-4864-9511-f15e14e3e3ec admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:33.032824 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 951/1938] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:32 2022] PUT /identity/v3/projects/11942ff9e7aa4b65a9d0a5c44c5c3494/users/719f906e19ae4b5b991e0b37e15deaca/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:33.043336 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d935b-48f5-413d-be5a-f3d09cbd9b61 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:33.043656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d935b-48f5-413d-be5a-f3d09cbd9b61 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:33.043926 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d935b-48f5-413d-be5a-f3d09cbd9b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:33.073784 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:33.077365 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-653d935b-48f5-413d-be5a-f3d09cbd9b61 None None] MFA Rules not processed for user `719f906e19ae4b5b991e0b37e15deaca`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:33.078617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-653d935b-48f5-413d-be5a-f3d09cbd9b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:33.174658 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 988/1939] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:33.188580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f1f6e-e15b-4864-9511-f15e14e3e3ec admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:33.191720 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f55f1f6e-e15b-4864-9511-f15e14e3e3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:33.231685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d935b-48f5-413d-be5a-f3d09cbd9b61 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:33.233665 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-653d935b-48f5-413d-be5a-f3d09cbd9b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:33.304805 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f1f6e-e15b-4864-9511-f15e14e3e3ec admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:33.308919 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ddb1b-0009-48a0-8692-a0d164b68d9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:33.310368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ddb1b-0009-48a0-8692-a0d164b68d9a service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:33.310731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ddb1b-0009-48a0-8692-a0d164b68d9a service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:33.311082 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7ddb1b-0009-48a0-8692-a0d164b68d9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:33.329801 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ddb1b-0009-48a0-8692-a0d164b68d9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:33.331426 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7ddb1b-0009-48a0-8692-a0d164b68d9a service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:33.342272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653d935b-48f5-413d-be5a-f3d09cbd9b61 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:33.349193 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54302081-019b-462e-adcd-f318e8642140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:33.350296 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54302081-019b-462e-adcd-f318e8642140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:33.350699 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54302081-019b-462e-adcd-f318e8642140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:33.351133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54302081-019b-462e-adcd-f318e8642140 admin admin] PATH_INFO: `/v3/users/b3a783a787624362a82a36583e9b832d` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:33.352873 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54302081-019b-462e-adcd-f318e8642140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3a783a787624362a82a36583e9b832d)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:33.354832 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54302081-019b-462e-adcd-f318e8642140 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:33.358537 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 952/1940] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:33.466290 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ddb1b-0009-48a0-8692-a0d164b68d9a service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:33.475502 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7ddb1b-0009-48a0-8692-a0d164b68d9a service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:33.478238 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-54302081-019b-462e-adcd-f318e8642140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3a783a787624362a82a36583e9b832d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:33.479157 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-54302081-019b-462e-adcd-f318e8642140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3a783a787624362a82a36583e9b832d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:33.483612 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198a92a-e5f7-4bb7-afdf-7fe882bc2b48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:33.484996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198a92a-e5f7-4bb7-afdf-7fe882bc2b48 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:33.486281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198a92a-e5f7-4bb7-afdf-7fe882bc2b48 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:33.486281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3198a92a-e5f7-4bb7-afdf-7fe882bc2b48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:33.488828 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3198a92a-e5f7-4bb7-afdf-7fe882bc2b48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:33.492043 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-54302081-019b-462e-adcd-f318e8642140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3a783a787624362a82a36583e9b832d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:33.493264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-54302081-019b-462e-adcd-f318e8642140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3a783a787624362a82a36583e9b832d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:33.502914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-54302081-019b-462e-adcd-f318e8642140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3a783a787624362a82a36583e9b832d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:33.539968 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 989/1941] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:33 2022] DELETE /identity/v3/users/b3a783a787624362a82a36583e9b832d => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:33.541653 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3456a-66ef-46ec-aa23-05e1d5031bb1 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:33.542048 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3456a-66ef-46ec-aa23-05e1d5031bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:33.542429 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3456a-66ef-46ec-aa23-05e1d5031bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:33.569575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-79b3456a-66ef-46ec-aa23-05e1d5031bb1 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:33.571607 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-79b3456a-66ef-46ec-aa23-05e1d5031bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:33.600410 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198a92a-e5f7-4bb7-afdf-7fe882bc2b48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:33.603113 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3198a92a-e5f7-4bb7-afdf-7fe882bc2b48 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:33.615088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:33.648775 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 953/1942] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:33 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:33.650170 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198a92a-e5f7-4bb7-afdf-7fe882bc2b48 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:33.662072 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3198a92a-e5f7-4bb7-afdf-7fe882bc2b48 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:33.720586 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3198a92a-e5f7-4bb7-afdf-7fe882bc2b48 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:33.780412 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 990/1943] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:33.790893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3456a-66ef-46ec-aa23-05e1d5031bb1 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:33.792903 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-79b3456a-66ef-46ec-aa23-05e1d5031bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:33.828268 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdd8ae-ae31-4225-8042-810b2aaef434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:33.829661 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdd8ae-ae31-4225-8042-810b2aaef434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:33.830081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdd8ae-ae31-4225-8042-810b2aaef434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:33.830345 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdd8ae-ae31-4225-8042-810b2aaef434 admin admin] PATH_INFO: `/v3/projects/fc6cfce9e1704cc3a5deb3dffd62a846` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:33.831764 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdd8ae-ae31-4225-8042-810b2aaef434 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc6cfce9e1704cc3a5deb3dffd62a846)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:33.834471 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdd8ae-ae31-4225-8042-810b2aaef434 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:33.866015 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:33.870444 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b3456a-66ef-46ec-aa23-05e1d5031bb1 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:33.880258 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebfce8-d636-471a-a571-d189e4a99089 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:33.881445 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebfce8-d636-471a-a571-d189e4a99089 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:33.881731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebfce8-d636-471a-a571-d189e4a99089 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:33.882058 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebfce8-d636-471a-a571-d189e4a99089 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:33.895010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebfce8-d636-471a-a571-d189e4a99089 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:33.896702 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebfce8-d636-471a-a571-d189e4a99089 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:33.904336 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8fdd8ae-ae31-4225-8042-810b2aaef434 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc6cfce9e1704cc3a5deb3dffd62a846', 'request_id': 'req-f8fdd8ae-ae31-4225-8042-810b2aaef434'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:33.907472 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 991/1944] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:33.912842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8fdd8ae-ae31-4225-8042-810b2aaef434 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc6cfce9e1704cc3a5deb3dffd62a846', 'request_id': 'req-f8fdd8ae-ae31-4225-8042-810b2aaef434'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:33.922690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8fdd8ae-ae31-4225-8042-810b2aaef434 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc6cfce9e1704cc3a5deb3dffd62a846', 'request_id': 'req-f8fdd8ae-ae31-4225-8042-810b2aaef434'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:33.937051 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8fdd8ae-ae31-4225-8042-810b2aaef434 admin admin] The token cache is being invalidate because project fc6cfce9e1704cc3a5deb3dffd62a846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:33.937193 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8fdd8ae-ae31-4225-8042-810b2aaef434 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:33.937849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f8fdd8ae-ae31-4225-8042-810b2aaef434 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:33.939661 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 954/1945] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:33 2022] DELETE /identity/v3/projects/fc6cfce9e1704cc3a5deb3dffd62a846 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:33.943840 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebfce8-d636-471a-a571-d189e4a99089 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:33.954069 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebfce8-d636-471a-a571-d189e4a99089 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:34.042509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75b914-3b95-4cc7-99a7-0908fd564d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:34.043851 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75b914-3b95-4cc7-99a7-0908fd564d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:34.044172 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75b914-3b95-4cc7-99a7-0908fd564d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:34.044448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b75b914-3b95-4cc7-99a7-0908fd564d7a admin admin] PATH_INFO: `/v3/users/124c14f860cf4e828882294e7aa7dab7` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:34.046210 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75b914-3b95-4cc7-99a7-0908fd564d7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=124c14f860cf4e828882294e7aa7dab7)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:34.050235 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b75b914-3b95-4cc7-99a7-0908fd564d7a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:34.123835 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2b75b914-3b95-4cc7-99a7-0908fd564d7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '124c14f860cf4e828882294e7aa7dab7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.124621 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2b75b914-3b95-4cc7-99a7-0908fd564d7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '124c14f860cf4e828882294e7aa7dab7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.134914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2b75b914-3b95-4cc7-99a7-0908fd564d7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '124c14f860cf4e828882294e7aa7dab7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.136029 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2b75b914-3b95-4cc7-99a7-0908fd564d7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '124c14f860cf4e828882294e7aa7dab7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.144171 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2b75b914-3b95-4cc7-99a7-0908fd564d7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '124c14f860cf4e828882294e7aa7dab7'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.150006 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:34.171840 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 992/1946] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:33 2022] DELETE /identity/v3/users/124c14f860cf4e828882294e7aa7dab7 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:34.289231 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdd8ae-ae31-4225-8042-810b2aaef434 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:34.290742 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f8fdd8ae-ae31-4225-8042-810b2aaef434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:34.307486 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdd8ae-ae31-4225-8042-810b2aaef434 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:34.370386 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c0245-20d1-4f2b-b080-5da9a8a8953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:34.371518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c0245-20d1-4f2b-b080-5da9a8a8953d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:34.372150 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c0245-20d1-4f2b-b080-5da9a8a8953d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:34.378019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837c0245-20d1-4f2b-b080-5da9a8a8953d admin admin] PATH_INFO: `/v3/projects/b1a33991cb9049b993bfd80219f5d402` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:34.379537 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c0245-20d1-4f2b-b080-5da9a8a8953d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1a33991cb9049b993bfd80219f5d402)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:34.382709 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837c0245-20d1-4f2b-b080-5da9a8a8953d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:34.435132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-837c0245-20d1-4f2b-b080-5da9a8a8953d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a33991cb9049b993bfd80219f5d402', 'request_id': 'req-837c0245-20d1-4f2b-b080-5da9a8a8953d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.445969 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-837c0245-20d1-4f2b-b080-5da9a8a8953d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a33991cb9049b993bfd80219f5d402', 'request_id': 'req-837c0245-20d1-4f2b-b080-5da9a8a8953d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.456280 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-837c0245-20d1-4f2b-b080-5da9a8a8953d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a33991cb9049b993bfd80219f5d402', 'request_id': 'req-837c0245-20d1-4f2b-b080-5da9a8a8953d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.467836 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-837c0245-20d1-4f2b-b080-5da9a8a8953d admin admin] The token cache is being invalidate because project b1a33991cb9049b993bfd80219f5d402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:34.468129 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-837c0245-20d1-4f2b-b080-5da9a8a8953d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.468790 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-837c0245-20d1-4f2b-b080-5da9a8a8953d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.470423 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 955/1947] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:34 2022] DELETE /identity/v3/projects/b1a33991cb9049b993bfd80219f5d402 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:34.474552 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75b914-3b95-4cc7-99a7-0908fd564d7a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:34.476040 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2b75b914-3b95-4cc7-99a7-0908fd564d7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:34.488785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b75b914-3b95-4cc7-99a7-0908fd564d7a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:34.570226 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c9bb89-ad84-4717-aadd-9fb9b8756e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:34.571322 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9bb89-ad84-4717-aadd-9fb9b8756e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:34.571707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9bb89-ad84-4717-aadd-9fb9b8756e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:34.572088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c9bb89-ad84-4717-aadd-9fb9b8756e9a admin admin] PATH_INFO: `/v3/users/cc87cf4f847442de9ddadad83591e31a` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:34.574382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9bb89-ad84-4717-aadd-9fb9b8756e9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc87cf4f847442de9ddadad83591e31a)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:34.576777 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c9bb89-ad84-4717-aadd-9fb9b8756e9a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:34.581271 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c0245-20d1-4f2b-b080-5da9a8a8953d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:34.582792 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-837c0245-20d1-4f2b-b080-5da9a8a8953d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:34.601434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837c0245-20d1-4f2b-b080-5da9a8a8953d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:34.607724 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5dc36-26c8-438e-844e-fa88421f073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:34.608650 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5dc36-26c8-438e-844e-fa88421f073c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:34.608956 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5dc36-26c8-438e-844e-fa88421f073c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:34.609625 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5dc36-26c8-438e-844e-fa88421f073c admin admin] PATH_INFO: `/v3/projects/7ebc5f7f1e3d432f86854f2d7c0eb00f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:34.610567 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5dc36-26c8-438e-844e-fa88421f073c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ebc5f7f1e3d432f86854f2d7c0eb00f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:34.612700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5dc36-26c8-438e-844e-fa88421f073c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:34.641933 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-20c9bb89-ad84-4717-aadd-9fb9b8756e9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc87cf4f847442de9ddadad83591e31a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.642692 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-20c9bb89-ad84-4717-aadd-9fb9b8756e9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc87cf4f847442de9ddadad83591e31a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.657771 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-20c9bb89-ad84-4717-aadd-9fb9b8756e9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc87cf4f847442de9ddadad83591e31a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.668462 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:34.668707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-20c9bb89-ad84-4717-aadd-9fb9b8756e9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc87cf4f847442de9ddadad83591e31a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.677544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-20c9bb89-ad84-4717-aadd-9fb9b8756e9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc87cf4f847442de9ddadad83591e31a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.690635 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9af5dc36-26c8-438e-844e-fa88421f073c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ebc5f7f1e3d432f86854f2d7c0eb00f', 'request_id': 'req-9af5dc36-26c8-438e-844e-fa88421f073c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.699702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9af5dc36-26c8-438e-844e-fa88421f073c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ebc5f7f1e3d432f86854f2d7c0eb00f', 'request_id': 'req-9af5dc36-26c8-438e-844e-fa88421f073c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.700683 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 993/1948] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:34 2022] DELETE /identity/v3/users/cc87cf4f847442de9ddadad83591e31a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:34.706649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9af5dc36-26c8-438e-844e-fa88421f073c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ebc5f7f1e3d432f86854f2d7c0eb00f', 'request_id': 'req-9af5dc36-26c8-438e-844e-fa88421f073c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.718434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9af5dc36-26c8-438e-844e-fa88421f073c admin admin] The token cache is being invalidate because project 7ebc5f7f1e3d432f86854f2d7c0eb00f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:34.718727 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9af5dc36-26c8-438e-844e-fa88421f073c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.719491 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9af5dc36-26c8-438e-844e-fa88421f073c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:34.724784 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 956/1949] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:34 2022] DELETE /identity/v3/projects/7ebc5f7f1e3d432f86854f2d7c0eb00f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:34.726804 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca310f-c172-4dbc-b336-57835bd9e438 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:34.727225 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca310f-c172-4dbc-b336-57835bd9e438 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:34.727672 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca310f-c172-4dbc-b336-57835bd9e438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:34.747262 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-94ca310f-c172-4dbc-b336-57835bd9e438 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:34.748611 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-94ca310f-c172-4dbc-b336-57835bd9e438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:34.815909 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:34.831935 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 994/1950] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:34.836211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f120caf-46d5-4349-b85b-1b1cc8963056 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:34.836461 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f120caf-46d5-4349-b85b-1b1cc8963056 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:34.836800 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f120caf-46d5-4349-b85b-1b1cc8963056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:34.855814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0f120caf-46d5-4349-b85b-1b1cc8963056 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:34.857033 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0f120caf-46d5-4349-b85b-1b1cc8963056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:34.866103 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 957/1951] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:34.869911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca310f-c172-4dbc-b336-57835bd9e438 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:34.880000 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca310f-c172-4dbc-b336-57835bd9e438 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:34.884944 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d877ad2-c9e1-4b7d-abda-564d048ba8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:34.885595 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d877ad2-c9e1-4b7d-abda-564d048ba8f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:34.886223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d877ad2-c9e1-4b7d-abda-564d048ba8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:34.886223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d877ad2-c9e1-4b7d-abda-564d048ba8f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:34.886825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d877ad2-c9e1-4b7d-abda-564d048ba8f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:34.887130 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d877ad2-c9e1-4b7d-abda-564d048ba8f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:34.888892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d877ad2-c9e1-4b7d-abda-564d048ba8f7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:34.905251 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 995/1952] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:34.906276 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f120caf-46d5-4349-b85b-1b1cc8963056 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:34.917043 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f120caf-46d5-4349-b85b-1b1cc8963056 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:34.921806 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3551d32-3900-41da-ac10-e86bec2d233a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:34.922474 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3551d32-3900-41da-ac10-e86bec2d233a admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:34.922754 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3551d32-3900-41da-ac10-e86bec2d233a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:34.923027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3551d32-3900-41da-ac10-e86bec2d233a admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:34.923744 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3551d32-3900-41da-ac10-e86bec2d233a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:34.925967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3551d32-3900-41da-ac10-e86bec2d233a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:34.953632 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 958/1953] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:34 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:12:34.957609 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d877ad2-c9e1-4b7d-abda-564d048ba8f7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:34.967630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d877ad2-c9e1-4b7d-abda-564d048ba8f7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:35.024770 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ffbc1-1a88-4ce5-85c4-5299c81ce749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:35.025460 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ffbc1-1a88-4ce5-85c4-5299c81ce749 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.025748 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ffbc1-1a88-4ce5-85c4-5299c81ce749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.026030 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ffbc1-1a88-4ce5-85c4-5299c81ce749 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.026746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ffbc1-1a88-4ce5-85c4-5299c81ce749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:35.028734 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ffbc1-1a88-4ce5-85c4-5299c81ce749 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.053897 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 996/1954] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:34 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:12:35.055234 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3551d32-3900-41da-ac10-e86bec2d233a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:35.075639 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3551d32-3900-41da-ac10-e86bec2d233a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:35.081152 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da7a3c-18a3-4acb-9ddb-14c64902404b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:35.081839 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da7a3c-18a3-4acb-9ddb-14c64902404b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.082116 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da7a3c-18a3-4acb-9ddb-14c64902404b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.082389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da7a3c-18a3-4acb-9ddb-14c64902404b admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.083188 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da7a3c-18a3-4acb-9ddb-14c64902404b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:35.084853 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3da7a3c-18a3-4acb-9ddb-14c64902404b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.103012 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 959/1955] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:12:35.106981 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ffbc1-1a88-4ce5-85c4-5299c81ce749 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:35.118265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ffbc1-1a88-4ce5-85c4-5299c81ce749 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:35.127373 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edd65f-b074-4ee4-85ac-63be83a88a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:35.128294 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edd65f-b074-4ee4-85ac-63be83a88a3f admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.128613 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edd65f-b074-4ee4-85ac-63be83a88a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.128856 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edd65f-b074-4ee4-85ac-63be83a88a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.129859 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edd65f-b074-4ee4-85ac-63be83a88a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:35.131792 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edd65f-b074-4ee4-85ac-63be83a88a3f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.145535 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 997/1956] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:35.149690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da7a3c-18a3-4acb-9ddb-14c64902404b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:35.164456 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da7a3c-18a3-4acb-9ddb-14c64902404b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:35.171956 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9127c2-0d2f-4c35-b1a5-3cd3e77e7570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:35.172741 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9127c2-0d2f-4c35-b1a5-3cd3e77e7570 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.173109 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9127c2-0d2f-4c35-b1a5-3cd3e77e7570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.173540 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9127c2-0d2f-4c35-b1a5-3cd3e77e7570 admin admin] PATH_INFO: `/v3/projects/adb349eaf1db47058b2319144a638dab/users/9ec4ab30360347be842245b1100a4755/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.183043 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edd65f-b074-4ee4-85ac-63be83a88a3f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:35.189079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-95edd65f-b074-4ee4-85ac-63be83a88a3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:35.204572 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edd65f-b074-4ee4-85ac-63be83a88a3f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:35.210928 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77629327-b01a-4dcf-8b20-e945c37afc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:35.212223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77629327-b01a-4dcf-8b20-e945c37afc83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.214487 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9127c2-0d2f-4c35-b1a5-3cd3e77e7570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adb349eaf1db47058b2319144a638dab, user_id=9ec4ab30360347be842245b1100a4755, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:35.215443 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77629327-b01a-4dcf-8b20-e945c37afc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.216356 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77629327-b01a-4dcf-8b20-e945c37afc83 admin admin] PATH_INFO: `/v3/projects/dc5b2347909548d582ebe862f5ac15ee` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.217238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9127c2-0d2f-4c35-b1a5-3cd3e77e7570 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.217692 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77629327-b01a-4dcf-8b20-e945c37afc83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc5b2347909548d582ebe862f5ac15ee)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:35.219940 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77629327-b01a-4dcf-8b20-e945c37afc83 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.234338 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 960/1957] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:35 2022] PUT /identity/v3/projects/adb349eaf1db47058b2319144a638dab/users/9ec4ab30360347be842245b1100a4755/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:35.246392 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fa892-3446-4be2-b37f-e2d793061d40 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.246688 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fa892-3446-4be2-b37f-e2d793061d40 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.246978 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fa892-3446-4be2-b37f-e2d793061d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.279445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-df8fa892-3446-4be2-b37f-e2d793061d40 None None] MFA Rules not processed for user `9ec4ab30360347be842245b1100a4755`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:35.281309 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-df8fa892-3446-4be2-b37f-e2d793061d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:35.282775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-77629327-b01a-4dcf-8b20-e945c37afc83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc5b2347909548d582ebe862f5ac15ee', 'request_id': 'req-77629327-b01a-4dcf-8b20-e945c37afc83'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:35.290672 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-77629327-b01a-4dcf-8b20-e945c37afc83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc5b2347909548d582ebe862f5ac15ee', 'request_id': 'req-77629327-b01a-4dcf-8b20-e945c37afc83'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:35.300158 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-77629327-b01a-4dcf-8b20-e945c37afc83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc5b2347909548d582ebe862f5ac15ee', 'request_id': 'req-77629327-b01a-4dcf-8b20-e945c37afc83'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:35.321766 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-77629327-b01a-4dcf-8b20-e945c37afc83 admin admin] The token cache is being invalidate because project dc5b2347909548d582ebe862f5ac15ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:35.323144 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-77629327-b01a-4dcf-8b20-e945c37afc83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:35.324037 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-77629327-b01a-4dcf-8b20-e945c37afc83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:35.327787 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 998/1958] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:35 2022] DELETE /identity/v3/projects/dc5b2347909548d582ebe862f5ac15ee => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:35.332656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831b9c6-562b-4232-9de2-5ba272ce1f7d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.333171 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831b9c6-562b-4232-9de2-5ba272ce1f7d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.334806 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831b9c6-562b-4232-9de2-5ba272ce1f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.359682 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5831b9c6-562b-4232-9de2-5ba272ce1f7d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:35.361716 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5831b9c6-562b-4232-9de2-5ba272ce1f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:35.367096 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 961/1959] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:35.372425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fa892-3446-4be2-b37f-e2d793061d40 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:35.374220 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-df8fa892-3446-4be2-b37f-e2d793061d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:35.450332 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:35.482236 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:35.499041 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fa892-3446-4be2-b37f-e2d793061d40 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:35.505009 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9fd10-1c8d-4b42-bcb6-5f32bcb40731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:35.505716 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9fd10-1c8d-4b42-bcb6-5f32bcb40731 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.505965 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9fd10-1c8d-4b42-bcb6-5f32bcb40731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.506246 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd9fd10-1c8d-4b42-bcb6-5f32bcb40731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.507414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9fd10-1c8d-4b42-bcb6-5f32bcb40731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:35.509355 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd9fd10-1c8d-4b42-bcb6-5f32bcb40731 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.513185 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 999/1960] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:35.520913 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18269531-b412-41e5-95fb-ee2333108586 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.521482 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18269531-b412-41e5-95fb-ee2333108586 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.521926 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18269531-b412-41e5-95fb-ee2333108586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.555174 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-18269531-b412-41e5-95fb-ee2333108586 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:35.557942 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-18269531-b412-41e5-95fb-ee2333108586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:35.559748 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 962/1961] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:35 2022] POST /identity/v3/projects => generated 377 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:35.564859 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9fd10-1c8d-4b42-bcb6-5f32bcb40731 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:35.641045 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1000/1962] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:35.645645 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18269531-b412-41e5-95fb-ee2333108586 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:35.649192 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd9fd10-1c8d-4b42-bcb6-5f32bcb40731 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:35.655467 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddbb50-f941-49ba-976a-a8fd8cd2847b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:35.656003 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18269531-b412-41e5-95fb-ee2333108586 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:35.656141 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddbb50-f941-49ba-976a-a8fd8cd2847b admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.656356 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddbb50-f941-49ba-976a-a8fd8cd2847b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.656673 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ddbb50-f941-49ba-976a-a8fd8cd2847b admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.657570 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddbb50-f941-49ba-976a-a8fd8cd2847b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:35.659621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ddbb50-f941-49ba-976a-a8fd8cd2847b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.662228 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2a2ac-5fd9-4af6-8c24-612f3398a5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:35.663011 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2a2ac-5fd9-4af6-8c24-612f3398a5c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.663437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2a2ac-5fd9-4af6-8c24-612f3398a5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.663825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce2a2ac-5fd9-4af6-8c24-612f3398a5c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.664678 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2a2ac-5fd9-4af6-8c24-612f3398a5c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:35.665221 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2a2ac-5fd9-4af6-8c24-612f3398a5c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:35.667081 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce2a2ac-5fd9-4af6-8c24-612f3398a5c8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.688382 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1001/1963] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:35.689863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2a2ac-5fd9-4af6-8c24-612f3398a5c8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:35.699116 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 963/1964] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:35 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:35.702836 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddbb50-f941-49ba-976a-a8fd8cd2847b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:35.708106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce2a2ac-5fd9-4af6-8c24-612f3398a5c8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:35.713545 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8752f4-9576-4901-994d-48831feaa8e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:35.714336 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8752f4-9576-4901-994d-48831feaa8e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.714725 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8752f4-9576-4901-994d-48831feaa8e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.715101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8752f4-9576-4901-994d-48831feaa8e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.716633 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8752f4-9576-4901-994d-48831feaa8e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:35.719589 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8752f4-9576-4901-994d-48831feaa8e2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.720713 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ddbb50-f941-49ba-976a-a8fd8cd2847b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:35.733658 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3e900-81e9-4cbd-b720-7053ace8919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:35.734358 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3e900-81e9-4cbd-b720-7053ace8919e admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.734644 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3e900-81e9-4cbd-b720-7053ace8919e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.734924 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3e900-81e9-4cbd-b720-7053ace8919e admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.735688 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3e900-81e9-4cbd-b720-7053ace8919e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:35.737455 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3e900-81e9-4cbd-b720-7053ace8919e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.756917 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 964/1965] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:35.761880 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113bf9b-ba9a-4f15-a7b4-3e0ddb1d9eb1 None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.762187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113bf9b-ba9a-4f15-a7b4-3e0ddb1d9eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.762477 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113bf9b-ba9a-4f15-a7b4-3e0ddb1d9eb1 None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.764146 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 965/1966] 10.222.0.42 () {54 vars in 921 bytes} [Sun Jul 24 01:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:12:35.764879 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113bf9b-ba9a-4f15-a7b4-3e0ddb1d9eb1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:35.780300 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113bf9b-ba9a-4f15-a7b4-3e0ddb1d9eb1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:35.780743 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1002/1967] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:35 2022] POST /identity/v3/projects => generated 383 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:35.787714 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0114f-f931-4f7d-b8ea-9ae7136661ea None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.788143 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0114f-f931-4f7d-b8ea-9ae7136661ea None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.788544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0114f-f931-4f7d-b8ea-9ae7136661ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.821544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a3b0114f-f931-4f7d-b8ea-9ae7136661ea None None] MFA Rules not processed for user `6c32c443ee1a421e98e7656e8e86e27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:35.822981 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a3b0114f-f931-4f7d-b8ea-9ae7136661ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:35.877155 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b46c9-7124-43a2-b3e7-db5b3f1a0246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:35.878049 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b46c9-7124-43a2-b3e7-db5b3f1a0246 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.878346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b46c9-7124-43a2-b3e7-db5b3f1a0246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.878637 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b46c9-7124-43a2-b3e7-db5b3f1a0246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.881581 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b46c9-7124-43a2-b3e7-db5b3f1a0246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:35.883601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b46c9-7124-43a2-b3e7-db5b3f1a0246 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.900970 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 966/1968] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:35.902372 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b46c9-7124-43a2-b3e7-db5b3f1a0246 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:35.908212 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1003/1969] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Jul 24 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:35.908917 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0114f-f931-4f7d-b8ea-9ae7136661ea None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:35.919748 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0114f-f931-4f7d-b8ea-9ae7136661ea None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:35.922641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b46c9-7124-43a2-b3e7-db5b3f1a0246 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:35.924360 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da39cf-1514-449d-b039-1644ec80a282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:35.925278 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da39cf-1514-449d-b039-1644ec80a282 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.925565 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da39cf-1514-449d-b039-1644ec80a282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.925842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da39cf-1514-449d-b039-1644ec80a282 admin admin] PATH_INFO: `/v3/projects/ecdaa0fec4bd4ecc9f2f63d7cf0f3c9d/users/ebfec4e975b5410ba5bc7124f8cd34cf/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.931986 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76658d72-43b5-4b6f-bd5f-84019a9e25cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:35.933257 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76658d72-43b5-4b6f-bd5f-84019a9e25cc admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.933868 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76658d72-43b5-4b6f-bd5f-84019a9e25cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.934637 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76658d72-43b5-4b6f-bd5f-84019a9e25cc admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:35.935686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76658d72-43b5-4b6f-bd5f-84019a9e25cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:35.938524 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76658d72-43b5-4b6f-bd5f-84019a9e25cc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.942358 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da39cf-1514-449d-b039-1644ec80a282 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecdaa0fec4bd4ecc9f2f63d7cf0f3c9d, user_id=ebfec4e975b5410ba5bc7124f8cd34cf, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:35.945132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da39cf-1514-449d-b039-1644ec80a282 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:35.962155 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1004/1970] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:35 2022] PUT /identity/v3/projects/ecdaa0fec4bd4ecc9f2f63d7cf0f3c9d/users/ebfec4e975b5410ba5bc7124f8cd34cf/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:35.969006 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 967/1971] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:35 2022] POST /identity/v3/users => generated 292 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:35.970221 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da39cf-1514-449d-b039-1644ec80a282 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:35.974125 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed4f80-aacd-4e32-8e85-98d9ddb826c0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:35.974506 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed4f80-aacd-4e32-8e85-98d9ddb826c0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:35.974788 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed4f80-aacd-4e32-8e85-98d9ddb826c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.004499 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:36.015533 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2bed4f80-aacd-4e32-8e85-98d9ddb826c0 None None] MFA Rules not processed for user `ebfec4e975b5410ba5bc7124f8cd34cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:36.015533 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2bed4f80-aacd-4e32-8e85-98d9ddb826c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:36.027998 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:36.052548 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da39cf-1514-449d-b039-1644ec80a282 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.057908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5e49e-5f39-4bff-9459-c6475684c70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.058591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5e49e-5f39-4bff-9459-c6475684c70a admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.058875 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5e49e-5f39-4bff-9459-c6475684c70a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.059157 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e5e49e-5f39-4bff-9459-c6475684c70a admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.059923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5e49e-5f39-4bff-9459-c6475684c70a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.061545 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e5e49e-5f39-4bff-9459-c6475684c70a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.072694 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1005/1972] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:36.074117 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5e49e-5f39-4bff-9459-c6475684c70a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.075934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f2e5e49e-5f39-4bff-9459-c6475684c70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:36.088918 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 968/1973] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:36.089864 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed4f80-aacd-4e32-8e85-98d9ddb826c0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.104180 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed4f80-aacd-4e32-8e85-98d9ddb826c0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.109902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea6864-cdef-49ee-99ea-ffbc1e6d8d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.110742 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea6864-cdef-49ee-99ea-ffbc1e6d8d23 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.111487 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea6864-cdef-49ee-99ea-ffbc1e6d8d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.111780 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ea6864-cdef-49ee-99ea-ffbc1e6d8d23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.112660 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea6864-cdef-49ee-99ea-ffbc1e6d8d23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.115165 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ea6864-cdef-49ee-99ea-ffbc1e6d8d23 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.131462 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 969/1974] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:36.131462 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea6864-cdef-49ee-99ea-ffbc1e6d8d23 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.144122 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ea6864-cdef-49ee-99ea-ffbc1e6d8d23 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.150416 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4c1ee-aebd-4bb1-ac0d-77f4e292940d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.151261 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4c1ee-aebd-4bb1-ac0d-77f4e292940d admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.151591 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4c1ee-aebd-4bb1-ac0d-77f4e292940d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.151921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4c1ee-aebd-4bb1-ac0d-77f4e292940d admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.152776 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4c1ee-aebd-4bb1-ac0d-77f4e292940d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.155448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4c1ee-aebd-4bb1-ac0d-77f4e292940d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.168797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e5e49e-5f39-4bff-9459-c6475684c70a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.179674 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd24ee-5036-4b64-bbe0-be3543da01b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.180448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd24ee-5036-4b64-bbe0-be3543da01b0 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.180889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd24ee-5036-4b64-bbe0-be3543da01b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.181230 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd24ee-5036-4b64-bbe0-be3543da01b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.190368 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 970/1975] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:36 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:36.190368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4c1ee-aebd-4bb1-ac0d-77f4e292940d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.199235 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd24ee-5036-4b64-bbe0-be3543da01b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.201030 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd24ee-5036-4b64-bbe0-be3543da01b0 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.215630 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1006/1976] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:36.216689 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd24ee-5036-4b64-bbe0-be3543da01b0 service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.233388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd24ee-5036-4b64-bbe0-be3543da01b0 service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.374319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4c1ee-aebd-4bb1-ac0d-77f4e292940d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.383384 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5ca08-43bc-4e11-83e7-44ce0bde787a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.384394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5ca08-43bc-4e11-83e7-44ce0bde787a admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.384755 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5ca08-43bc-4e11-83e7-44ce0bde787a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.385798 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5ca08-43bc-4e11-83e7-44ce0bde787a admin admin] PATH_INFO: `/v3/projects/7a640ef44c664f91bdb3480a34cebeec/users/5f7c89c8a9324667bdfd40ff31e0fdc8/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.391778 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e33cf-860f-4a6c-bfe5-918f2c6405f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.392562 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e33cf-860f-4a6c-bfe5-918f2c6405f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.392911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e33cf-860f-4a6c-bfe5-918f2c6405f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.393247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952e33cf-860f-4a6c-bfe5-918f2c6405f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.394366 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e33cf-860f-4a6c-bfe5-918f2c6405f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.396087 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952e33cf-860f-4a6c-bfe5-918f2c6405f3 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.411212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5ca08-43bc-4e11-83e7-44ce0bde787a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a640ef44c664f91bdb3480a34cebeec, user_id=5f7c89c8a9324667bdfd40ff31e0fdc8, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.414438 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa5ca08-43bc-4e11-83e7-44ce0bde787a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.426438 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1007/1977] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:36 2022] POST /identity/v3/users => generated 296 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:36.427623 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e33cf-860f-4a6c-bfe5-918f2c6405f3 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.447024 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 971/1978] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:36 2022] PUT /identity/v3/projects/7a640ef44c664f91bdb3480a34cebeec/users/5f7c89c8a9324667bdfd40ff31e0fdc8/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:36.447230 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952e33cf-860f-4a6c-bfe5-918f2c6405f3 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.449300 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a643df-302e-4d9f-b317-6bfbb868a38f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.449787 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a643df-302e-4d9f-b317-6bfbb868a38f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.450179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a643df-302e-4d9f-b317-6bfbb868a38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.485165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:36.486570 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-35a643df-302e-4d9f-b317-6bfbb868a38f None None] MFA Rules not processed for user `5f7c89c8a9324667bdfd40ff31e0fdc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:36.488075 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-35a643df-302e-4d9f-b317-6bfbb868a38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:36.531878 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984e107-72b9-4b70-87a7-8f043d91265b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.533027 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984e107-72b9-4b70-87a7-8f043d91265b admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.533644 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984e107-72b9-4b70-87a7-8f043d91265b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.536119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6984e107-72b9-4b70-87a7-8f043d91265b admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.537696 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984e107-72b9-4b70-87a7-8f043d91265b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.540796 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6984e107-72b9-4b70-87a7-8f043d91265b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.578051 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1008/1979] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:36.582405 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984e107-72b9-4b70-87a7-8f043d91265b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.618354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:36.626899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6984e107-72b9-4b70-87a7-8f043d91265b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.642040 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61947acd-8724-4e98-83fd-7cd1da92795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.643067 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61947acd-8724-4e98-83fd-7cd1da92795f admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.643450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61947acd-8724-4e98-83fd-7cd1da92795f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.643733 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61947acd-8724-4e98-83fd-7cd1da92795f admin admin] PATH_INFO: `/v3/projects/c9d2ce2228ee4999894fcd12b7e06bcd/users/1cc7a4ce510d4aa4a24cb144dfb1f722/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.644700 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 972/1980] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:36.652204 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a643df-302e-4d9f-b317-6bfbb868a38f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.667244 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a643df-302e-4d9f-b317-6bfbb868a38f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.667654 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61947acd-8724-4e98-83fd-7cd1da92795f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d2ce2228ee4999894fcd12b7e06bcd, user_id=1cc7a4ce510d4aa4a24cb144dfb1f722, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.670272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61947acd-8724-4e98-83fd-7cd1da92795f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.673491 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acc017-196e-4690-ae1b-e650b142e71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.675320 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acc017-196e-4690-ae1b-e650b142e71f admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.675940 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acc017-196e-4690-ae1b-e650b142e71f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.676192 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53acc017-196e-4690-ae1b-e650b142e71f admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.677029 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acc017-196e-4690-ae1b-e650b142e71f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.679678 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53acc017-196e-4690-ae1b-e650b142e71f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.688435 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1009/1981] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:36 2022] PUT /identity/v3/projects/c9d2ce2228ee4999894fcd12b7e06bcd/users/1cc7a4ce510d4aa4a24cb144dfb1f722/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:36.693270 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61947acd-8724-4e98-83fd-7cd1da92795f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.723741 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 973/1982] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:36 2022] POST /identity/v3/projects => generated 385 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:36.724743 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acc017-196e-4690-ae1b-e650b142e71f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.766001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61947acd-8724-4e98-83fd-7cd1da92795f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.803789 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53acc017-196e-4690-ae1b-e650b142e71f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.809253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02176767-3b84-4b59-8cc9-d73cc8905fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.809928 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02176767-3b84-4b59-8cc9-d73cc8905fbb admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.810311 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02176767-3b84-4b59-8cc9-d73cc8905fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.810683 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02176767-3b84-4b59-8cc9-d73cc8905fbb admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.811893 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02176767-3b84-4b59-8cc9-d73cc8905fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.813983 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02176767-3b84-4b59-8cc9-d73cc8905fbb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.831629 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95af5da-fbba-4f8c-82e4-97203ea9b7f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.834392 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95af5da-fbba-4f8c-82e4-97203ea9b7f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.834820 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95af5da-fbba-4f8c-82e4-97203ea9b7f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.835238 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95af5da-fbba-4f8c-82e4-97203ea9b7f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.836346 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95af5da-fbba-4f8c-82e4-97203ea9b7f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.838658 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95af5da-fbba-4f8c-82e4-97203ea9b7f1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.843180 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 974/1983] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:36 2022] POST /identity/v3/users => generated 299 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:36.848112 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02176767-3b84-4b59-8cc9-d73cc8905fbb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.859224 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02176767-3b84-4b59-8cc9-d73cc8905fbb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.860542 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1010/1984] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:36.864539 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95af5da-fbba-4f8c-82e4-97203ea9b7f1 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.867940 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12363aa-49ca-4d7e-afa8-9c72994f8bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.868616 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12363aa-49ca-4d7e-afa8-9c72994f8bbb admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.869031 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12363aa-49ca-4d7e-afa8-9c72994f8bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.869319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12363aa-49ca-4d7e-afa8-9c72994f8bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.870231 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12363aa-49ca-4d7e-afa8-9c72994f8bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.872158 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12363aa-49ca-4d7e-afa8-9c72994f8bbb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.875523 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95af5da-fbba-4f8c-82e4-97203ea9b7f1 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.880467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65467dea-8b74-475d-973b-f4b5f8ec7463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.882402 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65467dea-8b74-475d-973b-f4b5f8ec7463 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.882781 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65467dea-8b74-475d-973b-f4b5f8ec7463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.883194 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65467dea-8b74-475d-973b-f4b5f8ec7463 admin admin] PATH_INFO: `/v3/projects/c9d2ce2228ee4999894fcd12b7e06bcd/users/1cc7a4ce510d4aa4a24cb144dfb1f722/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.885428 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65467dea-8b74-475d-973b-f4b5f8ec7463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9d2ce2228ee4999894fcd12b7e06bcd, user_id=1cc7a4ce510d4aa4a24cb144dfb1f722, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:36.888302 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65467dea-8b74-475d-973b-f4b5f8ec7463 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:36.889475 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 975/1985] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:36.893938 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12363aa-49ca-4d7e-afa8-9c72994f8bbb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:36.900106 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1011/1986] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:36 2022] PUT /identity/v3/projects/c9d2ce2228ee4999894fcd12b7e06bcd/users/1cc7a4ce510d4aa4a24cb144dfb1f722/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:36.909720 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12363aa-49ca-4d7e-afa8-9c72994f8bbb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:36.911475 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92902be2-53c2-4fdc-8bc9-f53e41f5f010 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.911796 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92902be2-53c2-4fdc-8bc9-f53e41f5f010 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.912128 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92902be2-53c2-4fdc-8bc9-f53e41f5f010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:36.940830 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-92902be2-53c2-4fdc-8bc9-f53e41f5f010 None None] MFA Rules not processed for user `1cc7a4ce510d4aa4a24cb144dfb1f722`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:36.942154 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-92902be2-53c2-4fdc-8bc9-f53e41f5f010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:36.969120 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:36.986512 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78a1c3-9dd5-41ea-b52d-a2717c5501b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:36.987532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78a1c3-9dd5-41ea-b52d-a2717c5501b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:36.987945 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78a1c3-9dd5-41ea-b52d-a2717c5501b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:36.988342 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78a1c3-9dd5-41ea-b52d-a2717c5501b4 admin admin] PATH_INFO: `/v3/projects/83283c713a8e4b6983b6518fa1008050/users/d56656b3665f4c9594cf7eaf714140bb/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:37.011649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78a1c3-9dd5-41ea-b52d-a2717c5501b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83283c713a8e4b6983b6518fa1008050, user_id=d56656b3665f4c9594cf7eaf714140bb, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:37.016297 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78a1c3-9dd5-41ea-b52d-a2717c5501b4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:37.033333 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1012/1987] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:37.048511 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92902be2-53c2-4fdc-8bc9-f53e41f5f010 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:37.051492 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-92902be2-53c2-4fdc-8bc9-f53e41f5f010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:37.059350 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 976/1988] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:36 2022] PUT /identity/v3/projects/83283c713a8e4b6983b6518fa1008050/users/d56656b3665f4c9594cf7eaf714140bb/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:37.066045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78a1c3-9dd5-41ea-b52d-a2717c5501b4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:37.129898 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:37.154283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92902be2-53c2-4fdc-8bc9-f53e41f5f010 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:37.173936 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78a1c3-9dd5-41ea-b52d-a2717c5501b4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:37.181328 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527363e-6f96-449e-b6ca-a53a3fcce977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:37.182229 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527363e-6f96-449e-b6ca-a53a3fcce977 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:37.182606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527363e-6f96-449e-b6ca-a53a3fcce977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:37.183005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527363e-6f96-449e-b6ca-a53a3fcce977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:37.184625 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527363e-6f96-449e-b6ca-a53a3fcce977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:37.186416 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d527363e-6f96-449e-b6ca-a53a3fcce977 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:37.206904 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 977/1989] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:37.211312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527363e-6f96-449e-b6ca-a53a3fcce977 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:37.232535 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527363e-6f96-449e-b6ca-a53a3fcce977 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:37.235981 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea9b91-7c9e-4cfa-9ff9-a8b69be1b360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:37.239940 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea9b91-7c9e-4cfa-9ff9-a8b69be1b360 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:37.240384 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea9b91-7c9e-4cfa-9ff9-a8b69be1b360 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:37.240840 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea9b91-7c9e-4cfa-9ff9-a8b69be1b360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:37.242397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84729905-b809-4c26-be7f-ec69b7d3137a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:37.243681 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84729905-b809-4c26-be7f-ec69b7d3137a admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:37.244001 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84729905-b809-4c26-be7f-ec69b7d3137a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:37.244365 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84729905-b809-4c26-be7f-ec69b7d3137a admin admin] PATH_INFO: `/v3/projects/83283c713a8e4b6983b6518fa1008050/users/d56656b3665f4c9594cf7eaf714140bb/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:37.246515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84729905-b809-4c26-be7f-ec69b7d3137a admin admin] RBAC: Authorizing `identity:create_grant(project_id=83283c713a8e4b6983b6518fa1008050, user_id=d56656b3665f4c9594cf7eaf714140bb, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:37.249600 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84729905-b809-4c26-be7f-ec69b7d3137a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:37.265099 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 978/1990] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:37 2022] PUT /identity/v3/projects/83283c713a8e4b6983b6518fa1008050/users/d56656b3665f4c9594cf7eaf714140bb/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:37.276822 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa82c96-324b-4902-a800-c05b8d69429c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:37.277214 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa82c96-324b-4902-a800-c05b8d69429c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:37.277895 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa82c96-324b-4902-a800-c05b8d69429c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:37.317487 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1aa82c96-324b-4902-a800-c05b8d69429c None None] MFA Rules not processed for user `d56656b3665f4c9594cf7eaf714140bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:37.318885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1aa82c96-324b-4902-a800-c05b8d69429c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:37.349491 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea9b91-7c9e-4cfa-9ff9-a8b69be1b360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:37.351120 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea9b91-7c9e-4cfa-9ff9-a8b69be1b360 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:37.363808 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1013/1991] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:37.403787 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 979/1992] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:37.405578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea9b91-7c9e-4cfa-9ff9-a8b69be1b360 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:37.415122 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea9b91-7c9e-4cfa-9ff9-a8b69be1b360 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:37.439323 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:37.440501 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa82c96-324b-4902-a800-c05b8d69429c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:37.442316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1aa82c96-324b-4902-a800-c05b8d69429c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:37.465921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024311c4-e2bd-4861-971e-5053c0f8f067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:37.466576 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024311c4-e2bd-4861-971e-5053c0f8f067 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:37.466858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024311c4-e2bd-4861-971e-5053c0f8f067 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:37.467136 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024311c4-e2bd-4861-971e-5053c0f8f067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:37.518760 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa82c96-324b-4902-a800-c05b8d69429c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:37.522629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3f55d5-1ce4-4d45-9415-e741df622ea9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:37.523394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f55d5-1ce4-4d45-9415-e741df622ea9 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:37.523752 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f55d5-1ce4-4d45-9415-e741df622ea9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:37.524096 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f55d5-1ce4-4d45-9415-e741df622ea9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:37.540993 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024311c4-e2bd-4861-971e-5053c0f8f067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:37.542555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024311c4-e2bd-4861-971e-5053c0f8f067 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:37.589227 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1014/1993] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:37 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:37.614606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:37.622285 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f55d5-1ce4-4d45-9415-e741df622ea9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:37.625065 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3f55d5-1ce4-4d45-9415-e741df622ea9 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:37.645336 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 980/1994] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:37 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:39.834590 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024311c4-e2bd-4861-971e-5053c0f8f067 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:39.836119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-024311c4-e2bd-4861-971e-5053c0f8f067 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:39.940103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024311c4-e2bd-4861-971e-5053c0f8f067 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:39.945151 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66017a-6394-400c-935c-88de78f20634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:39.946048 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66017a-6394-400c-935c-88de78f20634 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:39.946334 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66017a-6394-400c-935c-88de78f20634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:39.946613 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66017a-6394-400c-935c-88de78f20634 admin admin] PATH_INFO: `/v3/users/e14ad1d26a31489e94ec626bc5973f61` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:39.947839 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66017a-6394-400c-935c-88de78f20634 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e14ad1d26a31489e94ec626bc5973f61)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:39.949803 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66017a-6394-400c-935c-88de78f20634 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:39.996535 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4c66017a-6394-400c-935c-88de78f20634 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e14ad1d26a31489e94ec626bc5973f61'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:39.997240 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4c66017a-6394-400c-935c-88de78f20634 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e14ad1d26a31489e94ec626bc5973f61'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:40.005653 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4c66017a-6394-400c-935c-88de78f20634 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e14ad1d26a31489e94ec626bc5973f61'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:40.006289 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4c66017a-6394-400c-935c-88de78f20634 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e14ad1d26a31489e94ec626bc5973f61'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:40.013799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-4c66017a-6394-400c-935c-88de78f20634 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e14ad1d26a31489e94ec626bc5973f61'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:40.029395 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:40.033943 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1015/1995] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:39 2022] DELETE /identity/v3/users/e14ad1d26a31489e94ec626bc5973f61 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:40.038907 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2431461-7bf4-4b71-9ee7-ba27377a0d52 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:40.039467 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2431461-7bf4-4b71-9ee7-ba27377a0d52 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:40.039580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2431461-7bf4-4b71-9ee7-ba27377a0d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:40.059019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c2431461-7bf4-4b71-9ee7-ba27377a0d52 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:40.060291 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c2431461-7bf4-4b71-9ee7-ba27377a0d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:40.128628 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 981/1996] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:40.142067 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66017a-6394-400c-935c-88de78f20634 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:40.144106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4c66017a-6394-400c-935c-88de78f20634 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:40.217571 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66017a-6394-400c-935c-88de78f20634 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:40.221361 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80316818-92b7-492a-8162-69add78b7942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:40.222016 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316818-92b7-492a-8162-69add78b7942 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:40.222304 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316818-92b7-492a-8162-69add78b7942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:40.222584 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80316818-92b7-492a-8162-69add78b7942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:40.232575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80316818-92b7-492a-8162-69add78b7942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:40.234030 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80316818-92b7-492a-8162-69add78b7942 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:40.244372 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1016/1997] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:40.528342 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2431461-7bf4-4b71-9ee7-ba27377a0d52 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:40.529779 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c2431461-7bf4-4b71-9ee7-ba27377a0d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:40.543122 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2431461-7bf4-4b71-9ee7-ba27377a0d52 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:40.550181 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978be789-d7bf-40dd-ac20-e9cae45a9bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:40.551856 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978be789-d7bf-40dd-ac20-e9cae45a9bab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:40.552157 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978be789-d7bf-40dd-ac20-e9cae45a9bab admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:40.552443 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978be789-d7bf-40dd-ac20-e9cae45a9bab admin admin] PATH_INFO: `/v3/projects/88aee93f28ac4b4ea0fb5720e8c3551f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:40.554355 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978be789-d7bf-40dd-ac20-e9cae45a9bab admin admin] RBAC: Authorizing `identity:delete_project(project_id=88aee93f28ac4b4ea0fb5720e8c3551f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:40.556341 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978be789-d7bf-40dd-ac20-e9cae45a9bab admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:40.607243 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-978be789-d7bf-40dd-ac20-e9cae45a9bab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88aee93f28ac4b4ea0fb5720e8c3551f', 'request_id': 'req-978be789-d7bf-40dd-ac20-e9cae45a9bab'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:40.618975 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-978be789-d7bf-40dd-ac20-e9cae45a9bab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88aee93f28ac4b4ea0fb5720e8c3551f', 'request_id': 'req-978be789-d7bf-40dd-ac20-e9cae45a9bab'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:40.627472 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-978be789-d7bf-40dd-ac20-e9cae45a9bab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88aee93f28ac4b4ea0fb5720e8c3551f', 'request_id': 'req-978be789-d7bf-40dd-ac20-e9cae45a9bab'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:40.640160 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-978be789-d7bf-40dd-ac20-e9cae45a9bab admin admin] The token cache is being invalidate because project 88aee93f28ac4b4ea0fb5720e8c3551f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:40.640450 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-978be789-d7bf-40dd-ac20-e9cae45a9bab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:40.641122 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-978be789-d7bf-40dd-ac20-e9cae45a9bab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:40.642697 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 982/1998] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:40 2022] DELETE /identity/v3/projects/88aee93f28ac4b4ea0fb5720e8c3551f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:40.647475 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80316818-92b7-492a-8162-69add78b7942 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:40.658340 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80316818-92b7-492a-8162-69add78b7942 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:40.717025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4154d59-ac30-45a0-9576-20a807a5f4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:40.717920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4154d59-ac30-45a0-9576-20a807a5f4b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:40.718209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4154d59-ac30-45a0-9576-20a807a5f4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:40.718515 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4154d59-ac30-45a0-9576-20a807a5f4b2 admin admin] PATH_INFO: `/v3/users/719f906e19ae4b5b991e0b37e15deaca` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:40.719853 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4154d59-ac30-45a0-9576-20a807a5f4b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=719f906e19ae4b5b991e0b37e15deaca)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:40.721818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4154d59-ac30-45a0-9576-20a807a5f4b2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:40.769383 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f4154d59-ac30-45a0-9576-20a807a5f4b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '719f906e19ae4b5b991e0b37e15deaca'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:40.770035 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f4154d59-ac30-45a0-9576-20a807a5f4b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '719f906e19ae4b5b991e0b37e15deaca'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:40.777915 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f4154d59-ac30-45a0-9576-20a807a5f4b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '719f906e19ae4b5b991e0b37e15deaca'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:40.778790 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f4154d59-ac30-45a0-9576-20a807a5f4b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '719f906e19ae4b5b991e0b37e15deaca'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:40.785705 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f4154d59-ac30-45a0-9576-20a807a5f4b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '719f906e19ae4b5b991e0b37e15deaca'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:40.804157 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1017/1999] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:40 2022] DELETE /identity/v3/users/719f906e19ae4b5b991e0b37e15deaca => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:41.047352 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978be789-d7bf-40dd-ac20-e9cae45a9bab admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:41.049665 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-978be789-d7bf-40dd-ac20-e9cae45a9bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:41.070184 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978be789-d7bf-40dd-ac20-e9cae45a9bab admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:41.182407 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4af358-a5e3-420d-a4da-a21bf94eff79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:41.183668 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4af358-a5e3-420d-a4da-a21bf94eff79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:41.184051 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4af358-a5e3-420d-a4da-a21bf94eff79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:41.184420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4af358-a5e3-420d-a4da-a21bf94eff79 admin admin] PATH_INFO: `/v3/users/9ec4ab30360347be842245b1100a4755` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:41.186025 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4af358-a5e3-420d-a4da-a21bf94eff79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec4ab30360347be842245b1100a4755)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:41.188627 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4af358-a5e3-420d-a4da-a21bf94eff79 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:41.213975 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:41.249751 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ce4af358-a5e3-420d-a4da-a21bf94eff79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec4ab30360347be842245b1100a4755'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:41.250425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ce4af358-a5e3-420d-a4da-a21bf94eff79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec4ab30360347be842245b1100a4755'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:41.251041 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ce4af358-a5e3-420d-a4da-a21bf94eff79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec4ab30360347be842245b1100a4755'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:41.259593 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ce4af358-a5e3-420d-a4da-a21bf94eff79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec4ab30360347be842245b1100a4755'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:41.265176 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4154d59-ac30-45a0-9576-20a807a5f4b2 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:41.266711 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f4154d59-ac30-45a0-9576-20a807a5f4b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:41.293098 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ce4af358-a5e3-420d-a4da-a21bf94eff79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec4ab30360347be842245b1100a4755'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:41.298467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4154d59-ac30-45a0-9576-20a807a5f4b2 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:41.304475 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab40aa4-75dd-4778-9790-b0a9f4c891d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:41.316603 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab40aa4-75dd-4778-9790-b0a9f4c891d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:41.317893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab40aa4-75dd-4778-9790-b0a9f4c891d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:41.329085 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab40aa4-75dd-4778-9790-b0a9f4c891d3 admin admin] PATH_INFO: `/v3/projects/11942ff9e7aa4b65a9d0a5c44c5c3494` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:41.331129 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 983/2000] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:41 2022] DELETE /identity/v3/users/9ec4ab30360347be842245b1100a4755 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:41.332124 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab40aa4-75dd-4778-9790-b0a9f4c891d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11942ff9e7aa4b65a9d0a5c44c5c3494)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:41.335780 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab40aa4-75dd-4778-9790-b0a9f4c891d3 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:41.342239 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda9194-fd62-4539-9bbe-7cb7489432db None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:41.343316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda9194-fd62-4539-9bbe-7cb7489432db None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:41.343609 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afda9194-fd62-4539-9bbe-7cb7489432db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:41.369858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:41.446429 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-afda9194-fd62-4539-9bbe-7cb7489432db None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:41.448147 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-afda9194-fd62-4539-9bbe-7cb7489432db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:41.465658 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1ab40aa4-75dd-4778-9790-b0a9f4c891d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11942ff9e7aa4b65a9d0a5c44c5c3494', 'request_id': 'req-1ab40aa4-75dd-4778-9790-b0a9f4c891d3'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:41.477959 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1ab40aa4-75dd-4778-9790-b0a9f4c891d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11942ff9e7aa4b65a9d0a5c44c5c3494', 'request_id': 'req-1ab40aa4-75dd-4778-9790-b0a9f4c891d3'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:41.496025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1ab40aa4-75dd-4778-9790-b0a9f4c891d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11942ff9e7aa4b65a9d0a5c44c5c3494', 'request_id': 'req-1ab40aa4-75dd-4778-9790-b0a9f4c891d3'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:41.521275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1ab40aa4-75dd-4778-9790-b0a9f4c891d3 admin admin] The token cache is being invalidate because project 11942ff9e7aa4b65a9d0a5c44c5c3494 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:41.521667 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1ab40aa4-75dd-4778-9790-b0a9f4c891d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:41.523669 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1ab40aa4-75dd-4778-9790-b0a9f4c891d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:41.530412 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1018/2001] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:41 2022] DELETE /identity/v3/projects/11942ff9e7aa4b65a9d0a5c44c5c3494 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:41.537483 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63188d6-3e6c-471b-a9e4-aecacdf5df07 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:41.540119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63188d6-3e6c-471b-a9e4-aecacdf5df07 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:41.541863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63188d6-3e6c-471b-a9e4-aecacdf5df07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:41.586340 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 984/2002] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:41.591455 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c63188d6-3e6c-471b-a9e4-aecacdf5df07 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:41.592761 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c63188d6-3e6c-471b-a9e4-aecacdf5df07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:41.598803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda9194-fd62-4539-9bbe-7cb7489432db None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:41.600877 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-afda9194-fd62-4539-9bbe-7cb7489432db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:41.610553 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1019/2003] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:41.613320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da33256-8685-442a-acbc-30d3eaa9a8e6 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:41.613712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da33256-8685-442a-acbc-30d3eaa9a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:41.614001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da33256-8685-442a-acbc-30d3eaa9a8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:41.645286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3da33256-8685-442a-acbc-30d3eaa9a8e6 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:41.646638 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3da33256-8685-442a-acbc-30d3eaa9a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:41.654925 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1020/2004] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:41.660358 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da33256-8685-442a-acbc-30d3eaa9a8e6 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:41.671616 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da33256-8685-442a-acbc-30d3eaa9a8e6 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:41.677467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac55dc-4ded-4354-b0d7-1a82d3b3a1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:41.678657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac55dc-4ded-4354-b0d7-1a82d3b3a1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:41.679068 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac55dc-4ded-4354-b0d7-1a82d3b3a1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:41.679450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac55dc-4ded-4354-b0d7-1a82d3b3a1c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:41.680299 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac55dc-4ded-4354-b0d7-1a82d3b3a1c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:41.680846 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac55dc-4ded-4354-b0d7-1a82d3b3a1c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:41.682751 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac55dc-4ded-4354-b0d7-1a82d3b3a1c0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:41.682894 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afda9194-fd62-4539-9bbe-7cb7489432db None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:41.687094 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7ae01-9952-48e5-a343-019b10cfb318 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:41.688260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7ae01-9952-48e5-a343-019b10cfb318 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:41.688260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7ae01-9952-48e5-a343-019b10cfb318 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:41.688431 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd7ae01-9952-48e5-a343-019b10cfb318 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:41.699078 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1021/2005] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:12:41.702152 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7ae01-9952-48e5-a343-019b10cfb318 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:41.702669 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac55dc-4ded-4354-b0d7-1a82d3b3a1c0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:41.703616 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd7ae01-9952-48e5-a343-019b10cfb318 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:41.712879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac55dc-4ded-4354-b0d7-1a82d3b3a1c0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:41.718457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9323b-f6f5-47a5-a641-3f7fb3741940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:41.719401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9323b-f6f5-47a5-a641-3f7fb3741940 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:41.719644 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 985/2006] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:41.719803 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9323b-f6f5-47a5-a641-3f7fb3741940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:41.720380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a9323b-f6f5-47a5-a641-3f7fb3741940 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:41.720940 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9323b-f6f5-47a5-a641-3f7fb3741940 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:41.722916 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a9323b-f6f5-47a5-a641-3f7fb3741940 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:41.799724 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1022/2007] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:41 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:41.808271 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7ae01-9952-48e5-a343-019b10cfb318 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:41.819987 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd7ae01-9952-48e5-a343-019b10cfb318 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:41.899424 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:41.949611 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de447a5-b0b9-4cec-baf3-e6a601e145f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:41.950518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de447a5-b0b9-4cec-baf3-e6a601e145f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:41.950887 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de447a5-b0b9-4cec-baf3-e6a601e145f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:41.951259 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de447a5-b0b9-4cec-baf3-e6a601e145f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:41.953227 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de447a5-b0b9-4cec-baf3-e6a601e145f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:41.971778 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de447a5-b0b9-4cec-baf3-e6a601e145f1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:42.021015 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 986/2008] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:41 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:42.022452 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9323b-f6f5-47a5-a641-3f7fb3741940 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:42.036602 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a9323b-f6f5-47a5-a641-3f7fb3741940 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:42.044610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2eff6-dcf6-4daa-b143-3c03acd85cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:42.045622 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2eff6-dcf6-4daa-b143-3c03acd85cbd admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:42.046050 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2eff6-dcf6-4daa-b143-3c03acd85cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:42.046703 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2eff6-dcf6-4daa-b143-3c03acd85cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:42.051008 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2eff6-dcf6-4daa-b143-3c03acd85cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:42.055980 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2eff6-dcf6-4daa-b143-3c03acd85cbd admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:42.068289 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1023/2009] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:42.072662 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de447a5-b0b9-4cec-baf3-e6a601e145f1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:42.087702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de447a5-b0b9-4cec-baf3-e6a601e145f1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:42.094017 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622d70a-b09b-4ad4-8bb5-5b40a17700ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:42.095019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622d70a-b09b-4ad4-8bb5-5b40a17700ac admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:42.095495 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622d70a-b09b-4ad4-8bb5-5b40a17700ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:42.095925 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622d70a-b09b-4ad4-8bb5-5b40a17700ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:42.097083 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622d70a-b09b-4ad4-8bb5-5b40a17700ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:42.099176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622d70a-b09b-4ad4-8bb5-5b40a17700ac admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:42.116478 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2eff6-dcf6-4daa-b143-3c03acd85cbd admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:42.117169 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 987/2010] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:42.130471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2eff6-dcf6-4daa-b143-3c03acd85cbd admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:42.135578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154b668-0c97-49b3-8a6f-ad87033e4d97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:42.136505 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154b668-0c97-49b3-8a6f-ad87033e4d97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:42.136788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154b668-0c97-49b3-8a6f-ad87033e4d97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:42.137062 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2154b668-0c97-49b3-8a6f-ad87033e4d97 admin admin] PATH_INFO: `/v3/projects/b8d043fc94e647b5864b2d44ae419fa5/users/b9e9ac94e391429887296c4da62f30b5/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:42.164046 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154b668-0c97-49b3-8a6f-ad87033e4d97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8d043fc94e647b5864b2d44ae419fa5, user_id=b9e9ac94e391429887296c4da62f30b5, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:42.166736 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2154b668-0c97-49b3-8a6f-ad87033e4d97 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:42.187744 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1024/2011] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:42 2022] PUT /identity/v3/projects/b8d043fc94e647b5864b2d44ae419fa5/users/b9e9ac94e391429887296c4da62f30b5/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:42.193915 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866d04a-972b-46e5-80ff-c98fc25967d3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:42.195873 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866d04a-972b-46e5-80ff-c98fc25967d3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:42.195873 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866d04a-972b-46e5-80ff-c98fc25967d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:42.218593 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e866d04a-972b-46e5-80ff-c98fc25967d3 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:42.219189 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e866d04a-972b-46e5-80ff-c98fc25967d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:42.316057 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 988/2012] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:42.348275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154b668-0c97-49b3-8a6f-ad87033e4d97 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:42.496268 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2154b668-0c97-49b3-8a6f-ad87033e4d97 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:42.509601 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb53a9-1afe-4978-8ee3-c6704938c18a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:42.510387 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb53a9-1afe-4978-8ee3-c6704938c18a service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:42.510677 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb53a9-1afe-4978-8ee3-c6704938c18a service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:42.510955 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeb53a9-1afe-4978-8ee3-c6704938c18a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:42.523253 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb53a9-1afe-4978-8ee3-c6704938c18a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:42.525016 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeb53a9-1afe-4978-8ee3-c6704938c18a service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:42.537445 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1025/2013] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:42.564277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866d04a-972b-46e5-80ff-c98fc25967d3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:42.567614 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e866d04a-972b-46e5-80ff-c98fc25967d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:42.653384 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866d04a-972b-46e5-80ff-c98fc25967d3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:42.657882 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c621a48-05ef-4ff4-9edd-032ed2a3bad9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:42.658346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c621a48-05ef-4ff4-9edd-032ed2a3bad9 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:42.658702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c621a48-05ef-4ff4-9edd-032ed2a3bad9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:42.659066 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c621a48-05ef-4ff4-9edd-032ed2a3bad9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:42.661028 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1c621a48-05ef-4ff4-9edd-032ed2a3bad9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:42.774333 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c621a48-05ef-4ff4-9edd-032ed2a3bad9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:42.775879 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c621a48-05ef-4ff4-9edd-032ed2a3bad9 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:42.786085 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 989/2014] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:42 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:43.407030 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb53a9-1afe-4978-8ee3-c6704938c18a service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:43.408310 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8aeb53a9-1afe-4978-8ee3-c6704938c18a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:43.430732 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeb53a9-1afe-4978-8ee3-c6704938c18a service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:43.440469 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9488e84-d955-49bd-887c-4786d8ec3517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:43.442013 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9488e84-d955-49bd-887c-4786d8ec3517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:43.442633 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9488e84-d955-49bd-887c-4786d8ec3517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:43.443816 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9488e84-d955-49bd-887c-4786d8ec3517 admin admin] PATH_INFO: `/v3/projects/adb349eaf1db47058b2319144a638dab` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:43.446017 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9488e84-d955-49bd-887c-4786d8ec3517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adb349eaf1db47058b2319144a638dab)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:43.449622 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9488e84-d955-49bd-887c-4786d8ec3517 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:43.479806 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:43.514503 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e9488e84-d955-49bd-887c-4786d8ec3517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adb349eaf1db47058b2319144a638dab', 'request_id': 'req-e9488e84-d955-49bd-887c-4786d8ec3517'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:43.525981 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e9488e84-d955-49bd-887c-4786d8ec3517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adb349eaf1db47058b2319144a638dab', 'request_id': 'req-e9488e84-d955-49bd-887c-4786d8ec3517'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:43.535232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e9488e84-d955-49bd-887c-4786d8ec3517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adb349eaf1db47058b2319144a638dab', 'request_id': 'req-e9488e84-d955-49bd-887c-4786d8ec3517'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:43.564979 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e9488e84-d955-49bd-887c-4786d8ec3517 admin admin] The token cache is being invalidate because project adb349eaf1db47058b2319144a638dab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:43.565314 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e9488e84-d955-49bd-887c-4786d8ec3517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:43.566072 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e9488e84-d955-49bd-887c-4786d8ec3517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:43.571715 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1026/2015] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:43 2022] DELETE /identity/v3/projects/adb349eaf1db47058b2319144a638dab => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:43.572842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c621a48-05ef-4ff4-9edd-032ed2a3bad9 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:43.586321 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c621a48-05ef-4ff4-9edd-032ed2a3bad9 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:43.596166 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:43.655502 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d73a8-1aea-4ad1-adeb-90d8895cbe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:43.656411 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d73a8-1aea-4ad1-adeb-90d8895cbe72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:43.656967 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d73a8-1aea-4ad1-adeb-90d8895cbe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:43.657334 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d73a8-1aea-4ad1-adeb-90d8895cbe72 admin admin] PATH_INFO: `/v3/users/ebfec4e975b5410ba5bc7124f8cd34cf` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:43.658674 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d73a8-1aea-4ad1-adeb-90d8895cbe72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebfec4e975b5410ba5bc7124f8cd34cf)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:43.660558 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d73a8-1aea-4ad1-adeb-90d8895cbe72 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:43.710966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-015d73a8-1aea-4ad1-adeb-90d8895cbe72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebfec4e975b5410ba5bc7124f8cd34cf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:43.711662 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-015d73a8-1aea-4ad1-adeb-90d8895cbe72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebfec4e975b5410ba5bc7124f8cd34cf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:43.712260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-015d73a8-1aea-4ad1-adeb-90d8895cbe72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebfec4e975b5410ba5bc7124f8cd34cf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:43.719225 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-015d73a8-1aea-4ad1-adeb-90d8895cbe72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebfec4e975b5410ba5bc7124f8cd34cf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:43.740202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-015d73a8-1aea-4ad1-adeb-90d8895cbe72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebfec4e975b5410ba5bc7124f8cd34cf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:43.769182 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 990/2016] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:43 2022] DELETE /identity/v3/users/ebfec4e975b5410ba5bc7124f8cd34cf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:43.793699 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719a3af-3646-43ac-a055-c0e6ad1d78db None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:43.793699 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719a3af-3646-43ac-a055-c0e6ad1d78db None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:43.793999 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5719a3af-3646-43ac-a055-c0e6ad1d78db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:43.835564 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5719a3af-3646-43ac-a055-c0e6ad1d78db None None] MFA Rules not processed for user `b9e9ac94e391429887296c4da62f30b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:43.837146 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5719a3af-3646-43ac-a055-c0e6ad1d78db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:43.911350 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1027/2017] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:43.916330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d73a8-1aea-4ad1-adeb-90d8895cbe72 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:43.918853 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-015d73a8-1aea-4ad1-adeb-90d8895cbe72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:44.026357 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d73a8-1aea-4ad1-adeb-90d8895cbe72 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:44.032217 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80871c-ded4-4808-83ec-7e73104a76ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:44.034092 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80871c-ded4-4808-83ec-7e73104a76ee admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:44.034092 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80871c-ded4-4808-83ec-7e73104a76ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:44.034092 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80871c-ded4-4808-83ec-7e73104a76ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:44.034385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80871c-ded4-4808-83ec-7e73104a76ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:44.036354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80871c-ded4-4808-83ec-7e73104a76ee admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:44.085437 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 991/2018] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:43 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:44.088845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719a3af-3646-43ac-a055-c0e6ad1d78db None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:44.104345 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5719a3af-3646-43ac-a055-c0e6ad1d78db None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:44.144011 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80871c-ded4-4808-83ec-7e73104a76ee admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:44.146538 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1d80871c-ded4-4808-83ec-7e73104a76ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:44.173515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:44.231949 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86b9f4-2709-4da9-91e3-48e9d954b26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:44.232558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86b9f4-2709-4da9-91e3-48e9d954b26d admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:44.232844 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86b9f4-2709-4da9-91e3-48e9d954b26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:44.233121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86b9f4-2709-4da9-91e3-48e9d954b26d admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:44.233838 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86b9f4-2709-4da9-91e3-48e9d954b26d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:44.236705 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86b9f4-2709-4da9-91e3-48e9d954b26d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:44.253237 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80871c-ded4-4808-83ec-7e73104a76ee admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:44.271030 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1028/2019] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:44 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:44.271030 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86b9f4-2709-4da9-91e3-48e9d954b26d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:44.272350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5dea8-f409-4dc5-b293-621acad284df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:44.273577 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5dea8-f409-4dc5-b293-621acad284df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:44.273858 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5dea8-f409-4dc5-b293-621acad284df admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:44.274129 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5dea8-f409-4dc5-b293-621acad284df admin admin] PATH_INFO: `/v3/projects/ecdaa0fec4bd4ecc9f2f63d7cf0f3c9d` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:44.275689 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5dea8-f409-4dc5-b293-621acad284df admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecdaa0fec4bd4ecc9f2f63d7cf0f3c9d)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:44.277620 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5dea8-f409-4dc5-b293-621acad284df admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:44.288439 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86b9f4-2709-4da9-91e3-48e9d954b26d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:44.293140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36bcdb-b0a5-4665-be21-d482d05bd2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:44.293808 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36bcdb-b0a5-4665-be21-d482d05bd2ad admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:44.294088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36bcdb-b0a5-4665-be21-d482d05bd2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:44.294374 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36bcdb-b0a5-4665-be21-d482d05bd2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:44.295101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36bcdb-b0a5-4665-be21-d482d05bd2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:44.296742 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b36bcdb-b0a5-4665-be21-d482d05bd2ad admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:44.311860 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1029/2020] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:12:44.313236 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36bcdb-b0a5-4665-be21-d482d05bd2ad admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:44.324150 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36bcdb-b0a5-4665-be21-d482d05bd2ad admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:44.337165 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-50b5dea8-f409-4dc5-b293-621acad284df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecdaa0fec4bd4ecc9f2f63d7cf0f3c9d', 'request_id': 'req-50b5dea8-f409-4dc5-b293-621acad284df'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:44.349438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:44.367742 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-50b5dea8-f409-4dc5-b293-621acad284df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecdaa0fec4bd4ecc9f2f63d7cf0f3c9d', 'request_id': 'req-50b5dea8-f409-4dc5-b293-621acad284df'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:44.377632 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-50b5dea8-f409-4dc5-b293-621acad284df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecdaa0fec4bd4ecc9f2f63d7cf0f3c9d', 'request_id': 'req-50b5dea8-f409-4dc5-b293-621acad284df'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:44.402961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-50b5dea8-f409-4dc5-b293-621acad284df admin admin] The token cache is being invalidate because project ecdaa0fec4bd4ecc9f2f63d7cf0f3c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:44.403517 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-50b5dea8-f409-4dc5-b293-621acad284df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:44.404358 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-50b5dea8-f409-4dc5-b293-621acad284df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:44.409729 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 992/2021] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:44 2022] DELETE /identity/v3/projects/ecdaa0fec4bd4ecc9f2f63d7cf0f3c9d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:44.410676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5dea8-f409-4dc5-b293-621acad284df admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:44.412293 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffcdea-9d59-4ab2-85df-9bc5a9c07079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:44.412870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-50b5dea8-f409-4dc5-b293-621acad284df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:44.413286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffcdea-9d59-4ab2-85df-9bc5a9c07079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:44.413633 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffcdea-9d59-4ab2-85df-9bc5a9c07079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:44.413909 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffcdea-9d59-4ab2-85df-9bc5a9c07079 admin admin] PATH_INFO: `/v3/projects/b04ce510ad96411d85d3e9227e4c3e74/users/1807540cdedf4c828a492c964eee7db5/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:44.429358 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5dea8-f409-4dc5-b293-621acad284df admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:44.431461 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffcdea-9d59-4ab2-85df-9bc5a9c07079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b04ce510ad96411d85d3e9227e4c3e74, user_id=1807540cdedf4c828a492c964eee7db5, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:44.434538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffcdea-9d59-4ab2-85df-9bc5a9c07079 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:44.435198 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba6889-7c0b-427f-bd31-7ef22b2bd64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:44.436326 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba6889-7c0b-427f-bd31-7ef22b2bd64f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:44.437006 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba6889-7c0b-427f-bd31-7ef22b2bd64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:44.437479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba6889-7c0b-427f-bd31-7ef22b2bd64f admin admin] PATH_INFO: `/v3/users/1cc7a4ce510d4aa4a24cb144dfb1f722` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:44.439173 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba6889-7c0b-427f-bd31-7ef22b2bd64f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cc7a4ce510d4aa4a24cb144dfb1f722)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:44.441398 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba6889-7c0b-427f-bd31-7ef22b2bd64f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:44.451608 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1030/2022] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:44 2022] PUT /identity/v3/projects/b04ce510ad96411d85d3e9227e4c3e74/users/1807540cdedf4c828a492c964eee7db5/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:44.455103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffcdea-9d59-4ab2-85df-9bc5a9c07079 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:44.458305 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d7ffcdea-9d59-4ab2-85df-9bc5a9c07079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:44.554557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b7ba6889-7c0b-427f-bd31-7ef22b2bd64f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cc7a4ce510d4aa4a24cb144dfb1f722'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:44.557193 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b7ba6889-7c0b-427f-bd31-7ef22b2bd64f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cc7a4ce510d4aa4a24cb144dfb1f722'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:44.559070 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b7ba6889-7c0b-427f-bd31-7ef22b2bd64f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cc7a4ce510d4aa4a24cb144dfb1f722'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:44.562684 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffcdea-9d59-4ab2-85df-9bc5a9c07079 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:44.569081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b7ba6889-7c0b-427f-bd31-7ef22b2bd64f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cc7a4ce510d4aa4a24cb144dfb1f722'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:44.570359 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729dff1-7d8d-464b-9a92-d5b8277ff3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:44.571328 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729dff1-7d8d-464b-9a92-d5b8277ff3cc admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:44.571760 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729dff1-7d8d-464b-9a92-d5b8277ff3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:44.572179 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729dff1-7d8d-464b-9a92-d5b8277ff3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:44.573324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729dff1-7d8d-464b-9a92-d5b8277ff3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:44.575902 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729dff1-7d8d-464b-9a92-d5b8277ff3cc admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:44.587869 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b7ba6889-7c0b-427f-bd31-7ef22b2bd64f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cc7a4ce510d4aa4a24cb144dfb1f722'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:44.589662 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1031/2023] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:44 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:12:44.593962 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729dff1-7d8d-464b-9a92-d5b8277ff3cc admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:44.595884 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e729dff1-7d8d-464b-9a92-d5b8277ff3cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:44.610035 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 993/2024] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:44 2022] DELETE /identity/v3/users/1cc7a4ce510d4aa4a24cb144dfb1f722 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:44.612594 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729dff1-7d8d-464b-9a92-d5b8277ff3cc admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:44.695160 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce01ceb1-37a3-408d-b193-98d86334d636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:44.696612 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01ceb1-37a3-408d-b193-98d86334d636 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:44.696921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01ceb1-37a3-408d-b193-98d86334d636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:44.697266 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce01ceb1-37a3-408d-b193-98d86334d636 admin admin] PATH_INFO: `/v3/projects/b04ce510ad96411d85d3e9227e4c3e74/users/1807540cdedf4c828a492c964eee7db5/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:44.699593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01ceb1-37a3-408d-b193-98d86334d636 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b04ce510ad96411d85d3e9227e4c3e74, user_id=1807540cdedf4c828a492c964eee7db5, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:44.702544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce01ceb1-37a3-408d-b193-98d86334d636 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:44.716873 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1032/2025] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:44 2022] PUT /identity/v3/projects/b04ce510ad96411d85d3e9227e4c3e74/users/1807540cdedf4c828a492c964eee7db5/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:44.932725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba6889-7c0b-427f-bd31-7ef22b2bd64f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:44.934312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b7ba6889-7c0b-427f-bd31-7ef22b2bd64f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:44.955642 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba6889-7c0b-427f-bd31-7ef22b2bd64f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:44.976041 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:45.024899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950fd5c-cf86-45e5-a40e-3fee38abd23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:45.025817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950fd5c-cf86-45e5-a40e-3fee38abd23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:45.026124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950fd5c-cf86-45e5-a40e-3fee38abd23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:45.026906 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950fd5c-cf86-45e5-a40e-3fee38abd23c admin admin] PATH_INFO: `/v3/projects/c9d2ce2228ee4999894fcd12b7e06bcd` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:45.029013 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950fd5c-cf86-45e5-a40e-3fee38abd23c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9d2ce2228ee4999894fcd12b7e06bcd)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:45.033285 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950fd5c-cf86-45e5-a40e-3fee38abd23c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:45.107486 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2950fd5c-cf86-45e5-a40e-3fee38abd23c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9d2ce2228ee4999894fcd12b7e06bcd', 'request_id': 'req-2950fd5c-cf86-45e5-a40e-3fee38abd23c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:45.116520 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2950fd5c-cf86-45e5-a40e-3fee38abd23c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9d2ce2228ee4999894fcd12b7e06bcd', 'request_id': 'req-2950fd5c-cf86-45e5-a40e-3fee38abd23c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:45.123337 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2950fd5c-cf86-45e5-a40e-3fee38abd23c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9d2ce2228ee4999894fcd12b7e06bcd', 'request_id': 'req-2950fd5c-cf86-45e5-a40e-3fee38abd23c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:45.136332 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2950fd5c-cf86-45e5-a40e-3fee38abd23c admin admin] The token cache is being invalidate because project c9d2ce2228ee4999894fcd12b7e06bcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:45.136518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2950fd5c-cf86-45e5-a40e-3fee38abd23c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:45.137497 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2950fd5c-cf86-45e5-a40e-3fee38abd23c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:45.139431 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 994/2026] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:44 2022] DELETE /identity/v3/projects/c9d2ce2228ee4999894fcd12b7e06bcd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:45.145841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39617c8a-8117-4ab1-83f3-c0e353f05787 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:45.146136 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39617c8a-8117-4ab1-83f3-c0e353f05787 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:45.147010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39617c8a-8117-4ab1-83f3-c0e353f05787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:45.165717 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-39617c8a-8117-4ab1-83f3-c0e353f05787 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:45.167039 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-39617c8a-8117-4ab1-83f3-c0e353f05787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:45.191055 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:45.228222 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1033/2027] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:45.236191 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fc976-5449-493d-b8dd-4646acbb5a5a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:45.236590 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fc976-5449-493d-b8dd-4646acbb5a5a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:45.236950 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fc976-5449-493d-b8dd-4646acbb5a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:45.255346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a41fc976-5449-493d-b8dd-4646acbb5a5a None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:45.256628 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a41fc976-5449-493d-b8dd-4646acbb5a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:45.265216 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 995/2028] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:45.270391 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39617c8a-8117-4ab1-83f3-c0e353f05787 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:45.281651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39617c8a-8117-4ab1-83f3-c0e353f05787 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:45.288608 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d50f2-4bf3-4f4b-b5e4-08416677ab1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:45.289356 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d50f2-4bf3-4f4b-b5e4-08416677ab1b admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:45.290017 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d50f2-4bf3-4f4b-b5e4-08416677ab1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:45.290357 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d50f2-4bf3-4f4b-b5e4-08416677ab1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:45.291164 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d50f2-4bf3-4f4b-b5e4-08416677ab1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:45.291675 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d50f2-4bf3-4f4b-b5e4-08416677ab1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:45.295420 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d50f2-4bf3-4f4b-b5e4-08416677ab1b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:45.315556 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1034/2029] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:45.316567 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fc976-5449-493d-b8dd-4646acbb5a5a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:45.328063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fc976-5449-493d-b8dd-4646acbb5a5a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:45.333974 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff54021-74c9-497b-967b-536ca33b0601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:45.334828 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff54021-74c9-497b-967b-536ca33b0601 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:45.335177 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff54021-74c9-497b-967b-536ca33b0601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:45.335501 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff54021-74c9-497b-967b-536ca33b0601 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:45.336251 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff54021-74c9-497b-967b-536ca33b0601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:45.341043 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff54021-74c9-497b-967b-536ca33b0601 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:45.421262 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 996/2030] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:45 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:12:45.425759 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d50f2-4bf3-4f4b-b5e4-08416677ab1b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:45.437775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d50f2-4bf3-4f4b-b5e4-08416677ab1b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:45.511675 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a135c-3cef-4c6a-808b-ab2e7c607155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:45.512630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a135c-3cef-4c6a-808b-ab2e7c607155 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:45.513368 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a135c-3cef-4c6a-808b-ab2e7c607155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:45.513368 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055a135c-3cef-4c6a-808b-ab2e7c607155 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:45.514013 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a135c-3cef-4c6a-808b-ab2e7c607155 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:45.515982 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055a135c-3cef-4c6a-808b-ab2e7c607155 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:45.550747 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1035/2031] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:45 2022] POST /identity/v3/users => generated 290 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:45.553725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff54021-74c9-497b-967b-536ca33b0601 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:45.568650 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff54021-74c9-497b-967b-536ca33b0601 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:45.573913 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4528b-0a63-4c5b-9310-e552bf8ba5cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:45.574610 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4528b-0a63-4c5b-9310-e552bf8ba5cf admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:45.574899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4528b-0a63-4c5b-9310-e552bf8ba5cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:45.575914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4528b-0a63-4c5b-9310-e552bf8ba5cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:45.576650 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4528b-0a63-4c5b-9310-e552bf8ba5cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:45.578287 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4528b-0a63-4c5b-9310-e552bf8ba5cf admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:45.590532 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 997/2032] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:45.594589 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a135c-3cef-4c6a-808b-ab2e7c607155 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:45.604952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055a135c-3cef-4c6a-808b-ab2e7c607155 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:45.610006 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaffbee4-b9bc-487f-b66c-aea3a3fc0839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:45.610902 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffbee4-b9bc-487f-b66c-aea3a3fc0839 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:45.611484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffbee4-b9bc-487f-b66c-aea3a3fc0839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:45.611987 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaffbee4-b9bc-487f-b66c-aea3a3fc0839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:45.612939 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffbee4-b9bc-487f-b66c-aea3a3fc0839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:45.615243 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaffbee4-b9bc-487f-b66c-aea3a3fc0839 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:45.628890 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1036/2033] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:45.632626 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4528b-0a63-4c5b-9310-e552bf8ba5cf admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:45.643971 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4528b-0a63-4c5b-9310-e552bf8ba5cf admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:45.650700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c844e2-79b4-4745-af86-00ebd3645827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:45.651826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c844e2-79b4-4745-af86-00ebd3645827 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:45.652351 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c844e2-79b4-4745-af86-00ebd3645827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:45.652852 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c844e2-79b4-4745-af86-00ebd3645827 admin admin] PATH_INFO: `/v3/projects/b0abefee154743b19088213dcc7ebe78/users/50587054cdd847e6a9d4b6901c9580e2/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:45.672748 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c844e2-79b4-4745-af86-00ebd3645827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0abefee154743b19088213dcc7ebe78, user_id=50587054cdd847e6a9d4b6901c9580e2, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:45.675590 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c844e2-79b4-4745-af86-00ebd3645827 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:45.706158 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 998/2034] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:45 2022] PUT /identity/v3/projects/b0abefee154743b19088213dcc7ebe78/users/50587054cdd847e6a9d4b6901c9580e2/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:45.707454 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e85a05-7a90-4659-88a9-a0b6330f50df None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:45.707747 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e85a05-7a90-4659-88a9-a0b6330f50df None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:45.708113 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e85a05-7a90-4659-88a9-a0b6330f50df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:45.739964 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-94e85a05-7a90-4659-88a9-a0b6330f50df None None] MFA Rules not processed for user `50587054cdd847e6a9d4b6901c9580e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:45.741204 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-94e85a05-7a90-4659-88a9-a0b6330f50df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:45.753742 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d705e0-532a-4456-83fe-d36580a9ae51 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:45.754034 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d705e0-532a-4456-83fe-d36580a9ae51 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:45.754313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d705e0-532a-4456-83fe-d36580a9ae51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:45.789065 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f4d705e0-532a-4456-83fe-d36580a9ae51 None None] MFA Rules not processed for user `1807540cdedf4c828a492c964eee7db5`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:45.790304 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f4d705e0-532a-4456-83fe-d36580a9ae51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:45.829111 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:45.891083 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1037/2035] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:45.894674 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e85a05-7a90-4659-88a9-a0b6330f50df None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:45.920345 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 999/2036] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:45.923499 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167815c3-d3a2-4d8d-a07d-3bb6264a045c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:45.923723 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167815c3-d3a2-4d8d-a07d-3bb6264a045c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:45.924584 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167815c3-d3a2-4d8d-a07d-3bb6264a045c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:45.944437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:45.950605 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-167815c3-d3a2-4d8d-a07d-3bb6264a045c None None] MFA Rules not processed for user `b9e9ac94e391429887296c4da62f30b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:45.953481 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-167815c3-d3a2-4d8d-a07d-3bb6264a045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:46.017248 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e85a05-7a90-4659-88a9-a0b6330f50df None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:46.026281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66445039-d448-4d1a-beb4-65bcd83c4026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:46.026975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66445039-d448-4d1a-beb4-65bcd83c4026 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:46.027260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66445039-d448-4d1a-beb4-65bcd83c4026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:46.027574 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66445039-d448-4d1a-beb4-65bcd83c4026 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:46.028296 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66445039-d448-4d1a-beb4-65bcd83c4026 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:46.030701 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66445039-d448-4d1a-beb4-65bcd83c4026 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:46.085918 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1038/2037] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:45 2022] POST /identity/v3/projects => generated 377 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:46.087219 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1000/2038] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:46.092534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66445039-d448-4d1a-beb4-65bcd83c4026 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:46.150698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167815c3-d3a2-4d8d-a07d-3bb6264a045c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:46.155972 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-167815c3-d3a2-4d8d-a07d-3bb6264a045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:46.186349 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66445039-d448-4d1a-beb4-65bcd83c4026 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:46.191899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfc22d-8ada-4de7-af46-bb3914acb20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:46.192590 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfc22d-8ada-4de7-af46-bb3914acb20c admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:46.192878 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfc22d-8ada-4de7-af46-bb3914acb20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:46.193157 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bfc22d-8ada-4de7-af46-bb3914acb20c admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:46.193912 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfc22d-8ada-4de7-af46-bb3914acb20c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:46.195981 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bfc22d-8ada-4de7-af46-bb3914acb20c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:46.233219 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1039/2039] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:46 2022] POST /identity/v3/users => generated 295 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:46.237036 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfc22d-8ada-4de7-af46-bb3914acb20c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:46.261880 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bfc22d-8ada-4de7-af46-bb3914acb20c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:46.271707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15721-e79c-41ca-82b3-8cd6e34dfe94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:46.272410 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15721-e79c-41ca-82b3-8cd6e34dfe94 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:46.272808 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15721-e79c-41ca-82b3-8cd6e34dfe94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:46.273153 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee15721-e79c-41ca-82b3-8cd6e34dfe94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:46.274104 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee15721-e79c-41ca-82b3-8cd6e34dfe94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:46.277230 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee15721-e79c-41ca-82b3-8cd6e34dfe94 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:46.297658 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1040/2040] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:46.298603 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15721-e79c-41ca-82b3-8cd6e34dfe94 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:46.309700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167815c3-d3a2-4d8d-a07d-3bb6264a045c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:46.316346 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee15721-e79c-41ca-82b3-8cd6e34dfe94 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:46.335540 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15e0d1-7dcf-473a-a845-302958ca2af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:46.336544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15e0d1-7dcf-473a-a845-302958ca2af7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:46.336837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15e0d1-7dcf-473a-a845-302958ca2af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:46.337286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15e0d1-7dcf-473a-a845-302958ca2af7 admin admin] PATH_INFO: `/v3/projects/841afea0101b4b50a052a66c3b38b3d8/users/fb195b93d31b48fc8d31652516fea46c/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:46.366376 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15e0d1-7dcf-473a-a845-302958ca2af7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=841afea0101b4b50a052a66c3b38b3d8, user_id=fb195b93d31b48fc8d31652516fea46c, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:46.369196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15e0d1-7dcf-473a-a845-302958ca2af7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:46.386033 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1041/2041] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:46 2022] PUT /identity/v3/projects/841afea0101b4b50a052a66c3b38b3d8/users/fb195b93d31b48fc8d31652516fea46c/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:46.389924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15e0d1-7dcf-473a-a845-302958ca2af7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:46.410829 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ddf615-d8fd-4c82-8357-497e35a55353 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:46.411626 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddf615-d8fd-4c82-8357-497e35a55353 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:46.411973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddf615-d8fd-4c82-8357-497e35a55353 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:46.412314 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ddf615-d8fd-4c82-8357-497e35a55353 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:46.414301 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f6ddf615-d8fd-4c82-8357-497e35a55353 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:46.423693 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:46.450657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15e0d1-7dcf-473a-a845-302958ca2af7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:46.455746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef697e9-c0e7-4ec5-b839-1a24d1d5905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:46.456446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef697e9-c0e7-4ec5-b839-1a24d1d5905d admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:46.456736 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef697e9-c0e7-4ec5-b839-1a24d1d5905d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:46.457014 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef697e9-c0e7-4ec5-b839-1a24d1d5905d admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:46.457753 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef697e9-c0e7-4ec5-b839-1a24d1d5905d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:46.459402 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef697e9-c0e7-4ec5-b839-1a24d1d5905d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:46.464701 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:46.473111 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1042/2042] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:12:46.474837 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ddf615-d8fd-4c82-8357-497e35a55353 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:46.475718 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef697e9-c0e7-4ec5-b839-1a24d1d5905d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:46.476728 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ddf615-d8fd-4c82-8357-497e35a55353 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:46.486699 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1001/2043] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:12:46.489118 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef697e9-c0e7-4ec5-b839-1a24d1d5905d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:46.494174 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28f202-3d8f-45bd-b27f-19ccb57931a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:46.495070 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28f202-3d8f-45bd-b27f-19ccb57931a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:46.495850 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28f202-3d8f-45bd-b27f-19ccb57931a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:46.496133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28f202-3d8f-45bd-b27f-19ccb57931a7 admin admin] PATH_INFO: `/v3/projects/841afea0101b4b50a052a66c3b38b3d8/users/fb195b93d31b48fc8d31652516fea46c/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:46.498272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28f202-3d8f-45bd-b27f-19ccb57931a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=841afea0101b4b50a052a66c3b38b3d8, user_id=fb195b93d31b48fc8d31652516fea46c, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:46.501161 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28f202-3d8f-45bd-b27f-19ccb57931a7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:46.512220 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1043/2044] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:46 2022] PUT /identity/v3/projects/841afea0101b4b50a052a66c3b38b3d8/users/fb195b93d31b48fc8d31652516fea46c/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:46.523517 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd2c05-cf50-484f-8364-eee224523499 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:46.523935 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd2c05-cf50-484f-8364-eee224523499 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:46.524313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd2c05-cf50-484f-8364-eee224523499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:46.567506 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b2cd2c05-cf50-484f-8364-eee224523499 None None] MFA Rules not processed for user `fb195b93d31b48fc8d31652516fea46c`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:46.569310 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b2cd2c05-cf50-484f-8364-eee224523499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:46.645663 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1002/2045] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:46 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:46.656911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28f202-3d8f-45bd-b27f-19ccb57931a7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:46.658824 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ea28f202-3d8f-45bd-b27f-19ccb57931a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:46.718906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28f202-3d8f-45bd-b27f-19ccb57931a7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:46.722712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43380b7-5de0-4da6-ad8f-6af2cd2961ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:46.723422 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43380b7-5de0-4da6-ad8f-6af2cd2961ec service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:46.723708 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43380b7-5de0-4da6-ad8f-6af2cd2961ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:46.724014 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43380b7-5de0-4da6-ad8f-6af2cd2961ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:46.733633 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43380b7-5de0-4da6-ad8f-6af2cd2961ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:46.735082 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43380b7-5de0-4da6-ad8f-6af2cd2961ec service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:46.745137 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1044/2046] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:46 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:47.242241 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd2c05-cf50-484f-8364-eee224523499 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:47.338996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd2c05-cf50-484f-8364-eee224523499 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:47.350289 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08d43b-0577-45b9-a5fa-e75f6d0bb278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:47.351342 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08d43b-0577-45b9-a5fa-e75f6d0bb278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:47.351545 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08d43b-0577-45b9-a5fa-e75f6d0bb278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:47.351814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff08d43b-0577-45b9-a5fa-e75f6d0bb278 admin admin] PATH_INFO: `/v3/users/50587054cdd847e6a9d4b6901c9580e2` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:47.353595 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08d43b-0577-45b9-a5fa-e75f6d0bb278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50587054cdd847e6a9d4b6901c9580e2)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:47.355597 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff08d43b-0577-45b9-a5fa-e75f6d0bb278 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:47.416405 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:47.428768 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ff08d43b-0577-45b9-a5fa-e75f6d0bb278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50587054cdd847e6a9d4b6901c9580e2'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:47.429496 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ff08d43b-0577-45b9-a5fa-e75f6d0bb278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50587054cdd847e6a9d4b6901c9580e2'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:47.430080 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ff08d43b-0577-45b9-a5fa-e75f6d0bb278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50587054cdd847e6a9d4b6901c9580e2'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:47.437393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ff08d43b-0577-45b9-a5fa-e75f6d0bb278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50587054cdd847e6a9d4b6901c9580e2'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:47.449845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ff08d43b-0577-45b9-a5fa-e75f6d0bb278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50587054cdd847e6a9d4b6901c9580e2'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:47.472006 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1003/2047] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:47 2022] DELETE /identity/v3/users/50587054cdd847e6a9d4b6901c9580e2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:47.476816 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171a26a-fd75-486e-ac12-c324ec8f0e68 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:47.477284 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171a26a-fd75-486e-ac12-c324ec8f0e68 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:47.477364 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171a26a-fd75-486e-ac12-c324ec8f0e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:47.500250 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6171a26a-fd75-486e-ac12-c324ec8f0e68 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:47.501605 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6171a26a-fd75-486e-ac12-c324ec8f0e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:47.608011 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1045/2048] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:47.619434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08d43b-0577-45b9-a5fa-e75f6d0bb278 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:47.620752 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ff08d43b-0577-45b9-a5fa-e75f6d0bb278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:47.702993 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff08d43b-0577-45b9-a5fa-e75f6d0bb278 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:47.710999 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093255d-748d-425e-801d-35821cce73fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:47.711820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093255d-748d-425e-801d-35821cce73fa service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:47.712132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093255d-748d-425e-801d-35821cce73fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:47.712510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093255d-748d-425e-801d-35821cce73fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:47.723174 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093255d-748d-425e-801d-35821cce73fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:47.724654 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093255d-748d-425e-801d-35821cce73fa service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:47.746822 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1004/2049] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:48.022346 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171a26a-fd75-486e-ac12-c324ec8f0e68 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:48.024482 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6171a26a-fd75-486e-ac12-c324ec8f0e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:48.037952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171a26a-fd75-486e-ac12-c324ec8f0e68 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:48.043072 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324ec7f0-2456-4500-9efb-267f166add94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:48.044404 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ec7f0-2456-4500-9efb-267f166add94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:48.044404 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ec7f0-2456-4500-9efb-267f166add94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:48.044618 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324ec7f0-2456-4500-9efb-267f166add94 admin admin] PATH_INFO: `/v3/users/5f7c89c8a9324667bdfd40ff31e0fdc8` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:48.045899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ec7f0-2456-4500-9efb-267f166add94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f7c89c8a9324667bdfd40ff31e0fdc8)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:48.046350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093255d-748d-425e-801d-35821cce73fa service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:48.047849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8093255d-748d-425e-801d-35821cce73fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:48.047963 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324ec7f0-2456-4500-9efb-267f166add94 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:48.067909 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093255d-748d-425e-801d-35821cce73fa service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:48.073435 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:48.074629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:48.074629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:48.074912 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4 admin admin] PATH_INFO: `/v3/projects/b0abefee154743b19088213dcc7ebe78` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:48.076330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0abefee154743b19088213dcc7ebe78)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:48.078392 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:48.107817 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-324ec7f0-2456-4500-9efb-267f166add94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f7c89c8a9324667bdfd40ff31e0fdc8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:48.108653 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-324ec7f0-2456-4500-9efb-267f166add94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f7c89c8a9324667bdfd40ff31e0fdc8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:48.117148 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-324ec7f0-2456-4500-9efb-267f166add94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f7c89c8a9324667bdfd40ff31e0fdc8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:48.117994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-324ec7f0-2456-4500-9efb-267f166add94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f7c89c8a9324667bdfd40ff31e0fdc8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:48.125807 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-324ec7f0-2456-4500-9efb-267f166add94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f7c89c8a9324667bdfd40ff31e0fdc8'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:48.130884 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0abefee154743b19088213dcc7ebe78', 'request_id': 'req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:48.141273 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0abefee154743b19088213dcc7ebe78', 'request_id': 'req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:48.145501 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1046/2050] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:48 2022] DELETE /identity/v3/users/5f7c89c8a9324667bdfd40ff31e0fdc8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:48.148692 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0abefee154743b19088213dcc7ebe78', 'request_id': 'req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:48.150142 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7b32b-2533-4610-9116-3beb79d86b85 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:48.151377 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7b32b-2533-4610-9116-3beb79d86b85 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:48.151377 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7b32b-2533-4610-9116-3beb79d86b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:48.168741 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4 admin admin] The token cache is being invalidate because project b0abefee154743b19088213dcc7ebe78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:48.170078 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:48.171787 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:48.172192 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:48.179841 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1005/2051] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:48 2022] DELETE /identity/v3/projects/b0abefee154743b19088213dcc7ebe78 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:48.184218 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:48.186547 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:48.207606 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-23f7b32b-2533-4610-9116-3beb79d86b85 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:48.209610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-23f7b32b-2533-4610-9116-3beb79d86b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:48.241933 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:48.272667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeecf5c8-565f-4db7-ac4c-93fe73af11d4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:48.319084 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1047/2052] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:48.327609 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7b32b-2533-4610-9116-3beb79d86b85 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:48.336963 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-23f7b32b-2533-4610-9116-3beb79d86b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:48.365929 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0f4e4-2710-400a-bc3d-0f9439fe591d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:48.366949 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0f4e4-2710-400a-bc3d-0f9439fe591d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:48.367216 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0f4e4-2710-400a-bc3d-0f9439fe591d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:48.367514 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d0f4e4-2710-400a-bc3d-0f9439fe591d admin admin] PATH_INFO: `/v3/users/fb195b93d31b48fc8d31652516fea46c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:48.368997 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0f4e4-2710-400a-bc3d-0f9439fe591d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb195b93d31b48fc8d31652516fea46c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:48.370981 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d0f4e4-2710-400a-bc3d-0f9439fe591d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:48.399249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7b32b-2533-4610-9116-3beb79d86b85 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:48.403775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb9ae1-84d6-4bb2-9515-88360635ebad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:48.404483 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb9ae1-84d6-4bb2-9515-88360635ebad service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:48.404795 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb9ae1-84d6-4bb2-9515-88360635ebad service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:48.405260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefb9ae1-84d6-4bb2-9515-88360635ebad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:48.418666 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb9ae1-84d6-4bb2-9515-88360635ebad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:48.420397 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefb9ae1-84d6-4bb2-9515-88360635ebad service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:48.451733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e2d0f4e4-2710-400a-bc3d-0f9439fe591d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb195b93d31b48fc8d31652516fea46c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:48.454059 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e2d0f4e4-2710-400a-bc3d-0f9439fe591d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb195b93d31b48fc8d31652516fea46c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:48.455068 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e2d0f4e4-2710-400a-bc3d-0f9439fe591d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb195b93d31b48fc8d31652516fea46c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:48.455368 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1048/2053] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:48.507959 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e2d0f4e4-2710-400a-bc3d-0f9439fe591d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb195b93d31b48fc8d31652516fea46c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:48.540900 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e2d0f4e4-2710-400a-bc3d-0f9439fe591d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb195b93d31b48fc8d31652516fea46c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:48.564626 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1006/2054] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:48 2022] DELETE /identity/v3/users/fb195b93d31b48fc8d31652516fea46c => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:48.944233 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb9ae1-84d6-4bb2-9515-88360635ebad service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:48.959692 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefb9ae1-84d6-4bb2-9515-88360635ebad service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:49.034176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0f4e4-2710-400a-bc3d-0f9439fe591d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:49.035982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e2d0f4e4-2710-400a-bc3d-0f9439fe591d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:49.060189 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367b79a-e79c-4c30-8872-a49635473d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:49.062151 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367b79a-e79c-4c30-8872-a49635473d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:49.062797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367b79a-e79c-4c30-8872-a49635473d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:49.063282 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367b79a-e79c-4c30-8872-a49635473d98 admin admin] PATH_INFO: `/v3/projects/841afea0101b4b50a052a66c3b38b3d8` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:49.065149 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367b79a-e79c-4c30-8872-a49635473d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=841afea0101b4b50a052a66c3b38b3d8)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:49.067954 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367b79a-e79c-4c30-8872-a49635473d98 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:49.115605 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d0f4e4-2710-400a-bc3d-0f9439fe591d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:49.121117 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c49ef-867a-445e-984d-052132aa6224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:49.122149 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c49ef-867a-445e-984d-052132aa6224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:49.122265 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c49ef-867a-445e-984d-052132aa6224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:49.122542 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c49ef-867a-445e-984d-052132aa6224 admin admin] PATH_INFO: `/v3/projects/7a640ef44c664f91bdb3480a34cebeec` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:49.123846 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c49ef-867a-445e-984d-052132aa6224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a640ef44c664f91bdb3480a34cebeec)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:49.126184 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c49ef-867a-445e-984d-052132aa6224 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:49.135621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:49.139726 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:49.142454 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3367b79a-e79c-4c30-8872-a49635473d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '841afea0101b4b50a052a66c3b38b3d8', 'request_id': 'req-3367b79a-e79c-4c30-8872-a49635473d98'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.152405 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3367b79a-e79c-4c30-8872-a49635473d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '841afea0101b4b50a052a66c3b38b3d8', 'request_id': 'req-3367b79a-e79c-4c30-8872-a49635473d98'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.159991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3367b79a-e79c-4c30-8872-a49635473d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '841afea0101b4b50a052a66c3b38b3d8', 'request_id': 'req-3367b79a-e79c-4c30-8872-a49635473d98'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.176975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3367b79a-e79c-4c30-8872-a49635473d98 admin admin] The token cache is being invalidate because project 841afea0101b4b50a052a66c3b38b3d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:49.177365 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3367b79a-e79c-4c30-8872-a49635473d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.178425 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3367b79a-e79c-4c30-8872-a49635473d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.180247 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1049/2055] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:48 2022] DELETE /identity/v3/projects/841afea0101b4b50a052a66c3b38b3d8 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:49.185630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6c44c-97ec-4ff3-a493-28f11f5879eb None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:49.185984 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6c44c-97ec-4ff3-a493-28f11f5879eb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:49.186327 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c6c44c-97ec-4ff3-a493-28f11f5879eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:49.200463 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-081c49ef-867a-445e-984d-052132aa6224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a640ef44c664f91bdb3480a34cebeec', 'request_id': 'req-081c49ef-867a-445e-984d-052132aa6224'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.210591 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-081c49ef-867a-445e-984d-052132aa6224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a640ef44c664f91bdb3480a34cebeec', 'request_id': 'req-081c49ef-867a-445e-984d-052132aa6224'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.217761 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-081c49ef-867a-445e-984d-052132aa6224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a640ef44c664f91bdb3480a34cebeec', 'request_id': 'req-081c49ef-867a-445e-984d-052132aa6224'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.219056 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-45c6c44c-97ec-4ff3-a493-28f11f5879eb None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:49.220475 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-45c6c44c-97ec-4ff3-a493-28f11f5879eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:49.231047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-081c49ef-867a-445e-984d-052132aa6224 admin admin] The token cache is being invalidate because project 7a640ef44c664f91bdb3480a34cebeec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:49.231343 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-081c49ef-867a-445e-984d-052132aa6224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.232017 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-081c49ef-867a-445e-984d-052132aa6224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.236604 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1007/2056] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:49 2022] DELETE /identity/v3/projects/7a640ef44c664f91bdb3480a34cebeec => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:49.237806 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c49ef-867a-445e-984d-052132aa6224 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:49.243598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-081c49ef-867a-445e-984d-052132aa6224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:49.299263 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1050/2057] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:49.309205 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999b8dc-92f9-4648-b70c-2b568f3e8a8d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:49.309532 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999b8dc-92f9-4648-b70c-2b568f3e8a8d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:49.309779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1999b8dc-92f9-4648-b70c-2b568f3e8a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:49.328583 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1999b8dc-92f9-4648-b70c-2b568f3e8a8d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:49.329790 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1999b8dc-92f9-4648-b70c-2b568f3e8a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:49.339739 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1051/2058] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:49.345384 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999b8dc-92f9-4648-b70c-2b568f3e8a8d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:49.354297 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c49ef-867a-445e-984d-052132aa6224 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:49.363331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1999b8dc-92f9-4648-b70c-2b568f3e8a8d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:49.372879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df513c7-6190-462e-a585-d0d4247411f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:49.373560 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df513c7-6190-462e-a585-d0d4247411f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:49.373849 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df513c7-6190-462e-a585-d0d4247411f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:49.374111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df513c7-6190-462e-a585-d0d4247411f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:49.374849 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df513c7-6190-462e-a585-d0d4247411f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:49.375155 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df513c7-6190-462e-a585-d0d4247411f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:49.376808 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df513c7-6190-462e-a585-d0d4247411f8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:49.379345 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae874b3-3e50-441e-9d8d-aadc927b4142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:49.380249 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae874b3-3e50-441e-9d8d-aadc927b4142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:49.380528 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae874b3-3e50-441e-9d8d-aadc927b4142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:49.380802 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae874b3-3e50-441e-9d8d-aadc927b4142 admin admin] PATH_INFO: `/v3/users/d56656b3665f4c9594cf7eaf714140bb` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:49.382126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae874b3-3e50-441e-9d8d-aadc927b4142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d56656b3665f4c9594cf7eaf714140bb)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:49.384131 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae874b3-3e50-441e-9d8d-aadc927b4142 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:49.391576 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1052/2059] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:12:49.395724 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df513c7-6190-462e-a585-d0d4247411f8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:49.405547 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df513c7-6190-462e-a585-d0d4247411f8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:49.410182 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575559f-ef0b-424f-9614-b5bd8415650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:49.410845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575559f-ef0b-424f-9614-b5bd8415650d admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:49.411129 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575559f-ef0b-424f-9614-b5bd8415650d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:49.411541 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575559f-ef0b-424f-9614-b5bd8415650d admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:49.412248 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575559f-ef0b-424f-9614-b5bd8415650d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:49.414345 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575559f-ef0b-424f-9614-b5bd8415650d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:49.436064 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aae874b3-3e50-441e-9d8d-aadc927b4142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd56656b3665f4c9594cf7eaf714140bb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.436802 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aae874b3-3e50-441e-9d8d-aadc927b4142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd56656b3665f4c9594cf7eaf714140bb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.437673 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aae874b3-3e50-441e-9d8d-aadc927b4142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd56656b3665f4c9594cf7eaf714140bb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.441033 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1053/2060] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:49 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:12:49.444888 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aae874b3-3e50-441e-9d8d-aadc927b4142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd56656b3665f4c9594cf7eaf714140bb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.445011 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575559f-ef0b-424f-9614-b5bd8415650d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:49.446568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3575559f-ef0b-424f-9614-b5bd8415650d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:49.457957 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-aae874b3-3e50-441e-9d8d-aadc927b4142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd56656b3665f4c9594cf7eaf714140bb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.472271 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1008/2061] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:49 2022] DELETE /identity/v3/users/d56656b3665f4c9594cf7eaf714140bb => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:49.516123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575559f-ef0b-424f-9614-b5bd8415650d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:49.561413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:49.581991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17126e2-93fb-4791-a3a5-ff32a61679a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:49.582695 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17126e2-93fb-4791-a3a5-ff32a61679a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:49.582962 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17126e2-93fb-4791-a3a5-ff32a61679a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:49.583239 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17126e2-93fb-4791-a3a5-ff32a61679a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:49.583970 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17126e2-93fb-4791-a3a5-ff32a61679a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:49.586123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17126e2-93fb-4791-a3a5-ff32a61679a1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:49.609821 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1054/2062] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:49 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:12:49.611730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae874b3-3e50-441e-9d8d-aadc927b4142 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:49.628395 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae874b3-3e50-441e-9d8d-aadc927b4142 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:49.634382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d0e2a-22e2-4d7b-b0b9-375a8a41565c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:49.635552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d0e2a-22e2-4d7b-b0b9-375a8a41565c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:49.635552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d0e2a-22e2-4d7b-b0b9-375a8a41565c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:49.635694 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d0e2a-22e2-4d7b-b0b9-375a8a41565c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:49.636348 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d0e2a-22e2-4d7b-b0b9-375a8a41565c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:49.637962 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d0e2a-22e2-4d7b-b0b9-375a8a41565c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:49.649382 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1009/2063] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:49.654379 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17126e2-93fb-4791-a3a5-ff32a61679a1 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:49.665532 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17126e2-93fb-4791-a3a5-ff32a61679a1 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:49.672105 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc0bb2-77af-4411-8f2e-dce34c995a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:49.672818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc0bb2-77af-4411-8f2e-dce34c995a25 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:49.673071 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc0bb2-77af-4411-8f2e-dce34c995a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:49.673344 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc0bb2-77af-4411-8f2e-dce34c995a25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:49.674463 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc0bb2-77af-4411-8f2e-dce34c995a25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:49.676157 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc0bb2-77af-4411-8f2e-dce34c995a25 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:49.691031 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1055/2064] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:49.692149 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d0e2a-22e2-4d7b-b0b9-375a8a41565c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:49.699455 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:49.705390 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d0e2a-22e2-4d7b-b0b9-375a8a41565c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:49.713061 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f491db7-f7e5-45c4-8424-4e2770297aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:49.714509 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f491db7-f7e5-45c4-8424-4e2770297aa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:49.714880 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f491db7-f7e5-45c4-8424-4e2770297aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:49.715122 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f491db7-f7e5-45c4-8424-4e2770297aa5 admin admin] PATH_INFO: `/v3/projects/2c81ba16f43b4245b9e7d16f97335304/users/9767d1501f2e4dcdafe6464e138631b7/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:49.742797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f491db7-f7e5-45c4-8424-4e2770297aa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c81ba16f43b4245b9e7d16f97335304, user_id=9767d1501f2e4dcdafe6464e138631b7, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:49.745706 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f491db7-f7e5-45c4-8424-4e2770297aa5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:49.767346 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1010/2065] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:49 2022] PUT /identity/v3/projects/2c81ba16f43b4245b9e7d16f97335304/users/9767d1501f2e4dcdafe6464e138631b7/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:49.773045 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc0bb2-77af-4411-8f2e-dce34c995a25 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:49.776137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-46bc0bb2-77af-4411-8f2e-dce34c995a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:49.778691 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8e834-470f-442d-a671-971bbdbb3847 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:49.779172 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8e834-470f-442d-a671-971bbdbb3847 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:49.780335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8e834-470f-442d-a671-971bbdbb3847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:49.795355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc0bb2-77af-4411-8f2e-dce34c995a25 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:49.831621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8bd8e834-470f-442d-a671-971bbdbb3847 None None] MFA Rules not processed for user `9767d1501f2e4dcdafe6464e138631b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:49.833126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8bd8e834-470f-442d-a671-971bbdbb3847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:49.892799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5963f6-a938-4649-82b5-6b3f53f59a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:49.894539 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5963f6-a938-4649-82b5-6b3f53f59a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:49.895019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5963f6-a938-4649-82b5-6b3f53f59a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:49.895630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5963f6-a938-4649-82b5-6b3f53f59a9d admin admin] PATH_INFO: `/v3/projects/83283c713a8e4b6983b6518fa1008050` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:49.897285 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5963f6-a938-4649-82b5-6b3f53f59a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=83283c713a8e4b6983b6518fa1008050)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:49.899745 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5963f6-a938-4649-82b5-6b3f53f59a9d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:49.965181 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9a5963f6-a938-4649-82b5-6b3f53f59a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83283c713a8e4b6983b6518fa1008050', 'request_id': 'req-9a5963f6-a938-4649-82b5-6b3f53f59a9d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.976951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9a5963f6-a938-4649-82b5-6b3f53f59a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83283c713a8e4b6983b6518fa1008050', 'request_id': 'req-9a5963f6-a938-4649-82b5-6b3f53f59a9d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.983827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9a5963f6-a938-4649-82b5-6b3f53f59a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83283c713a8e4b6983b6518fa1008050', 'request_id': 'req-9a5963f6-a938-4649-82b5-6b3f53f59a9d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:49.986925 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1011/2066] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:49.998922 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8e834-470f-442d-a671-971bbdbb3847 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:50.000345 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8bd8e834-470f-442d-a671-971bbdbb3847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:50.001225 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9a5963f6-a938-4649-82b5-6b3f53f59a9d admin admin] The token cache is being invalidate because project 83283c713a8e4b6983b6518fa1008050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:50.001613 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9a5963f6-a938-4649-82b5-6b3f53f59a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:50.002407 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9a5963f6-a938-4649-82b5-6b3f53f59a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:50.004571 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1056/2067] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:49 2022] DELETE /identity/v3/projects/83283c713a8e4b6983b6518fa1008050 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:50.012209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8c3dc-e9e5-44a2-bd9c-ad86e7134d77 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:50.012595 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8c3dc-e9e5-44a2-bd9c-ad86e7134d77 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:50.012874 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee8c3dc-e9e5-44a2-bd9c-ad86e7134d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:50.031556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7ee8c3dc-e9e5-44a2-bd9c-ad86e7134d77 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:50.032769 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7ee8c3dc-e9e5-44a2-bd9c-ad86e7134d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:50.072051 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8e834-470f-442d-a671-971bbdbb3847 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:50.117788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:50.136147 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1057/2068] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:50.140033 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddff5dd-f93f-40d7-9051-c39eca038ec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:50.140712 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddff5dd-f93f-40d7-9051-c39eca038ec0 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:50.140994 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddff5dd-f93f-40d7-9051-c39eca038ec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:50.141267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddff5dd-f93f-40d7-9051-c39eca038ec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:50.143177 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-eddff5dd-f93f-40d7-9051-c39eca038ec0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:50.144334 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c891fff-e44f-4385-bd6b-48bb3c8bad33 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:50.144626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c891fff-e44f-4385-bd6b-48bb3c8bad33 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:50.144909 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c891fff-e44f-4385-bd6b-48bb3c8bad33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:50.162592 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3c891fff-e44f-4385-bd6b-48bb3c8bad33 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:50.163876 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3c891fff-e44f-4385-bd6b-48bb3c8bad33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:50.172318 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1058/2069] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:50.176437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c891fff-e44f-4385-bd6b-48bb3c8bad33 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:50.184638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:50.185788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c891fff-e44f-4385-bd6b-48bb3c8bad33 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:50.190634 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1aaa5d-c0db-45a9-b8b7-e08a9e4a771b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:50.191458 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1aaa5d-c0db-45a9-b8b7-e08a9e4a771b admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:50.191802 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1aaa5d-c0db-45a9-b8b7-e08a9e4a771b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:50.192075 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1aaa5d-c0db-45a9-b8b7-e08a9e4a771b admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:50.192800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1aaa5d-c0db-45a9-b8b7-e08a9e4a771b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:50.193105 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1aaa5d-c0db-45a9-b8b7-e08a9e4a771b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:50.194776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1aaa5d-c0db-45a9-b8b7-e08a9e4a771b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:50.203686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddff5dd-f93f-40d7-9051-c39eca038ec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:50.205232 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddff5dd-f93f-40d7-9051-c39eca038ec0 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:50.207487 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1059/2070] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:12:50.211974 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1aaa5d-c0db-45a9-b8b7-e08a9e4a771b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:50.214426 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1012/2071] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:50.222049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1aaa5d-c0db-45a9-b8b7-e08a9e4a771b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:50.227089 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17642cfe-9ce4-42e5-b06c-d58532790ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:50.227794 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17642cfe-9ce4-42e5-b06c-d58532790ddb admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:50.228082 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17642cfe-9ce4-42e5-b06c-d58532790ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:50.228356 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17642cfe-9ce4-42e5-b06c-d58532790ddb admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:50.229058 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17642cfe-9ce4-42e5-b06c-d58532790ddb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:50.230971 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17642cfe-9ce4-42e5-b06c-d58532790ddb admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:50.233314 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddff5dd-f93f-40d7-9051-c39eca038ec0 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:50.234714 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-eddff5dd-f93f-40d7-9051-c39eca038ec0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:50.249791 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddff5dd-f93f-40d7-9051-c39eca038ec0 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:50.254577 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd419f-8990-4767-b654-0a0493d25efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:50.255499 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd419f-8990-4767-b654-0a0493d25efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:50.255781 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd419f-8990-4767-b654-0a0493d25efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:50.256054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd419f-8990-4767-b654-0a0493d25efd admin admin] PATH_INFO: `/v3/users/9767d1501f2e4dcdafe6464e138631b7` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:50.257270 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd419f-8990-4767-b654-0a0493d25efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9767d1501f2e4dcdafe6464e138631b7)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:50.258075 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1060/2072] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:50 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:50.259198 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd419f-8990-4767-b654-0a0493d25efd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:50.262017 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17642cfe-9ce4-42e5-b06c-d58532790ddb admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:50.307944 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-abcd419f-8990-4767-b654-0a0493d25efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9767d1501f2e4dcdafe6464e138631b7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:50.308707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-abcd419f-8990-4767-b654-0a0493d25efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9767d1501f2e4dcdafe6464e138631b7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:50.309519 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-abcd419f-8990-4767-b654-0a0493d25efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9767d1501f2e4dcdafe6464e138631b7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:50.316308 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-abcd419f-8990-4767-b654-0a0493d25efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9767d1501f2e4dcdafe6464e138631b7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:50.322462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17642cfe-9ce4-42e5-b06c-d58532790ddb admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:50.327205 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb63890-c187-43f5-b52c-3ec1598999e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:50.327810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-abcd419f-8990-4767-b654-0a0493d25efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9767d1501f2e4dcdafe6464e138631b7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:50.328043 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63890-c187-43f5-b52c-3ec1598999e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:50.328402 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63890-c187-43f5-b52c-3ec1598999e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:50.328860 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb63890-c187-43f5-b52c-3ec1598999e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:50.329639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb63890-c187-43f5-b52c-3ec1598999e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:50.331632 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb63890-c187-43f5-b52c-3ec1598999e9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:50.342431 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1013/2073] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:50 2022] DELETE /identity/v3/users/9767d1501f2e4dcdafe6464e138631b7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:50.347190 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43d610-d63f-4a97-9f13-8d66a717cb92 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:50.347570 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43d610-d63f-4a97-9f13-8d66a717cb92 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:50.347854 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43d610-d63f-4a97-9f13-8d66a717cb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:50.356591 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1061/2074] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:50 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:12:50.357907 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb63890-c187-43f5-b52c-3ec1598999e9 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:50.359754 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8bb63890-c187-43f5-b52c-3ec1598999e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:50.365205 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-4a43d610-d63f-4a97-9f13-8d66a717cb92 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:50.366547 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4a43d610-d63f-4a97-9f13-8d66a717cb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:50.372382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb63890-c187-43f5-b52c-3ec1598999e9 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:50.458292 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e04c5e-f816-483f-a9e2-b94a4a44ff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:50.459037 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e04c5e-f816-483f-a9e2-b94a4a44ff1e admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:50.459283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e04c5e-f816-483f-a9e2-b94a4a44ff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:50.459641 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e04c5e-f816-483f-a9e2-b94a4a44ff1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:50.461154 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e04c5e-f816-483f-a9e2-b94a4a44ff1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:50.462292 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e04c5e-f816-483f-a9e2-b94a4a44ff1e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:50.463377 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1014/2075] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:50.473358 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43d610-d63f-4a97-9f13-8d66a717cb92 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:50.474859 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4a43d610-d63f-4a97-9f13-8d66a717cb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:50.479391 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1062/2076] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:12:50.483193 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e04c5e-f816-483f-a9e2-b94a4a44ff1e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:50.494442 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e04c5e-f816-483f-a9e2-b94a4a44ff1e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:50.501182 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad64c74-da77-4060-ba29-d38a3b455be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:50.501884 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad64c74-da77-4060-ba29-d38a3b455be0 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:50.502269 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad64c74-da77-4060-ba29-d38a3b455be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:50.502442 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad64c74-da77-4060-ba29-d38a3b455be0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:50.503191 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad64c74-da77-4060-ba29-d38a3b455be0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:50.504986 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad64c74-da77-4060-ba29-d38a3b455be0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:50.516186 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1063/2077] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:12:50.520072 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad64c74-da77-4060-ba29-d38a3b455be0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:50.534125 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad64c74-da77-4060-ba29-d38a3b455be0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:50.542160 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43d610-d63f-4a97-9f13-8d66a717cb92 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:50.542830 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada42891-99dc-4126-a514-ceba31993c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:50.543843 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada42891-99dc-4126-a514-ceba31993c44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:50.544585 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada42891-99dc-4126-a514-ceba31993c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:50.544585 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada42891-99dc-4126-a514-ceba31993c44 admin admin] PATH_INFO: `/v3/projects/083e6e1f36c3453da2befa06a4875014/users/9a0398a0ec144dfcbcc4c92fc54d4dee/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:50.549996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b33ffc-1751-41a9-949f-a0be915d6ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:50.550701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b33ffc-1751-41a9-949f-a0be915d6ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:50.551014 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b33ffc-1751-41a9-949f-a0be915d6ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:50.551289 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b33ffc-1751-41a9-949f-a0be915d6ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:50.560403 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:50.562017 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada42891-99dc-4126-a514-ceba31993c44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=083e6e1f36c3453da2befa06a4875014, user_id=9a0398a0ec144dfcbcc4c92fc54d4dee, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:50.562908 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b33ffc-1751-41a9-949f-a0be915d6ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:50.564203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b33ffc-1751-41a9-949f-a0be915d6ac8 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:50.565121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada42891-99dc-4126-a514-ceba31993c44 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:50.577364 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1015/2078] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:12:50.590823 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:50.597160 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1064/2079] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:50 2022] PUT /identity/v3/projects/083e6e1f36c3453da2befa06a4875014/users/9a0398a0ec144dfcbcc4c92fc54d4dee/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:12:50.602230 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65290439-39b0-4e6e-a8b5-7fef4e7a95e3 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:50.602524 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65290439-39b0-4e6e-a8b5-7fef4e7a95e3 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:50.602798 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65290439-39b0-4e6e-a8b5-7fef4e7a95e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:50.625567 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-65290439-39b0-4e6e-a8b5-7fef4e7a95e3 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:50.627090 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-65290439-39b0-4e6e-a8b5-7fef4e7a95e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:50.713274 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1016/2080] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:50.728218 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada42891-99dc-4126-a514-ceba31993c44 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:50.730340 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ada42891-99dc-4126-a514-ceba31993c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:50.821242 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada42891-99dc-4126-a514-ceba31993c44 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:50.825508 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb790782-9622-4a61-89ee-7b246f3e7dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:50.826178 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790782-9622-4a61-89ee-7b246f3e7dbd service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:50.826464 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790782-9622-4a61-89ee-7b246f3e7dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:50.826738 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb790782-9622-4a61-89ee-7b246f3e7dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:50.836782 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb790782-9622-4a61-89ee-7b246f3e7dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:50.838251 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb790782-9622-4a61-89ee-7b246f3e7dbd service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:50.848090 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1065/2081] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:50.978809 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65290439-39b0-4e6e-a8b5-7fef4e7a95e3 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:50.980270 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-65290439-39b0-4e6e-a8b5-7fef4e7a95e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:50.993064 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65290439-39b0-4e6e-a8b5-7fef4e7a95e3 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:51.000058 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7629d9c3-e613-4b22-b149-1267f579b443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:51.000994 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629d9c3-e613-4b22-b149-1267f579b443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:51.001276 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629d9c3-e613-4b22-b149-1267f579b443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:51.001546 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7629d9c3-e613-4b22-b149-1267f579b443 admin admin] PATH_INFO: `/v3/projects/2c81ba16f43b4245b9e7d16f97335304` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:51.002803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629d9c3-e613-4b22-b149-1267f579b443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c81ba16f43b4245b9e7d16f97335304)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:51.004988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7629d9c3-e613-4b22-b149-1267f579b443 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:51.066741 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7629d9c3-e613-4b22-b149-1267f579b443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c81ba16f43b4245b9e7d16f97335304', 'request_id': 'req-7629d9c3-e613-4b22-b149-1267f579b443'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:51.076626 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7629d9c3-e613-4b22-b149-1267f579b443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c81ba16f43b4245b9e7d16f97335304', 'request_id': 'req-7629d9c3-e613-4b22-b149-1267f579b443'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:51.082578 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7629d9c3-e613-4b22-b149-1267f579b443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c81ba16f43b4245b9e7d16f97335304', 'request_id': 'req-7629d9c3-e613-4b22-b149-1267f579b443'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:51.107684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7629d9c3-e613-4b22-b149-1267f579b443 admin admin] The token cache is being invalidate because project 2c81ba16f43b4245b9e7d16f97335304 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:51.108032 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7629d9c3-e613-4b22-b149-1267f579b443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:51.109278 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-7629d9c3-e613-4b22-b149-1267f579b443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:51.115254 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1017/2082] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:50 2022] DELETE /identity/v3/projects/2c81ba16f43b4245b9e7d16f97335304 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:51.120579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9cea1-afbf-43b3-8e47-f9e9607b6315 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:51.121704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9cea1-afbf-43b3-8e47-f9e9607b6315 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:51.122269 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9cea1-afbf-43b3-8e47-f9e9607b6315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:51.147063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d2c9cea1-afbf-43b3-8e47-f9e9607b6315 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:51.148642 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d2c9cea1-afbf-43b3-8e47-f9e9607b6315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:51.211467 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1066/2083] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:51.283484 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c708d21-5a49-4513-a82a-fc87bfd99135 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:51.283786 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c708d21-5a49-4513-a82a-fc87bfd99135 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:51.284137 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c708d21-5a49-4513-a82a-fc87bfd99135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:51.339888 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5c708d21-5a49-4513-a82a-fc87bfd99135 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:51.341172 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5c708d21-5a49-4513-a82a-fc87bfd99135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:51.364863 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1018/2084] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:51.368721 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9cea1-afbf-43b3-8e47-f9e9607b6315 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:51.382217 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c9cea1-afbf-43b3-8e47-f9e9607b6315 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:51.389608 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a36e7f-8faa-4269-9b32-f3516ea56b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:51.390846 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a36e7f-8faa-4269-9b32-f3516ea56b3f admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:51.391473 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a36e7f-8faa-4269-9b32-f3516ea56b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:51.391979 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a36e7f-8faa-4269-9b32-f3516ea56b3f admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:51.393206 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a36e7f-8faa-4269-9b32-f3516ea56b3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:51.393717 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a36e7f-8faa-4269-9b32-f3516ea56b3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:51.403885 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a36e7f-8faa-4269-9b32-f3516ea56b3f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:51.434642 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1067/2085] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:51.439369 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c708d21-5a49-4513-a82a-fc87bfd99135 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:51.475456 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c708d21-5a49-4513-a82a-fc87bfd99135 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:51.485368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954d790-d444-4b3f-a20b-01b5b0e3e8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:51.486372 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954d790-d444-4b3f-a20b-01b5b0e3e8bb admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:51.486836 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954d790-d444-4b3f-a20b-01b5b0e3e8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:51.487468 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2954d790-d444-4b3f-a20b-01b5b0e3e8bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:51.488349 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954d790-d444-4b3f-a20b-01b5b0e3e8bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:51.490497 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2954d790-d444-4b3f-a20b-01b5b0e3e8bb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:51.529900 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1019/2086] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:51 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:51.534293 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a36e7f-8faa-4269-9b32-f3516ea56b3f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:51.546691 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a36e7f-8faa-4269-9b32-f3516ea56b3f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:51.627833 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da56ad5-59e1-4ace-a223-7deefb16dea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:51.628537 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da56ad5-59e1-4ace-a223-7deefb16dea5 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:51.628825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da56ad5-59e1-4ace-a223-7deefb16dea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:51.629746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da56ad5-59e1-4ace-a223-7deefb16dea5 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:51.631126 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da56ad5-59e1-4ace-a223-7deefb16dea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:51.633189 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da56ad5-59e1-4ace-a223-7deefb16dea5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:51.663624 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1068/2087] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:51 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:51.664640 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954d790-d444-4b3f-a20b-01b5b0e3e8bb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:51.678348 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2954d790-d444-4b3f-a20b-01b5b0e3e8bb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:51.684767 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3043c-e36d-4853-9ffc-2d21b526b907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:51.687077 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3043c-e36d-4853-9ffc-2d21b526b907 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:51.687815 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3043c-e36d-4853-9ffc-2d21b526b907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:51.688223 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3043c-e36d-4853-9ffc-2d21b526b907 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:51.689074 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3043c-e36d-4853-9ffc-2d21b526b907 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:51.691123 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3043c-e36d-4853-9ffc-2d21b526b907 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:51.704774 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1020/2088] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:51.711047 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da56ad5-59e1-4ace-a223-7deefb16dea5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:51.727398 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da56ad5-59e1-4ace-a223-7deefb16dea5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:51.733599 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e17b8-991c-454a-a9e6-92906d3ae439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:51.734487 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e17b8-991c-454a-a9e6-92906d3ae439 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:51.734788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e17b8-991c-454a-a9e6-92906d3ae439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:51.735199 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e17b8-991c-454a-a9e6-92906d3ae439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:51.736402 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e17b8-991c-454a-a9e6-92906d3ae439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:51.739033 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e17b8-991c-454a-a9e6-92906d3ae439 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:51.759448 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1069/2089] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:51 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:51.760079 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3043c-e36d-4853-9ffc-2d21b526b907 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:51.780303 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3043c-e36d-4853-9ffc-2d21b526b907 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:51.786046 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330da6-de67-4290-8309-68481de7e96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:51.787506 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330da6-de67-4290-8309-68481de7e96d admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:51.788158 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330da6-de67-4290-8309-68481de7e96d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:51.788691 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330da6-de67-4290-8309-68481de7e96d admin admin] PATH_INFO: `/v3/projects/c48a134437184873b098e45c3087b516/users/6589122bd9e540d699a3498ee11aceb4/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:51.815834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83330da6-de67-4290-8309-68481de7e96d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c48a134437184873b098e45c3087b516, user_id=6589122bd9e540d699a3498ee11aceb4, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:51.818995 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83330da6-de67-4290-8309-68481de7e96d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:51.840263 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1021/2090] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:51 2022] PUT /identity/v3/projects/c48a134437184873b098e45c3087b516/users/6589122bd9e540d699a3498ee11aceb4/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:51.850810 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cc081-aacc-44d2-ab3d-9ba28eef3d6d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:51.851519 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cc081-aacc-44d2-ab3d-9ba28eef3d6d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:51.852633 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cc081-aacc-44d2-ab3d-9ba28eef3d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:51.897009 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:51.912602 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-db0cc081-aacc-44d2-ab3d-9ba28eef3d6d None None] MFA Rules not processed for user `6589122bd9e540d699a3498ee11aceb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:51.914388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-db0cc081-aacc-44d2-ab3d-9ba28eef3d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:52.006578 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330da6-de67-4290-8309-68481de7e96d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:52.012151 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1070/2091] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:52.047888 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:52.199629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330da6-de67-4290-8309-68481de7e96d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:52.215267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cbd4a-44d8-4854-9a59-835cd320421c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:52.216797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cbd4a-44d8-4854-9a59-835cd320421c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:52.217410 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cbd4a-44d8-4854-9a59-835cd320421c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:52.217826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4cbd4a-44d8-4854-9a59-835cd320421c admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:52.218949 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cbd4a-44d8-4854-9a59-835cd320421c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:52.222428 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4cbd4a-44d8-4854-9a59-835cd320421c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:52.268288 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1022/2092] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:52 2022] POST /identity/v3/projects => generated 373 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:12:52.272214 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cc081-aacc-44d2-ab3d-9ba28eef3d6d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:52.286133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cc081-aacc-44d2-ab3d-9ba28eef3d6d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:52.433990 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75e85c-e409-45b9-a7c0-2d0a1e0fc670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:52.434668 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75e85c-e409-45b9-a7c0-2d0a1e0fc670 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:52.434952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75e85c-e409-45b9-a7c0-2d0a1e0fc670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:52.435232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb75e85c-e409-45b9-a7c0-2d0a1e0fc670 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:52.435969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75e85c-e409-45b9-a7c0-2d0a1e0fc670 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:52.439381 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb75e85c-e409-45b9-a7c0-2d0a1e0fc670 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:52.487379 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1071/2093] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:52 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:52.492541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cbd4a-44d8-4854-9a59-835cd320421c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:52.529857 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4cbd4a-44d8-4854-9a59-835cd320421c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:52.544800 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801ce52-4bad-4449-94cc-19c35676f75a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:52.560512 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801ce52-4bad-4449-94cc-19c35676f75a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:52.561944 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801ce52-4bad-4449-94cc-19c35676f75a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:52.563251 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d801ce52-4bad-4449-94cc-19c35676f75a admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:52.564147 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801ce52-4bad-4449-94cc-19c35676f75a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:52.571879 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d801ce52-4bad-4449-94cc-19c35676f75a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:52.598923 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1023/2094] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:52.603270 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75e85c-e409-45b9-a7c0-2d0a1e0fc670 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:52.618360 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb75e85c-e409-45b9-a7c0-2d0a1e0fc670 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:52.631160 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956f2a1-0bcb-4c78-b313-bb4c6c0332ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:52.632166 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956f2a1-0bcb-4c78-b313-bb4c6c0332ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:52.632565 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956f2a1-0bcb-4c78-b313-bb4c6c0332ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:52.633129 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956f2a1-0bcb-4c78-b313-bb4c6c0332ec admin admin] PATH_INFO: `/v3/projects/40c186841f8943fa8a3bdb5bf1210f24/users/1d86da8f572c40d292ec04fdbd472362/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:52.656706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956f2a1-0bcb-4c78-b313-bb4c6c0332ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c186841f8943fa8a3bdb5bf1210f24, user_id=1d86da8f572c40d292ec04fdbd472362, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:52.665640 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1956f2a1-0bcb-4c78-b313-bb4c6c0332ec admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:52.693957 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1072/2095] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:52 2022] PUT /identity/v3/projects/40c186841f8943fa8a3bdb5bf1210f24/users/1d86da8f572c40d292ec04fdbd472362/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:52.698124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801ce52-4bad-4449-94cc-19c35676f75a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:52.709577 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d801ce52-4bad-4449-94cc-19c35676f75a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:52.796917 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8fadae-84a8-435b-b4b1-4f819dcb59a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:52.797877 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fadae-84a8-435b-b4b1-4f819dcb59a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:52.798943 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fadae-84a8-435b-b4b1-4f819dcb59a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:52.799942 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8fadae-84a8-435b-b4b1-4f819dcb59a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:52.800874 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fadae-84a8-435b-b4b1-4f819dcb59a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:52.803907 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8fadae-84a8-435b-b4b1-4f819dcb59a0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:52.821225 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1024/2096] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:52.825241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956f2a1-0bcb-4c78-b313-bb4c6c0332ec admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:52.837955 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1956f2a1-0bcb-4c78-b313-bb4c6c0332ec admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:52.842946 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e60d7e-f239-4f0c-a3cc-2a749d58627e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:52.843908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e60d7e-f239-4f0c-a3cc-2a749d58627e admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:52.844195 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e60d7e-f239-4f0c-a3cc-2a749d58627e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:52.844470 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e60d7e-f239-4f0c-a3cc-2a749d58627e admin admin] PATH_INFO: `/v3/projects/40c186841f8943fa8a3bdb5bf1210f24/users/1d86da8f572c40d292ec04fdbd472362/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:52.846517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e60d7e-f239-4f0c-a3cc-2a749d58627e admin admin] RBAC: Authorizing `identity:create_grant(project_id=40c186841f8943fa8a3bdb5bf1210f24, user_id=1d86da8f572c40d292ec04fdbd472362, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:52.849231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e60d7e-f239-4f0c-a3cc-2a749d58627e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:52.873260 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1073/2097] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:52 2022] PUT /identity/v3/projects/40c186841f8943fa8a3bdb5bf1210f24/users/1d86da8f572c40d292ec04fdbd472362/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:52.888141 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532f5c3-fddd-4a66-89b5-f6cdf136eb30 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:52.888646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532f5c3-fddd-4a66-89b5-f6cdf136eb30 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:52.889203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532f5c3-fddd-4a66-89b5-f6cdf136eb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:52.919864 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2532f5c3-fddd-4a66-89b5-f6cdf136eb30 None None] MFA Rules not processed for user `1d86da8f572c40d292ec04fdbd472362`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:52.921195 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2532f5c3-fddd-4a66-89b5-f6cdf136eb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:53.109154 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1025/2098] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:53.120780 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e60d7e-f239-4f0c-a3cc-2a749d58627e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:53.122684 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-20e60d7e-f239-4f0c-a3cc-2a749d58627e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:53.212887 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e60d7e-f239-4f0c-a3cc-2a749d58627e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:53.229347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29441b8-785a-4390-baa4-3c621ae28b56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:53.230102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29441b8-785a-4390-baa4-3c621ae28b56 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:53.230416 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29441b8-785a-4390-baa4-3c621ae28b56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:53.230745 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29441b8-785a-4390-baa4-3c621ae28b56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:53.240322 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:53.306513 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29441b8-785a-4390-baa4-3c621ae28b56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:53.308102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29441b8-785a-4390-baa4-3c621ae28b56 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:53.329617 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1074/2099] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:53 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:56.332587 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532f5c3-fddd-4a66-89b5-f6cdf136eb30 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:56.374649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:56.477549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532f5c3-fddd-4a66-89b5-f6cdf136eb30 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:56.489686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb92183-f1af-4dcf-a941-1c72378def14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:56.490706 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb92183-f1af-4dcf-a941-1c72378def14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:56.490991 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb92183-f1af-4dcf-a941-1c72378def14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:56.491621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb92183-f1af-4dcf-a941-1c72378def14 admin admin] PATH_INFO: `/v3/users/6589122bd9e540d699a3498ee11aceb4` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:56.494999 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb92183-f1af-4dcf-a941-1c72378def14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6589122bd9e540d699a3498ee11aceb4)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:56.497609 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb92183-f1af-4dcf-a941-1c72378def14 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:56.565765 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3cb92183-f1af-4dcf-a941-1c72378def14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6589122bd9e540d699a3498ee11aceb4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:56.566371 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3cb92183-f1af-4dcf-a941-1c72378def14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6589122bd9e540d699a3498ee11aceb4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:56.567007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3cb92183-f1af-4dcf-a941-1c72378def14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6589122bd9e540d699a3498ee11aceb4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:56.575518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3cb92183-f1af-4dcf-a941-1c72378def14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6589122bd9e540d699a3498ee11aceb4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:56.598302 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3cb92183-f1af-4dcf-a941-1c72378def14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6589122bd9e540d699a3498ee11aceb4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:56.620211 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1026/2100] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:56 2022] DELETE /identity/v3/users/6589122bd9e540d699a3498ee11aceb4 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:56.626029 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778bbac-04a5-4526-a76d-59bc24e60c81 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:56.626663 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778bbac-04a5-4526-a76d-59bc24e60c81 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:56.626663 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778bbac-04a5-4526-a76d-59bc24e60c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:56.650493 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3778bbac-04a5-4526-a76d-59bc24e60c81 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:56.655625 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3778bbac-04a5-4526-a76d-59bc24e60c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:56.789602 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1075/2101] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:56.820047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb92183-f1af-4dcf-a941-1c72378def14 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:56.823005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3cb92183-f1af-4dcf-a941-1c72378def14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:56.954397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb92183-f1af-4dcf-a941-1c72378def14 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:56.964804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da00966-ec66-4688-81cf-0fc806945917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:56.966384 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da00966-ec66-4688-81cf-0fc806945917 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:56.966857 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da00966-ec66-4688-81cf-0fc806945917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:56.967817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da00966-ec66-4688-81cf-0fc806945917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:56.981257 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da00966-ec66-4688-81cf-0fc806945917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:56.983405 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da00966-ec66-4688-81cf-0fc806945917 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:56.999345 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1027/2102] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:12:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:12:58.123579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778bbac-04a5-4526-a76d-59bc24e60c81 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:58.125760 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3778bbac-04a5-4526-a76d-59bc24e60c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:58.145426 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778bbac-04a5-4526-a76d-59bc24e60c81 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:58.156920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:58.157830 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:58.158115 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:58.161539 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b admin admin] PATH_INFO: `/v3/projects/c48a134437184873b098e45c3087b516` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:58.162924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c48a134437184873b098e45c3087b516)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:58.167567 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:58.254466 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c48a134437184873b098e45c3087b516', 'request_id': 'req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:58.263026 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c48a134437184873b098e45c3087b516', 'request_id': 'req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:58.270636 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c48a134437184873b098e45c3087b516', 'request_id': 'req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:58.293377 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b admin admin] The token cache is being invalidate because project c48a134437184873b098e45c3087b516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:58.295108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:58.299869 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:58.301844 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1076/2103] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:58 2022] DELETE /identity/v3/projects/c48a134437184873b098e45c3087b516 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:58.306537 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da00966-ec66-4688-81cf-0fc806945917 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:58.318101 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da00966-ec66-4688-81cf-0fc806945917 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:58.367055 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:58.411806 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaead96-6fc8-4de6-a002-0209e1c12d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:58.413011 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaead96-6fc8-4de6-a002-0209e1c12d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:58.413568 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaead96-6fc8-4de6-a002-0209e1c12d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:58.414038 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaead96-6fc8-4de6-a002-0209e1c12d2a admin admin] PATH_INFO: `/v3/users/1d86da8f572c40d292ec04fdbd472362` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:58.415761 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaead96-6fc8-4de6-a002-0209e1c12d2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d86da8f572c40d292ec04fdbd472362)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:58.418850 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceaead96-6fc8-4de6-a002-0209e1c12d2a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:58.488896 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ceaead96-6fc8-4de6-a002-0209e1c12d2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d86da8f572c40d292ec04fdbd472362'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:58.489815 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ceaead96-6fc8-4de6-a002-0209e1c12d2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d86da8f572c40d292ec04fdbd472362'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:58.490434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ceaead96-6fc8-4de6-a002-0209e1c12d2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d86da8f572c40d292ec04fdbd472362'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:58.499051 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ceaead96-6fc8-4de6-a002-0209e1c12d2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d86da8f572c40d292ec04fdbd472362'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:58.515242 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ceaead96-6fc8-4de6-a002-0209e1c12d2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d86da8f572c40d292ec04fdbd472362'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:58.540410 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1028/2104] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:12:58 2022] DELETE /identity/v3/users/1d86da8f572c40d292ec04fdbd472362 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:58.954350 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:58.956355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:58.983558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dd9dc-1a86-43f1-9bc1-f963a38af14b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:59.033854 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:59.074718 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc33b04-c80b-489f-a8da-d67e301f3b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:59.075712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc33b04-c80b-489f-a8da-d67e301f3b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:59.076002 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc33b04-c80b-489f-a8da-d67e301f3b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:59.076283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc33b04-c80b-489f-a8da-d67e301f3b15 admin admin] PATH_INFO: `/v3/projects/40c186841f8943fa8a3bdb5bf1210f24` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:59.077513 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc33b04-c80b-489f-a8da-d67e301f3b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40c186841f8943fa8a3bdb5bf1210f24)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:59.079575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc33b04-c80b-489f-a8da-d67e301f3b15 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:59.124634 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84aa43-bb20-439d-8996-b9773a1d3488 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:59.125389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84aa43-bb20-439d-8996-b9773a1d3488 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:59.126189 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e84aa43-bb20-439d-8996-b9773a1d3488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:59.167456 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2e84aa43-bb20-439d-8996-b9773a1d3488 None None] MFA Rules not processed for user `9a0398a0ec144dfcbcc4c92fc54d4dee`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:59.169142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2e84aa43-bb20-439d-8996-b9773a1d3488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:59.179894 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0dc33b04-c80b-489f-a8da-d67e301f3b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40c186841f8943fa8a3bdb5bf1210f24', 'request_id': 'req-0dc33b04-c80b-489f-a8da-d67e301f3b15'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:59.191598 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0dc33b04-c80b-489f-a8da-d67e301f3b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40c186841f8943fa8a3bdb5bf1210f24', 'request_id': 'req-0dc33b04-c80b-489f-a8da-d67e301f3b15'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:59.208584 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0dc33b04-c80b-489f-a8da-d67e301f3b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40c186841f8943fa8a3bdb5bf1210f24', 'request_id': 'req-0dc33b04-c80b-489f-a8da-d67e301f3b15'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:59.229012 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0dc33b04-c80b-489f-a8da-d67e301f3b15 admin admin] The token cache is being invalidate because project 40c186841f8943fa8a3bdb5bf1210f24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:12:59.229846 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0dc33b04-c80b-489f-a8da-d67e301f3b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:59.230625 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-0dc33b04-c80b-489f-a8da-d67e301f3b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:12:59.232503 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1077/2105] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:12:58 2022] DELETE /identity/v3/projects/40c186841f8943fa8a3bdb5bf1210f24 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:59.238543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a095d0-f41d-407b-b974-30bda2a594d7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:59.238938 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a095d0-f41d-407b-b974-30bda2a594d7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:59.239324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a095d0-f41d-407b-b974-30bda2a594d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:59.251572 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1029/2106] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:12:59.255962 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84aa43-bb20-439d-8996-b9773a1d3488 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:59.257464 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2e84aa43-bb20-439d-8996-b9773a1d3488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:59.260808 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-41a095d0-f41d-407b-b974-30bda2a594d7 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:59.262088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-41a095d0-f41d-407b-b974-30bda2a594d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:59.316680 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:59.339477 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1078/2107] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:59.341775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebc5d6-fd7b-45cf-acb4-ff13b6e45a80 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:59.342526 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebc5d6-fd7b-45cf-acb4-ff13b6e45a80 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:59.342871 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ebc5d6-fd7b-45cf-acb4-ff13b6e45a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:59.344771 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e84aa43-bb20-439d-8996-b9773a1d3488 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:59.349298 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a61ab4-cf9e-43c1-98f9-44f9a5417cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:59.349965 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a61ab4-cf9e-43c1-98f9-44f9a5417cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:59.350248 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a61ab4-cf9e-43c1-98f9-44f9a5417cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:59.350722 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a61ab4-cf9e-43c1-98f9-44f9a5417cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:59.351249 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a61ab4-cf9e-43c1-98f9-44f9a5417cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:59.353239 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a61ab4-cf9e-43c1-98f9-44f9a5417cb6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:59.364365 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-30ebc5d6-fd7b-45cf-acb4-ff13b6e45a80 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:12:59.365893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-30ebc5d6-fd7b-45cf-acb4-ff13b6e45a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:12:59.376522 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1079/2108] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:12:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:12:59.380901 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebc5d6-fd7b-45cf-acb4-ff13b6e45a80 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:59.389238 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1030/2109] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:59 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:59.390335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a61ab4-cf9e-43c1-98f9-44f9a5417cb6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:59.397099 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ebc5d6-fd7b-45cf-acb4-ff13b6e45a80 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:59.545779 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a61ab4-cf9e-43c1-98f9-44f9a5417cb6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:59.563087 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:12:59.565537 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb46bf1-06f6-4bc4-8d79-2c9cf4dcff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:59.566250 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb46bf1-06f6-4bc4-8d79-2c9cf4dcff85 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:59.566536 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb46bf1-06f6-4bc4-8d79-2c9cf4dcff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:59.566871 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb46bf1-06f6-4bc4-8d79-2c9cf4dcff85 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:59.567612 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb46bf1-06f6-4bc4-8d79-2c9cf4dcff85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:59.573385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb46bf1-06f6-4bc4-8d79-2c9cf4dcff85 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:59.624428 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f1090-13b8-4d25-8d0f-e9a1bb2704cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:59.626914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f1090-13b8-4d25-8d0f-e9a1bb2704cd admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:59.627164 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f1090-13b8-4d25-8d0f-e9a1bb2704cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:59.632087 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1031/2110] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:59 2022] POST /identity/v3/users => generated 299 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:59.632798 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f1090-13b8-4d25-8d0f-e9a1bb2704cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:59.637184 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb46bf1-06f6-4bc4-8d79-2c9cf4dcff85 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:59.638072 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f1090-13b8-4d25-8d0f-e9a1bb2704cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:12:59.638400 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f1090-13b8-4d25-8d0f-e9a1bb2704cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:59.646982 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f1090-13b8-4d25-8d0f-e9a1bb2704cd admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:59.656889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb46bf1-06f6-4bc4-8d79-2c9cf4dcff85 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:59.672862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07820f-a645-43c0-91a4-9e9ed81f7ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:59.673855 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07820f-a645-43c0-91a4-9e9ed81f7ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:59.674666 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07820f-a645-43c0-91a4-9e9ed81f7ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:59.675575 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b07820f-a645-43c0-91a4-9e9ed81f7ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:59.678977 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07820f-a645-43c0-91a4-9e9ed81f7ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:59.680442 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1080/2111] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:12:59.681728 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f1090-13b8-4d25-8d0f-e9a1bb2704cd admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:59.683502 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b07820f-a645-43c0-91a4-9e9ed81f7ea8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:59.700235 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f1090-13b8-4d25-8d0f-e9a1bb2704cd admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:59.708907 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c8719-142c-4eb1-a7eb-d5057fc2fbd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:59.709744 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c8719-142c-4eb1-a7eb-d5057fc2fbd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:59.709976 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1032/2112] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:12:59.710220 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c8719-142c-4eb1-a7eb-d5057fc2fbd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:59.710535 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c8719-142c-4eb1-a7eb-d5057fc2fbd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:59.711328 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c8719-142c-4eb1-a7eb-d5057fc2fbd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:59.713502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c8719-142c-4eb1-a7eb-d5057fc2fbd1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:59.719233 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07820f-a645-43c0-91a4-9e9ed81f7ea8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:59.744162 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b07820f-a645-43c0-91a4-9e9ed81f7ea8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:59.750360 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456e8bd-d686-425e-ad3b-9b6bcbe6ebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:59.751191 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1081/2113] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:12:59 2022] POST /identity/v3/projects => generated 397 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:12:59.751775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456e8bd-d686-425e-ad3b-9b6bcbe6ebfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:59.752309 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456e8bd-d686-425e-ad3b-9b6bcbe6ebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:59.752754 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f456e8bd-d686-425e-ad3b-9b6bcbe6ebfb admin admin] PATH_INFO: `/v3/projects/1f8b56a808d54427b3c1923e541141c2/users/00a51f5f88c1449aa203f8f8c0a6e17b/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:59.756938 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c8719-142c-4eb1-a7eb-d5057fc2fbd1 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:59.787142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456e8bd-d686-425e-ad3b-9b6bcbe6ebfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8b56a808d54427b3c1923e541141c2, user_id=00a51f5f88c1449aa203f8f8c0a6e17b, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:59.792474 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f456e8bd-d686-425e-ad3b-9b6bcbe6ebfb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:59.845133 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1033/2114] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:59 2022] PUT /identity/v3/projects/1f8b56a808d54427b3c1923e541141c2/users/00a51f5f88c1449aa203f8f8c0a6e17b/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:12:59.849647 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456e8bd-d686-425e-ad3b-9b6bcbe6ebfb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:59.868415 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c8719-142c-4eb1-a7eb-d5057fc2fbd1 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:59.943947 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f456e8bd-d686-425e-ad3b-9b6bcbe6ebfb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:12:59.961662 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef60c5-a472-4e97-84b5-5740f5e4615f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:59.962501 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef60c5-a472-4e97-84b5-5740f5e4615f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:59.962793 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef60c5-a472-4e97-84b5-5740f5e4615f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:59.963076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef60c5-a472-4e97-84b5-5740f5e4615f admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:59.963886 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef60c5-a472-4e97-84b5-5740f5e4615f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:59.965548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef60c5-a472-4e97-84b5-5740f5e4615f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:59.965966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707c788-c519-47ac-8027-2d21350752b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:12:59.966749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707c788-c519-47ac-8027-2d21350752b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:12:59.967233 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707c788-c519-47ac-8027-2d21350752b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:12:59.967646 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1707c788-c519-47ac-8027-2d21350752b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:12:59.968446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707c788-c519-47ac-8027-2d21350752b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:12:59.970749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1707c788-c519-47ac-8027-2d21350752b0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:12:59.980922 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1034/2115] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:12:59.981901 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef60c5-a472-4e97-84b5-5740f5e4615f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:12:59.995164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef60c5-a472-4e97-84b5-5740f5e4615f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:00.005456 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3beec-f02e-4f82-b241-19c843b32709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:00.007402 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3beec-f02e-4f82-b241-19c843b32709 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:00.007873 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3beec-f02e-4f82-b241-19c843b32709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:00.008609 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a3beec-f02e-4f82-b241-19c843b32709 admin admin] PATH_INFO: `/v3/projects/1f8b56a808d54427b3c1923e541141c2/users/00a51f5f88c1449aa203f8f8c0a6e17b/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:00.011080 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3beec-f02e-4f82-b241-19c843b32709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8b56a808d54427b3c1923e541141c2, user_id=00a51f5f88c1449aa203f8f8c0a6e17b, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:00.014277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a3beec-f02e-4f82-b241-19c843b32709 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:00.023197 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1082/2116] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:12:59 2022] POST /identity/v3/users => generated 299 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:00.027345 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707c788-c519-47ac-8027-2d21350752b0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:00.029956 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1035/2117] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:12:59 2022] PUT /identity/v3/projects/1f8b56a808d54427b3c1923e541141c2/users/00a51f5f88c1449aa203f8f8c0a6e17b/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:00.046418 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1707c788-c519-47ac-8027-2d21350752b0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:00.141153 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c9360-7ec8-4af8-9e7a-a125b9c8351d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:00.141917 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c9360-7ec8-4af8-9e7a-a125b9c8351d admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:00.142203 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c9360-7ec8-4af8-9e7a-a125b9c8351d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:00.142531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1c9360-7ec8-4af8-9e7a-a125b9c8351d admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:00.143281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c9360-7ec8-4af8-9e7a-a125b9c8351d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:00.145327 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1c9360-7ec8-4af8-9e7a-a125b9c8351d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:00.148528 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:00.158950 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1083/2118] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:13:00.163750 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3beec-f02e-4f82-b241-19c843b32709 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:00.174775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:00.185476 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a3beec-f02e-4f82-b241-19c843b32709 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:00.194635 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c8686c-6fce-450a-94a1-fc86ba7707eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:00.195828 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8686c-6fce-450a-94a1-fc86ba7707eb admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:00.196330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8686c-6fce-450a-94a1-fc86ba7707eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:00.196822 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c8686c-6fce-450a-94a1-fc86ba7707eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:00.198255 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8686c-6fce-450a-94a1-fc86ba7707eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:00.200683 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c8686c-6fce-450a-94a1-fc86ba7707eb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:00.219848 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1036/2119] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:00.223281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c9360-7ec8-4af8-9e7a-a125b9c8351d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:00.234183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1c9360-7ec8-4af8-9e7a-a125b9c8351d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:00.246140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe4a7-7a59-4f07-bd0c-b0852e1831df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:00.249680 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe4a7-7a59-4f07-bd0c-b0852e1831df admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:00.249946 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe4a7-7a59-4f07-bd0c-b0852e1831df admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:00.250254 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefe4a7-7a59-4f07-bd0c-b0852e1831df admin admin] PATH_INFO: `/v3/projects/08b9ddfcf5d44dddb4ed3b7db4201f07/users/18c514d5ea6f4c8b8a6b8b0c8268b8d4/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:00.283084 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefe4a7-7a59-4f07-bd0c-b0852e1831df admin admin] RBAC: Authorizing `identity:create_grant(project_id=08b9ddfcf5d44dddb4ed3b7db4201f07, user_id=18c514d5ea6f4c8b8a6b8b0c8268b8d4, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:00.291368 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefe4a7-7a59-4f07-bd0c-b0852e1831df admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:00.328143 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1084/2120] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:00 2022] PUT /identity/v3/projects/08b9ddfcf5d44dddb4ed3b7db4201f07/users/18c514d5ea6f4c8b8a6b8b0c8268b8d4/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:00.338835 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48889-fbaa-4ba0-b712-4e5c41e73ee7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:00.339434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48889-fbaa-4ba0-b712-4e5c41e73ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:00.339685 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb48889-fbaa-4ba0-b712-4e5c41e73ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:00.374815 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-afb48889-fbaa-4ba0-b712-4e5c41e73ee7 None None] MFA Rules not processed for user `18c514d5ea6f4c8b8a6b8b0c8268b8d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:00.376091 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-afb48889-fbaa-4ba0-b712-4e5c41e73ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:00.487499 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1037/2121] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:00.499909 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe4a7-7a59-4f07-bd0c-b0852e1831df admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:00.503128 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4aefe4a7-7a59-4f07-bd0c-b0852e1831df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:00.604016 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefe4a7-7a59-4f07-bd0c-b0852e1831df admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:00.608633 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362e8c3-2c57-4aef-acaa-106b50e069e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:00.609466 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362e8c3-2c57-4aef-acaa-106b50e069e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:00.609822 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362e8c3-2c57-4aef-acaa-106b50e069e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:00.610099 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362e8c3-2c57-4aef-acaa-106b50e069e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:00.622469 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362e8c3-2c57-4aef-acaa-106b50e069e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:00.625749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362e8c3-2c57-4aef-acaa-106b50e069e9 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:00.640359 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1085/2122] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:00 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:06.289340 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb48889-fbaa-4ba0-b712-4e5c41e73ee7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:06.397810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb48889-fbaa-4ba0-b712-4e5c41e73ee7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:06.402761 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d6706-784b-479c-8b6d-a8af3a4c8f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:06.403710 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d6706-784b-479c-8b6d-a8af3a4c8f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:06.403996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d6706-784b-479c-8b6d-a8af3a4c8f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:06.404275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d6706-784b-479c-8b6d-a8af3a4c8f56 admin admin] PATH_INFO: `/v3/users/18c514d5ea6f4c8b8a6b8b0c8268b8d4` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:06.405578 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d6706-784b-479c-8b6d-a8af3a4c8f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c514d5ea6f4c8b8a6b8b0c8268b8d4)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:06.407901 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d6706-784b-479c-8b6d-a8af3a4c8f56 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:06.493131 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-312d6706-784b-479c-8b6d-a8af3a4c8f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c514d5ea6f4c8b8a6b8b0c8268b8d4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:06.494064 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-312d6706-784b-479c-8b6d-a8af3a4c8f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c514d5ea6f4c8b8a6b8b0c8268b8d4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:06.494832 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-312d6706-784b-479c-8b6d-a8af3a4c8f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c514d5ea6f4c8b8a6b8b0c8268b8d4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:06.506508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-312d6706-784b-479c-8b6d-a8af3a4c8f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c514d5ea6f4c8b8a6b8b0c8268b8d4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:06.531612 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-312d6706-784b-479c-8b6d-a8af3a4c8f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c514d5ea6f4c8b8a6b8b0c8268b8d4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:06.552424 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1038/2123] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:06 2022] DELETE /identity/v3/users/18c514d5ea6f4c8b8a6b8b0c8268b8d4 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:06.554944 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992eb5ad-c7ad-41f0-a160-267b1a04a058 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:06.555534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992eb5ad-c7ad-41f0-a160-267b1a04a058 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:06.555818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992eb5ad-c7ad-41f0-a160-267b1a04a058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:06.577962 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-992eb5ad-c7ad-41f0-a160-267b1a04a058 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:06.579479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-992eb5ad-c7ad-41f0-a160-267b1a04a058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:06.675931 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1086/2124] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:06.694938 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d6706-784b-479c-8b6d-a8af3a4c8f56 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:06.696941 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-312d6706-784b-479c-8b6d-a8af3a4c8f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:06.704297 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:06.721199 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe91dda-c9fe-4a8d-a884-f4638ad5536d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:06.721458 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe91dda-c9fe-4a8d-a884-f4638ad5536d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:06.721810 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe91dda-c9fe-4a8d-a884-f4638ad5536d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:06.764671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-dfe91dda-c9fe-4a8d-a884-f4638ad5536d None None] MFA Rules not processed for user `00a51f5f88c1449aa203f8f8c0a6e17b`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:06.766158 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-dfe91dda-c9fe-4a8d-a884-f4638ad5536d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:06.819698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d6706-784b-479c-8b6d-a8af3a4c8f56 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:06.824541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5692d-2a84-41ff-974e-b196ceb2504e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:06.825733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5692d-2a84-41ff-974e-b196ceb2504e service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:06.826029 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5692d-2a84-41ff-974e-b196ceb2504e service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:06.826383 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5692d-2a84-41ff-974e-b196ceb2504e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:06.844155 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5692d-2a84-41ff-974e-b196ceb2504e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:06.849216 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f5692d-2a84-41ff-974e-b196ceb2504e service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:06.862591 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1039/2125] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:06.875981 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1087/2126] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:06.888816 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5692d-2a84-41ff-974e-b196ceb2504e service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:06.890284 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-20f5692d-2a84-41ff-974e-b196ceb2504e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:06.955902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5692d-2a84-41ff-974e-b196ceb2504e service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:06.962042 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04672304-a63e-4c80-aeed-6eaefa18d54d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbdf910e67d4185a0ae14edf34ee3b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:06.962884 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04672304-a63e-4c80-aeed-6eaefa18d54d service glance] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:06.963164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04672304-a63e-4c80-aeed-6eaefa18d54d service glance] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:06.963473 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04672304-a63e-4c80-aeed-6eaefa18d54d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:06.968267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-04672304-a63e-4c80-aeed-6eaefa18d54d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:07.040960 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04672304-a63e-4c80-aeed-6eaefa18d54d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:07.042512 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04672304-a63e-4c80-aeed-6eaefa18d54d service glance] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:07.069516 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1040/2127] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:13:07.244406 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2342a8-6e31-4aaf-b2ee-42e810c98231 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:07.244703 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2342a8-6e31-4aaf-b2ee-42e810c98231 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:07.244987 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2342a8-6e31-4aaf-b2ee-42e810c98231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:07.254026 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:07.271588 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9c2342a8-6e31-4aaf-b2ee-42e810c98231 None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:07.272785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9c2342a8-6e31-4aaf-b2ee-42e810c98231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:07.343469 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1088/2128] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:13:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:07.396303 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04672304-a63e-4c80-aeed-6eaefa18d54d service glance] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:07.398342 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-04672304-a63e-4c80-aeed-6eaefa18d54d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:07.477593 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:07.484917 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04672304-a63e-4c80-aeed-6eaefa18d54d service glance] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:07.490762 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da1e55-a846-4bfd-843f-8bb742b99c72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:07.491528 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da1e55-a846-4bfd-843f-8bb742b99c72 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:07.491786 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da1e55-a846-4bfd-843f-8bb742b99c72 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:07.492215 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da1e55-a846-4bfd-843f-8bb742b99c72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:07.501594 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da1e55-a846-4bfd-843f-8bb742b99c72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:07.503429 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da1e55-a846-4bfd-843f-8bb742b99c72 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:07.513582 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1041/2129] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:13:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:07.834421 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2342a8-6e31-4aaf-b2ee-42e810c98231 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:07.836129 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9c2342a8-6e31-4aaf-b2ee-42e810c98231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:07.864517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2342a8-6e31-4aaf-b2ee-42e810c98231 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:07.878731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761562b1-7418-4f47-bfca-7c51dc74a5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:07.880420 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761562b1-7418-4f47-bfca-7c51dc74a5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:07.881852 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761562b1-7418-4f47-bfca-7c51dc74a5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:07.882460 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761562b1-7418-4f47-bfca-7c51dc74a5ea admin admin] PATH_INFO: `/v3/projects/08b9ddfcf5d44dddb4ed3b7db4201f07` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:07.887498 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761562b1-7418-4f47-bfca-7c51dc74a5ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=08b9ddfcf5d44dddb4ed3b7db4201f07)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:07.894771 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761562b1-7418-4f47-bfca-7c51dc74a5ea admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:08.050141 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-761562b1-7418-4f47-bfca-7c51dc74a5ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08b9ddfcf5d44dddb4ed3b7db4201f07', 'request_id': 'req-761562b1-7418-4f47-bfca-7c51dc74a5ea'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:08.076289 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-761562b1-7418-4f47-bfca-7c51dc74a5ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08b9ddfcf5d44dddb4ed3b7db4201f07', 'request_id': 'req-761562b1-7418-4f47-bfca-7c51dc74a5ea'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:08.108029 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-761562b1-7418-4f47-bfca-7c51dc74a5ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08b9ddfcf5d44dddb4ed3b7db4201f07', 'request_id': 'req-761562b1-7418-4f47-bfca-7c51dc74a5ea'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:08.140171 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-761562b1-7418-4f47-bfca-7c51dc74a5ea admin admin] The token cache is being invalidate because project 08b9ddfcf5d44dddb4ed3b7db4201f07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:08.141763 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-761562b1-7418-4f47-bfca-7c51dc74a5ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:08.142516 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-761562b1-7418-4f47-bfca-7c51dc74a5ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:08.146248 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1089/2130] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:07 2022] DELETE /identity/v3/projects/08b9ddfcf5d44dddb4ed3b7db4201f07 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:11.979536 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efa97a-2054-4445-8f12-100429ede6fc None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:11.980143 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efa97a-2054-4445-8f12-100429ede6fc None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:11.985005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5efa97a-2054-4445-8f12-100429ede6fc None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:11.986035 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1042/2131] 10.222.0.42 () {54 vars in 921 bytes} [Sun Jul 24 01:13:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:13:11.999620 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a991d-5b99-4303-9490-b233278268e2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:12.000249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a991d-5b99-4303-9490-b233278268e2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:12.000249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a991d-5b99-4303-9490-b233278268e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:12.042340 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-071a991d-5b99-4303-9490-b233278268e2 None None] MFA Rules not processed for user `333db0711d0f41fe8066ba5b9d91dacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:12.044153 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-071a991d-5b99-4303-9490-b233278268e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:12.100080 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efa97a-2054-4445-8f12-100429ede6fc None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:12.102182 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b5efa97a-2054-4445-8f12-100429ede6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:12.222513 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5efa97a-2054-4445-8f12-100429ede6fc None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:12.222715 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1090/2132] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Jul 24 01:13:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:12.227424 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccf94a9-a14d-46fc-831d-8166390e5cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:12.228323 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf94a9-a14d-46fc-831d-8166390e5cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:12.229269 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf94a9-a14d-46fc-831d-8166390e5cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:12.229269 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccf94a9-a14d-46fc-831d-8166390e5cd5 admin admin] PATH_INFO: `/v3/users/2d7d2c987db04aaabc0d75c1930f9c6f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:12.230196 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf94a9-a14d-46fc-831d-8166390e5cd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7d2c987db04aaabc0d75c1930f9c6f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:12.231121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a991d-5b99-4303-9490-b233278268e2 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:12.232366 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccf94a9-a14d-46fc-831d-8166390e5cd5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:12.234928 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-071a991d-5b99-4303-9490-b233278268e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:12.251468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a991d-5b99-4303-9490-b233278268e2 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:12.260359 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1aba1-27b1-4a51-ae91-c6cadba81272 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333db0711d0f41fe8066ba5b9d91dacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:12.261790 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1aba1-27b1-4a51-ae91-c6cadba81272 service placement] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:12.262487 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1aba1-27b1-4a51-ae91-c6cadba81272 service placement] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:12.263075 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f1aba1-27b1-4a51-ae91-c6cadba81272 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:12.275577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1aba1-27b1-4a51-ae91-c6cadba81272 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:12.278426 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f1aba1-27b1-4a51-ae91-c6cadba81272 service placement] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:12.291016 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1091/2133] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:12.298627 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1ccf94a9-a14d-46fc-831d-8166390e5cd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7d2c987db04aaabc0d75c1930f9c6f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:12.299569 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1ccf94a9-a14d-46fc-831d-8166390e5cd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7d2c987db04aaabc0d75c1930f9c6f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:12.300776 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1ccf94a9-a14d-46fc-831d-8166390e5cd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7d2c987db04aaabc0d75c1930f9c6f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:12.309309 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1ccf94a9-a14d-46fc-831d-8166390e5cd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7d2c987db04aaabc0d75c1930f9c6f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:12.338408 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1ccf94a9-a14d-46fc-831d-8166390e5cd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7d2c987db04aaabc0d75c1930f9c6f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:12.374893 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1043/2134] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:12 2022] DELETE /identity/v3/users/2d7d2c987db04aaabc0d75c1930f9c6f => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:12.688807 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1aba1-27b1-4a51-ae91-c6cadba81272 service placement] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:12.712224 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f1aba1-27b1-4a51-ae91-c6cadba81272 service placement] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:12.730238 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:12.822607 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e376979-ec9f-45cc-9133-aef84032201d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:12.823959 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e376979-ec9f-45cc-9133-aef84032201d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:12.824076 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e376979-ec9f-45cc-9133-aef84032201d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:12.824291 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e376979-ec9f-45cc-9133-aef84032201d admin admin] PATH_INFO: `/v3/projects/e076ee7a9aba4327977e47cd15f4d598` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:12.825743 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e376979-ec9f-45cc-9133-aef84032201d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e076ee7a9aba4327977e47cd15f4d598)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:12.828053 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e376979-ec9f-45cc-9133-aef84032201d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:12.913624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9e376979-ec9f-45cc-9133-aef84032201d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e076ee7a9aba4327977e47cd15f4d598', 'request_id': 'req-9e376979-ec9f-45cc-9133-aef84032201d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:12.921170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9e376979-ec9f-45cc-9133-aef84032201d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e076ee7a9aba4327977e47cd15f4d598', 'request_id': 'req-9e376979-ec9f-45cc-9133-aef84032201d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:12.935722 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9e376979-ec9f-45cc-9133-aef84032201d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e076ee7a9aba4327977e47cd15f4d598', 'request_id': 'req-9e376979-ec9f-45cc-9133-aef84032201d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:12.975137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9e376979-ec9f-45cc-9133-aef84032201d admin admin] The token cache is being invalidate because project e076ee7a9aba4327977e47cd15f4d598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:12.975583 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9e376979-ec9f-45cc-9133-aef84032201d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:12.976167 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9e376979-ec9f-45cc-9133-aef84032201d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:12.978207 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1092/2135] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:12 2022] DELETE /identity/v3/projects/e076ee7a9aba4327977e47cd15f4d598 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:12.982899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf17840-ae7e-4e6d-ad3e-eb5d97362d82 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:12.983465 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf17840-ae7e-4e6d-ad3e-eb5d97362d82 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:12.983579 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf17840-ae7e-4e6d-ad3e-eb5d97362d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.009204 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-fdf17840-ae7e-4e6d-ad3e-eb5d97362d82 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:13.011270 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fdf17840-ae7e-4e6d-ad3e-eb5d97362d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:13.100349 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1044/2136] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:13.117626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816dc1a-8bcd-4d93-86da-782b859094e3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.118261 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816dc1a-8bcd-4d93-86da-782b859094e3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.118261 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b816dc1a-8bcd-4d93-86da-782b859094e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.132736 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf17840-ae7e-4e6d-ad3e-eb5d97362d82 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:13.137434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-fdf17840-ae7e-4e6d-ad3e-eb5d97362d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:13.156496 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b816dc1a-8bcd-4d93-86da-782b859094e3 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:13.159909 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:13.163127 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b816dc1a-8bcd-4d93-86da-782b859094e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:13.179049 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1093/2137] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:13.183261 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816dc1a-8bcd-4d93-86da-782b859094e3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:13.201583 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b816dc1a-8bcd-4d93-86da-782b859094e3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:13.212372 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa094ab-8cde-4c76-a73c-fb262a09d207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:13.213066 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa094ab-8cde-4c76-a73c-fb262a09d207 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.213351 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa094ab-8cde-4c76-a73c-fb262a09d207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.213631 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa094ab-8cde-4c76-a73c-fb262a09d207 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.214376 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa094ab-8cde-4c76-a73c-fb262a09d207 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:13.214695 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa094ab-8cde-4c76-a73c-fb262a09d207 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:13.222931 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa094ab-8cde-4c76-a73c-fb262a09d207 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:13.273619 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1094/2138] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:13:13.274652 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa094ab-8cde-4c76-a73c-fb262a09d207 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:13.308215 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa094ab-8cde-4c76-a73c-fb262a09d207 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:13.310571 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf17840-ae7e-4e6d-ad3e-eb5d97362d82 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:13.317633 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e12f83-966c-4d65-931f-28c27edf8b4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:13.318316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e12f83-966c-4d65-931f-28c27edf8b4b service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.318692 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e12f83-966c-4d65-931f-28c27edf8b4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.319010 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e12f83-966c-4d65-931f-28c27edf8b4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.320657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a084d-c2a7-4492-8c2f-63156be1fb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:13.321534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a084d-c2a7-4492-8c2f-63156be1fb0f admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.321972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a084d-c2a7-4492-8c2f-63156be1fb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.322400 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a084d-c2a7-4492-8c2f-63156be1fb0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.323246 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a084d-c2a7-4492-8c2f-63156be1fb0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:13.324400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-06e12f83-966c-4d65-931f-28c27edf8b4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:13.325953 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a084d-c2a7-4492-8c2f-63156be1fb0f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:13.388468 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1095/2139] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:13 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:13.399983 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a084d-c2a7-4492-8c2f-63156be1fb0f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:13.447273 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e12f83-966c-4d65-931f-28c27edf8b4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:13.451449 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e12f83-966c-4d65-931f-28c27edf8b4b service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:13.477876 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1045/2140] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:13.534059 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a084d-c2a7-4492-8c2f-63156be1fb0f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:13.542976 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc3791-9ec2-4228-946c-72775c66ee86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:13.544061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc3791-9ec2-4228-946c-72775c66ee86 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.544996 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc3791-9ec2-4228-946c-72775c66ee86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.545378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afc3791-9ec2-4228-946c-72775c66ee86 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.546622 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc3791-9ec2-4228-946c-72775c66ee86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:13.550414 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afc3791-9ec2-4228-946c-72775c66ee86 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:13.571202 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:13.610280 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1096/2141] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:13 2022] POST /identity/v3/users => generated 286 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:13.618389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e12f83-966c-4d65-931f-28c27edf8b4b service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:13.672374 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e12f83-966c-4d65-931f-28c27edf8b4b service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:13.678924 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a065e87-b6d1-4164-99fe-6c115c380f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:13.680383 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a065e87-b6d1-4164-99fe-6c115c380f1b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.680709 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a065e87-b6d1-4164-99fe-6c115c380f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.681885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a065e87-b6d1-4164-99fe-6c115c380f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.683362 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a065e87-b6d1-4164-99fe-6c115c380f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:13.684599 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a065e87-b6d1-4164-99fe-6c115c380f1b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:13.704183 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1046/2142] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:13.708280 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc3791-9ec2-4228-946c-72775c66ee86 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:13.723233 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afc3791-9ec2-4228-946c-72775c66ee86 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:13.735434 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95c808-117a-48e4-8979-9e556a8af9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:13.736749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95c808-117a-48e4-8979-9e556a8af9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.737031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95c808-117a-48e4-8979-9e556a8af9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.737295 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95c808-117a-48e4-8979-9e556a8af9a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.738041 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95c808-117a-48e4-8979-9e556a8af9a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:13.739739 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95c808-117a-48e4-8979-9e556a8af9a7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:13.771764 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1097/2143] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:13.775658 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a065e87-b6d1-4164-99fe-6c115c380f1b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:13.809753 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a065e87-b6d1-4164-99fe-6c115c380f1b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:13.822421 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198ea45-236b-415f-a4eb-a0ca68f9faf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:13.823652 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198ea45-236b-415f-a4eb-a0ca68f9faf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.824151 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198ea45-236b-415f-a4eb-a0ca68f9faf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.824636 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4198ea45-236b-415f-a4eb-a0ca68f9faf4 admin admin] PATH_INFO: `/v3/projects/f576248489914969938c925a145bcf8c/users/2cd1aa73539e41269b1e99037713383e/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.843992 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198ea45-236b-415f-a4eb-a0ca68f9faf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f576248489914969938c925a145bcf8c, user_id=2cd1aa73539e41269b1e99037713383e, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:13.847707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4198ea45-236b-415f-a4eb-a0ca68f9faf4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:13.887919 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1047/2144] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:13 2022] PUT /identity/v3/projects/f576248489914969938c925a145bcf8c/users/2cd1aa73539e41269b1e99037713383e/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:13.889480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3b05c-849a-4fb0-bde2-e9490231a94d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:13.889836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3b05c-849a-4fb0-bde2-e9490231a94d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:13.890378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3b05c-849a-4fb0-bde2-e9490231a94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:13.949829 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a6a3b05c-849a-4fb0-bde2-e9490231a94d None None] MFA Rules not processed for user `2cd1aa73539e41269b1e99037713383e`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:13.953312 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a6a3b05c-849a-4fb0-bde2-e9490231a94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:14.092919 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1098/2145] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:14.097598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198ea45-236b-415f-a4eb-a0ca68f9faf4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:14.206853 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4198ea45-236b-415f-a4eb-a0ca68f9faf4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:14.212840 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb4df5-14fc-4fa8-bb80-8ecea931803a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:14.214018 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb4df5-14fc-4fa8-bb80-8ecea931803a admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:14.214318 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb4df5-14fc-4fa8-bb80-8ecea931803a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:14.214584 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb4df5-14fc-4fa8-bb80-8ecea931803a admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:14.216409 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb4df5-14fc-4fa8-bb80-8ecea931803a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:14.220663 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb4df5-14fc-4fa8-bb80-8ecea931803a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:14.267364 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1048/2146] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:14 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:14.271215 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3b05c-849a-4fb0-bde2-e9490231a94d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:14.290772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3b05c-849a-4fb0-bde2-e9490231a94d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:14.376489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79c3fc-1b1d-4607-8098-af933e399c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:14.378947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79c3fc-1b1d-4607-8098-af933e399c2b admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:14.378947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79c3fc-1b1d-4607-8098-af933e399c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:14.378947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea79c3fc-1b1d-4607-8098-af933e399c2b admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:14.378947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79c3fc-1b1d-4607-8098-af933e399c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:14.380497 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea79c3fc-1b1d-4607-8098-af933e399c2b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:14.403930 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1099/2147] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:14 2022] POST /identity/v3/users => generated 293 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:14.407923 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb4df5-14fc-4fa8-bb80-8ecea931803a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:14.420730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb4df5-14fc-4fa8-bb80-8ecea931803a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:14.425910 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad860a-1c7b-4e96-8624-f0b6c2731a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:14.426983 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad860a-1c7b-4e96-8624-f0b6c2731a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:14.427492 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad860a-1c7b-4e96-8624-f0b6c2731a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:14.428147 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ad860a-1c7b-4e96-8624-f0b6c2731a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:14.428964 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad860a-1c7b-4e96-8624-f0b6c2731a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:14.430597 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ad860a-1c7b-4e96-8624-f0b6c2731a51 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:14.433090 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:14.445850 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1049/2148] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:14.449724 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79c3fc-1b1d-4607-8098-af933e399c2b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:14.462575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea79c3fc-1b1d-4607-8098-af933e399c2b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:14.479734 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad93ed-9fde-44e0-8661-9a2e99532b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:14.480843 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad93ed-9fde-44e0-8661-9a2e99532b31 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:14.481798 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad93ed-9fde-44e0-8661-9a2e99532b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:14.481946 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad93ed-9fde-44e0-8661-9a2e99532b31 admin admin] PATH_INFO: `/v3/projects/3514f9ecf48e49e6a05c6e8f1ad4fbcd/users/3dfbd1a3507c4337840f87461f434150/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:14.502499 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad93ed-9fde-44e0-8661-9a2e99532b31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3514f9ecf48e49e6a05c6e8f1ad4fbcd, user_id=3dfbd1a3507c4337840f87461f434150, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:14.505434 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bad93ed-9fde-44e0-8661-9a2e99532b31 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:14.529518 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1100/2149] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:14 2022] PUT /identity/v3/projects/3514f9ecf48e49e6a05c6e8f1ad4fbcd/users/3dfbd1a3507c4337840f87461f434150/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:14.530717 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad860a-1c7b-4e96-8624-f0b6c2731a51 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:14.541273 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ad860a-1c7b-4e96-8624-f0b6c2731a51 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:14.634888 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54a11d-1223-4b16-97f4-e52c87f6ba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:14.635962 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54a11d-1223-4b16-97f4-e52c87f6ba01 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:14.635962 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54a11d-1223-4b16-97f4-e52c87f6ba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:14.636319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54a11d-1223-4b16-97f4-e52c87f6ba01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:14.637114 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54a11d-1223-4b16-97f4-e52c87f6ba01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:14.638798 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e54a11d-1223-4b16-97f4-e52c87f6ba01 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:14.654882 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1050/2150] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:14.659028 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad93ed-9fde-44e0-8661-9a2e99532b31 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:14.674953 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad93ed-9fde-44e0-8661-9a2e99532b31 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:14.684406 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0cf46-ba0f-4ebb-906d-00cc25948499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:14.685555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0cf46-ba0f-4ebb-906d-00cc25948499 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:14.685956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0cf46-ba0f-4ebb-906d-00cc25948499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:14.686670 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d0cf46-ba0f-4ebb-906d-00cc25948499 admin admin] PATH_INFO: `/v3/projects/3514f9ecf48e49e6a05c6e8f1ad4fbcd/users/3dfbd1a3507c4337840f87461f434150/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:14.689150 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0cf46-ba0f-4ebb-906d-00cc25948499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3514f9ecf48e49e6a05c6e8f1ad4fbcd, user_id=3dfbd1a3507c4337840f87461f434150, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:14.693198 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d0cf46-ba0f-4ebb-906d-00cc25948499 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:14.707034 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1101/2151] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:14 2022] PUT /identity/v3/projects/3514f9ecf48e49e6a05c6e8f1ad4fbcd/users/3dfbd1a3507c4337840f87461f434150/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:14.717609 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0d930-0eff-44c2-b640-7c4ea42e689e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:14.717902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0d930-0eff-44c2-b640-7c4ea42e689e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:14.718211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0d930-0eff-44c2-b640-7c4ea42e689e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:14.749704 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-59d0d930-0eff-44c2-b640-7c4ea42e689e None None] MFA Rules not processed for user `3dfbd1a3507c4337840f87461f434150`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:14.750853 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-59d0d930-0eff-44c2-b640-7c4ea42e689e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:14.862641 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1051/2152] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:14.875148 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0cf46-ba0f-4ebb-906d-00cc25948499 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:14.882678 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-12d0cf46-ba0f-4ebb-906d-00cc25948499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:14.914256 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:14.953033 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d0cf46-ba0f-4ebb-906d-00cc25948499 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:14.957273 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f1458b-5264-4fd9-ac84-ad7825330ce9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:14.959383 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1458b-5264-4fd9-ac84-ad7825330ce9 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:14.960227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1458b-5264-4fd9-ac84-ad7825330ce9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:14.960227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f1458b-5264-4fd9-ac84-ad7825330ce9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:14.970545 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1458b-5264-4fd9-ac84-ad7825330ce9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:14.972473 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f1458b-5264-4fd9-ac84-ad7825330ce9 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:14.984082 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1102/2153] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:14 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:15.479465 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0d930-0eff-44c2-b640-7c4ea42e689e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:15.564638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0d930-0eff-44c2-b640-7c4ea42e689e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:15.570120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f9f51-b913-41ed-8887-d8bcb8955dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:15.571014 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f9f51-b913-41ed-8887-d8bcb8955dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:15.571323 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f9f51-b913-41ed-8887-d8bcb8955dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:15.571598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937f9f51-b913-41ed-8887-d8bcb8955dd4 admin admin] PATH_INFO: `/v3/users/2cd1aa73539e41269b1e99037713383e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:15.572849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f9f51-b913-41ed-8887-d8bcb8955dd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cd1aa73539e41269b1e99037713383e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:15.574814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937f9f51-b913-41ed-8887-d8bcb8955dd4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:15.602716 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:15.639977 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-937f9f51-b913-41ed-8887-d8bcb8955dd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cd1aa73539e41269b1e99037713383e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:15.640725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-937f9f51-b913-41ed-8887-d8bcb8955dd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cd1aa73539e41269b1e99037713383e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:15.641432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-937f9f51-b913-41ed-8887-d8bcb8955dd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cd1aa73539e41269b1e99037713383e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:15.651306 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-937f9f51-b913-41ed-8887-d8bcb8955dd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cd1aa73539e41269b1e99037713383e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:15.663955 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-937f9f51-b913-41ed-8887-d8bcb8955dd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cd1aa73539e41269b1e99037713383e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:15.681144 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1052/2154] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:15 2022] DELETE /identity/v3/users/2cd1aa73539e41269b1e99037713383e => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:15.685799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2598c-0189-416a-9f6f-e2969a1d9bcc None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:15.686263 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2598c-0189-416a-9f6f-e2969a1d9bcc None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:15.686358 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2598c-0189-416a-9f6f-e2969a1d9bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:15.707108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-bcf2598c-0189-416a-9f6f-e2969a1d9bcc None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:15.708413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bcf2598c-0189-416a-9f6f-e2969a1d9bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:15.770022 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1103/2155] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:15.780661 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f9f51-b913-41ed-8887-d8bcb8955dd4 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:15.782160 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-937f9f51-b913-41ed-8887-d8bcb8955dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:15.864165 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937f9f51-b913-41ed-8887-d8bcb8955dd4 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:15.894309 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffb172-b139-4fa6-85f8-ded7cc53695a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:15.894999 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffb172-b139-4fa6-85f8-ded7cc53695a service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:15.895288 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffb172-b139-4fa6-85f8-ded7cc53695a service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:15.895591 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffb172-b139-4fa6-85f8-ded7cc53695a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:15.915478 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffb172-b139-4fa6-85f8-ded7cc53695a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:15.916966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffb172-b139-4fa6-85f8-ded7cc53695a service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:15.944009 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1053/2156] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:16.378799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2598c-0189-416a-9f6f-e2969a1d9bcc None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:16.381681 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bcf2598c-0189-416a-9f6f-e2969a1d9bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:16.399609 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2598c-0189-416a-9f6f-e2969a1d9bcc None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:16.405038 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040f55b-8f9f-47ac-a671-52cd93cdae27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:16.406380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040f55b-8f9f-47ac-a671-52cd93cdae27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:16.406795 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040f55b-8f9f-47ac-a671-52cd93cdae27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:16.407248 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c040f55b-8f9f-47ac-a671-52cd93cdae27 admin admin] PATH_INFO: `/v3/projects/f576248489914969938c925a145bcf8c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:16.409163 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040f55b-8f9f-47ac-a671-52cd93cdae27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f576248489914969938c925a145bcf8c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:16.412087 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c040f55b-8f9f-47ac-a671-52cd93cdae27 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:16.481882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c040f55b-8f9f-47ac-a671-52cd93cdae27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f576248489914969938c925a145bcf8c', 'request_id': 'req-c040f55b-8f9f-47ac-a671-52cd93cdae27'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:16.496244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c040f55b-8f9f-47ac-a671-52cd93cdae27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f576248489914969938c925a145bcf8c', 'request_id': 'req-c040f55b-8f9f-47ac-a671-52cd93cdae27'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:16.497635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c040f55b-8f9f-47ac-a671-52cd93cdae27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f576248489914969938c925a145bcf8c', 'request_id': 'req-c040f55b-8f9f-47ac-a671-52cd93cdae27'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:16.516838 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c040f55b-8f9f-47ac-a671-52cd93cdae27 admin admin] The token cache is being invalidate because project f576248489914969938c925a145bcf8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:16.517421 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c040f55b-8f9f-47ac-a671-52cd93cdae27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:16.519437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c040f55b-8f9f-47ac-a671-52cd93cdae27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:16.520780 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1104/2157] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:16 2022] DELETE /identity/v3/projects/f576248489914969938c925a145bcf8c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:16.524936 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffb172-b139-4fa6-85f8-ded7cc53695a service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:16.538291 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffb172-b139-4fa6-85f8-ded7cc53695a service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:16.617698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a712309d-71f1-48e7-a410-fe47525e48c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:16.619525 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712309d-71f1-48e7-a410-fe47525e48c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:16.619911 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712309d-71f1-48e7-a410-fe47525e48c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:16.620313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a712309d-71f1-48e7-a410-fe47525e48c4 admin admin] PATH_INFO: `/v3/users/3dfbd1a3507c4337840f87461f434150` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:16.621766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712309d-71f1-48e7-a410-fe47525e48c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dfbd1a3507c4337840f87461f434150)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:16.624622 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a712309d-71f1-48e7-a410-fe47525e48c4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:16.686790 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:16.690139 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a712309d-71f1-48e7-a410-fe47525e48c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dfbd1a3507c4337840f87461f434150'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:16.691211 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a712309d-71f1-48e7-a410-fe47525e48c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dfbd1a3507c4337840f87461f434150'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:16.692052 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a712309d-71f1-48e7-a410-fe47525e48c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dfbd1a3507c4337840f87461f434150'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:16.704706 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a712309d-71f1-48e7-a410-fe47525e48c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dfbd1a3507c4337840f87461f434150'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:16.720142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-a712309d-71f1-48e7-a410-fe47525e48c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dfbd1a3507c4337840f87461f434150'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:16.739439 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1054/2158] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:16 2022] DELETE /identity/v3/users/3dfbd1a3507c4337840f87461f434150 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:17.088999 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040f55b-8f9f-47ac-a671-52cd93cdae27 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:17.090517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c040f55b-8f9f-47ac-a671-52cd93cdae27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:17.113436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c040f55b-8f9f-47ac-a671-52cd93cdae27 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:17.179730 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:17.207098 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0bfe8-f071-4480-a3eb-aa04b99e4159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:17.208278 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0bfe8-f071-4480-a3eb-aa04b99e4159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.208572 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0bfe8-f071-4480-a3eb-aa04b99e4159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.208850 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0bfe8-f071-4480-a3eb-aa04b99e4159 admin admin] PATH_INFO: `/v3/projects/3514f9ecf48e49e6a05c6e8f1ad4fbcd` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:17.210169 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0bfe8-f071-4480-a3eb-aa04b99e4159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3514f9ecf48e49e6a05c6e8f1ad4fbcd)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:17.212222 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0bfe8-f071-4480-a3eb-aa04b99e4159 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:17.268924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2ef0bfe8-f071-4480-a3eb-aa04b99e4159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3514f9ecf48e49e6a05c6e8f1ad4fbcd', 'request_id': 'req-2ef0bfe8-f071-4480-a3eb-aa04b99e4159'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:17.276287 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2ef0bfe8-f071-4480-a3eb-aa04b99e4159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3514f9ecf48e49e6a05c6e8f1ad4fbcd', 'request_id': 'req-2ef0bfe8-f071-4480-a3eb-aa04b99e4159'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:17.283623 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2ef0bfe8-f071-4480-a3eb-aa04b99e4159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3514f9ecf48e49e6a05c6e8f1ad4fbcd', 'request_id': 'req-2ef0bfe8-f071-4480-a3eb-aa04b99e4159'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:17.307006 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2ef0bfe8-f071-4480-a3eb-aa04b99e4159 admin admin] The token cache is being invalidate because project 3514f9ecf48e49e6a05c6e8f1ad4fbcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:17.307926 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2ef0bfe8-f071-4480-a3eb-aa04b99e4159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:17.308616 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-2ef0bfe8-f071-4480-a3eb-aa04b99e4159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:17.314426 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1105/2159] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:17 2022] DELETE /identity/v3/projects/3514f9ecf48e49e6a05c6e8f1ad4fbcd => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:17.318654 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ead59e-394c-46c6-abf7-36bef7ebb94a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.319048 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ead59e-394c-46c6-abf7-36bef7ebb94a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.319518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ead59e-394c-46c6-abf7-36bef7ebb94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:17.343871 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d7ead59e-394c-46c6-abf7-36bef7ebb94a None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:17.348201 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d7ead59e-394c-46c6-abf7-36bef7ebb94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:17.497543 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1055/2160] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:17.506496 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123e63d-f29e-4438-b32c-0cc07992f168 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.506837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123e63d-f29e-4438-b32c-0cc07992f168 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.507132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123e63d-f29e-4438-b32c-0cc07992f168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:17.527454 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-8123e63d-f29e-4438-b32c-0cc07992f168 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:17.532089 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8123e63d-f29e-4438-b32c-0cc07992f168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:17.533031 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ead59e-394c-46c6-abf7-36bef7ebb94a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:17.535432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d7ead59e-394c-46c6-abf7-36bef7ebb94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:17.550961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ead59e-394c-46c6-abf7-36bef7ebb94a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:17.555714 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1106/2161] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:17.557373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f2fdd1-a3f1-4a32-9bff-75655a57db67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:17.558636 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2fdd1-a3f1-4a32-9bff-75655a57db67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.559371 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2fdd1-a3f1-4a32-9bff-75655a57db67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.559855 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f2fdd1-a3f1-4a32-9bff-75655a57db67 admin admin] PATH_INFO: `/v3/users/df71ddf05f07423ba5c0a7a8881ae737` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:17.560172 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123e63d-f29e-4438-b32c-0cc07992f168 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:17.561687 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2fdd1-a3f1-4a32-9bff-75655a57db67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df71ddf05f07423ba5c0a7a8881ae737)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:17.564572 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f2fdd1-a3f1-4a32-9bff-75655a57db67 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:17.571485 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123e63d-f29e-4438-b32c-0cc07992f168 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:17.582227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb5cf9-e039-4c68-9c92-fa6d6fac1c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:17.583033 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb5cf9-e039-4c68-9c92-fa6d6fac1c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.583349 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb5cf9-e039-4c68-9c92-fa6d6fac1c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.583633 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb5cf9-e039-4c68-9c92-fa6d6fac1c2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:17.584556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb5cf9-e039-4c68-9c92-fa6d6fac1c2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:17.584900 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb5cf9-e039-4c68-9c92-fa6d6fac1c2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:17.586546 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb5cf9-e039-4c68-9c92-fa6d6fac1c2a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:17.602736 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1107/2162] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:13:17.603930 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb5cf9-e039-4c68-9c92-fa6d6fac1c2a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:17.622407 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb5cf9-e039-4c68-9c92-fa6d6fac1c2a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:17.633184 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad80da-0114-44e3-bd03-70d3108d638a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:17.634153 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad80da-0114-44e3-bd03-70d3108d638a admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.634860 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad80da-0114-44e3-bd03-70d3108d638a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.635072 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad80da-0114-44e3-bd03-70d3108d638a admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:17.635919 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad80da-0114-44e3-bd03-70d3108d638a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:17.638561 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad80da-0114-44e3-bd03-70d3108d638a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:17.659086 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53f2fdd1-a3f1-4a32-9bff-75655a57db67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df71ddf05f07423ba5c0a7a8881ae737'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:17.659986 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53f2fdd1-a3f1-4a32-9bff-75655a57db67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df71ddf05f07423ba5c0a7a8881ae737'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:17.660629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53f2fdd1-a3f1-4a32-9bff-75655a57db67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df71ddf05f07423ba5c0a7a8881ae737'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:17.670185 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53f2fdd1-a3f1-4a32-9bff-75655a57db67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df71ddf05f07423ba5c0a7a8881ae737'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:17.703474 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53f2fdd1-a3f1-4a32-9bff-75655a57db67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df71ddf05f07423ba5c0a7a8881ae737'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:17.704529 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1108/2163] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:17 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:17.711132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad80da-0114-44e3-bd03-70d3108d638a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:17.714908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ddad80da-0114-44e3-bd03-70d3108d638a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:17.724186 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1056/2164] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:17 2022] DELETE /identity/v3/users/df71ddf05f07423ba5c0a7a8881ae737 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:17.728835 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abb348-224b-4724-a476-811e9e76866a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.729392 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abb348-224b-4724-a476-811e9e76866a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.729883 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abb348-224b-4724-a476-811e9e76866a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:17.753421 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d8abb348-224b-4724-a476-811e9e76866a None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:17.755429 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d8abb348-224b-4724-a476-811e9e76866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:17.824321 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:17.843548 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad80da-0114-44e3-bd03-70d3108d638a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:17.893835 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:17.897541 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1057/2165] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:17.909728 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abb348-224b-4724-a476-811e9e76866a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:17.911801 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d8abb348-224b-4724-a476-811e9e76866a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:17.919517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb1c02-e524-4332-b4af-9876dee9abb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:17.920766 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb1c02-e524-4332-b4af-9876dee9abb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.921075 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb1c02-e524-4332-b4af-9876dee9abb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.921409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb1c02-e524-4332-b4af-9876dee9abb0 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:17.922144 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb1c02-e524-4332-b4af-9876dee9abb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:17.924902 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb1c02-e524-4332-b4af-9876dee9abb0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:17.949436 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1109/2166] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:17 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:17.954134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb1c02-e524-4332-b4af-9876dee9abb0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:17.966010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb1c02-e524-4332-b4af-9876dee9abb0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:17.972423 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa49b71-b1ef-4f50-a7e4-f73857dc8d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:17.973110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa49b71-b1ef-4f50-a7e4-f73857dc8d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.973395 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa49b71-b1ef-4f50-a7e4-f73857dc8d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.973677 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa49b71-b1ef-4f50-a7e4-f73857dc8d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:17.974554 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa49b71-b1ef-4f50-a7e4-f73857dc8d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:17.976277 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa49b71-b1ef-4f50-a7e4-f73857dc8d71 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:17.986744 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abb348-224b-4724-a476-811e9e76866a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:17.990667 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1110/2167] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:13:17.991968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa49b71-b1ef-4f50-a7e4-f73857dc8d71 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:17.994610 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166784f-d224-455d-8c10-9842d0cd3ef2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:17.995511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166784f-d224-455d-8c10-9842d0cd3ef2 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:17.996913 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166784f-d224-455d-8c10-9842d0cd3ef2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:17.997340 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166784f-d224-455d-8c10-9842d0cd3ef2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.002756 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa49b71-b1ef-4f50-a7e4-f73857dc8d71 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:18.010360 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166784f-d224-455d-8c10-9842d0cd3ef2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:18.012509 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166784f-d224-455d-8c10-9842d0cd3ef2 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:18.017783 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e4326-d8f3-4f10-9e4d-5c5ea08b7f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:18.018472 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e4326-d8f3-4f10-9e4d-5c5ea08b7f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:18.018754 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e4326-d8f3-4f10-9e4d-5c5ea08b7f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:18.019028 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e4326-d8f3-4f10-9e4d-5c5ea08b7f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.019807 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e4326-d8f3-4f10-9e4d-5c5ea08b7f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:18.021726 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230e4326-d8f3-4f10-9e4d-5c5ea08b7f93 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:18.028986 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1058/2168] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:18.053952 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166784f-d224-455d-8c10-9842d0cd3ef2 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:18.054360 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1111/2169] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:13:18.074158 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166784f-d224-455d-8c10-9842d0cd3ef2 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:18.079584 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe97f92-bcaf-49d4-9100-91aa77218128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:18.080865 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe97f92-bcaf-49d4-9100-91aa77218128 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:18.081293 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe97f92-bcaf-49d4-9100-91aa77218128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:18.081712 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe97f92-bcaf-49d4-9100-91aa77218128 admin admin] PATH_INFO: `/v3/projects/d3aeba794eaf4d7a862a746d92b357ff/users/11bad26a5c9449e0853d79f03692afbc/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.109166 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe97f92-bcaf-49d4-9100-91aa77218128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3aeba794eaf4d7a862a746d92b357ff, user_id=11bad26a5c9449e0853d79f03692afbc, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:18.113606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe97f92-bcaf-49d4-9100-91aa77218128 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:18.150667 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b6fbd-57f8-4d37-80be-893d2866a362 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:18.151259 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b6fbd-57f8-4d37-80be-893d2866a362 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:18.151481 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b6fbd-57f8-4d37-80be-893d2866a362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.152936 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1059/2170] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:18 2022] PUT /identity/v3/projects/d3aeba794eaf4d7a862a746d92b357ff/users/11bad26a5c9449e0853d79f03692afbc/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:18.186536 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2f3b6fbd-57f8-4d37-80be-893d2866a362 None None] MFA Rules not processed for user `11bad26a5c9449e0853d79f03692afbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:18.187978 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2f3b6fbd-57f8-4d37-80be-893d2866a362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:18.277626 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe97f92-bcaf-49d4-9100-91aa77218128 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:18.280477 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1112/2171] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:18.369107 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe97f92-bcaf-49d4-9100-91aa77218128 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:18.374605 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d19535-05d7-43f1-aad1-6f82a84a0ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:18.375400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d19535-05d7-43f1-aad1-6f82a84a0ab2 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:18.375755 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d19535-05d7-43f1-aad1-6f82a84a0ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:18.376099 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d19535-05d7-43f1-aad1-6f82a84a0ab2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.377270 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d19535-05d7-43f1-aad1-6f82a84a0ab2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:18.379471 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d19535-05d7-43f1-aad1-6f82a84a0ab2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:18.418566 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1060/2172] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:18 2022] POST /identity/v3/projects => generated 389 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:18.419752 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b6fbd-57f8-4d37-80be-893d2866a362 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:18.434821 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b6fbd-57f8-4d37-80be-893d2866a362 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:18.468041 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d19535-05d7-43f1-aad1-6f82a84a0ab2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:18.470336 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f3d19535-05d7-43f1-aad1-6f82a84a0ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:18.512401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce803c7b-169c-4ff2-bf02-2e6c7f8075fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:18.512401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce803c7b-169c-4ff2-bf02-2e6c7f8075fa admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:18.512636 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce803c7b-169c-4ff2-bf02-2e6c7f8075fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:18.512882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce803c7b-169c-4ff2-bf02-2e6c7f8075fa admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.513598 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce803c7b-169c-4ff2-bf02-2e6c7f8075fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:18.515612 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce803c7b-169c-4ff2-bf02-2e6c7f8075fa admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:18.545008 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:18.557937 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1113/2173] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:18 2022] POST /identity/v3/users => generated 301 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:18.565185 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce803c7b-169c-4ff2-bf02-2e6c7f8075fa admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:18.572492 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d19535-05d7-43f1-aad1-6f82a84a0ab2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:18.580051 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce803c7b-169c-4ff2-bf02-2e6c7f8075fa admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:18.583914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a20fd1-fa2f-4397-bef0-57e4dfc8e8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:18.584844 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a20fd1-fa2f-4397-bef0-57e4dfc8e8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:18.585137 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a20fd1-fa2f-4397-bef0-57e4dfc8e8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:18.585267 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c74a37-1147-4768-8405-61699fbc6236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:18.585471 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a20fd1-fa2f-4397-bef0-57e4dfc8e8de admin admin] PATH_INFO: `/v3/projects/0144af33572d46ac9db8d475298bbcb0` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.585816 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c74a37-1147-4768-8405-61699fbc6236 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:18.586212 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c74a37-1147-4768-8405-61699fbc6236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:18.586499 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c74a37-1147-4768-8405-61699fbc6236 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.587250 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c74a37-1147-4768-8405-61699fbc6236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:18.589597 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c74a37-1147-4768-8405-61699fbc6236 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:18.590183 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a20fd1-fa2f-4397-bef0-57e4dfc8e8de admin admin] RBAC: Authorizing `identity:delete_project(project_id=0144af33572d46ac9db8d475298bbcb0)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:18.592119 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a20fd1-fa2f-4397-bef0-57e4dfc8e8de admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:18.600635 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1114/2174] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:18.604712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c74a37-1147-4768-8405-61699fbc6236 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:18.615787 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c74a37-1147-4768-8405-61699fbc6236 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:18.621433 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a2f2a-ab09-44b7-9eca-f5c1ae18c787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:18.622871 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a2f2a-ab09-44b7-9eca-f5c1ae18c787 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:18.622871 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a2f2a-ab09-44b7-9eca-f5c1ae18c787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:18.623049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37a2f2a-ab09-44b7-9eca-f5c1ae18c787 admin admin] PATH_INFO: `/v3/projects/baa5c943992b41a489216f79e053c7cd/users/17f2d58e22e7459ba833c0553af1fb66/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.641106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a2f2a-ab09-44b7-9eca-f5c1ae18c787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa5c943992b41a489216f79e053c7cd, user_id=17f2d58e22e7459ba833c0553af1fb66, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:18.644210 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37a2f2a-ab09-44b7-9eca-f5c1ae18c787 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:18.647904 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:18.669671 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1115/2175] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:18 2022] PUT /identity/v3/projects/baa5c943992b41a489216f79e053c7cd/users/17f2d58e22e7459ba833c0553af1fb66/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:18.673684 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a2f2a-ab09-44b7-9eca-f5c1ae18c787 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:18.688450 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d4a20fd1-fa2f-4397-bef0-57e4dfc8e8de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0144af33572d46ac9db8d475298bbcb0', 'request_id': 'req-d4a20fd1-fa2f-4397-bef0-57e4dfc8e8de'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:18.700121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d4a20fd1-fa2f-4397-bef0-57e4dfc8e8de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0144af33572d46ac9db8d475298bbcb0', 'request_id': 'req-d4a20fd1-fa2f-4397-bef0-57e4dfc8e8de'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:18.710106 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d4a20fd1-fa2f-4397-bef0-57e4dfc8e8de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0144af33572d46ac9db8d475298bbcb0', 'request_id': 'req-d4a20fd1-fa2f-4397-bef0-57e4dfc8e8de'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:18.725892 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d4a20fd1-fa2f-4397-bef0-57e4dfc8e8de admin admin] The token cache is being invalidate because project 0144af33572d46ac9db8d475298bbcb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:18.725892 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d4a20fd1-fa2f-4397-bef0-57e4dfc8e8de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:18.726885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d4a20fd1-fa2f-4397-bef0-57e4dfc8e8de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:18.729565 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1061/2176] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:18 2022] DELETE /identity/v3/projects/0144af33572d46ac9db8d475298bbcb0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:18.735506 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5960d-3540-4a0d-b52f-cf86db156a36 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:18.735928 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5960d-3540-4a0d-b52f-cf86db156a36 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:18.736369 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c5960d-3540-4a0d-b52f-cf86db156a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.765835 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-33c5960d-3540-4a0d-b52f-cf86db156a36 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:18.767333 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-33c5960d-3540-4a0d-b52f-cf86db156a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:18.775130 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37a2f2a-ab09-44b7-9eca-f5c1ae18c787 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:18.859055 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2fafe-af41-47ef-b029-c68746d74630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:18.859836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2fafe-af41-47ef-b029-c68746d74630 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:18.860187 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2fafe-af41-47ef-b029-c68746d74630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:18.860698 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed2fafe-af41-47ef-b029-c68746d74630 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.861614 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2fafe-af41-47ef-b029-c68746d74630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:18.864322 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed2fafe-af41-47ef-b029-c68746d74630 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:18.877139 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1116/2177] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:18.881353 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2fafe-af41-47ef-b029-c68746d74630 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:18.883495 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7ed2fafe-af41-47ef-b029-c68746d74630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:18.897805 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed2fafe-af41-47ef-b029-c68746d74630 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:18.904944 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3277d6c-9a3e-4a5b-aae5-772d475dfa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:18.906119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3277d6c-9a3e-4a5b-aae5-772d475dfa22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:18.906674 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3277d6c-9a3e-4a5b-aae5-772d475dfa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:18.907100 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3277d6c-9a3e-4a5b-aae5-772d475dfa22 admin admin] PATH_INFO: `/v3/projects/baa5c943992b41a489216f79e053c7cd/users/17f2d58e22e7459ba833c0553af1fb66/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.910615 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3277d6c-9a3e-4a5b-aae5-772d475dfa22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=baa5c943992b41a489216f79e053c7cd, user_id=17f2d58e22e7459ba833c0553af1fb66, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:18.913878 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3277d6c-9a3e-4a5b-aae5-772d475dfa22 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:18.931350 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1117/2178] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:18 2022] PUT /identity/v3/projects/baa5c943992b41a489216f79e053c7cd/users/17f2d58e22e7459ba833c0553af1fb66/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:18.934274 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1062/2179] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:18.944907 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0abb9e-4461-41fb-9d10-8d075608d66e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:18.945293 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0abb9e-4461-41fb-9d10-8d075608d66e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:18.945626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0abb9e-4461-41fb-9d10-8d075608d66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.950690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccb971-6256-4b9d-b21e-c7dee00b4d6d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:18.951179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccb971-6256-4b9d-b21e-c7dee00b4d6d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:18.951665 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ccb971-6256-4b9d-b21e-c7dee00b4d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:18.973412 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-0e0abb9e-4461-41fb-9d10-8d075608d66e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:18.974748 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0e0abb9e-4461-41fb-9d10-8d075608d66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:19.007794 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-83ccb971-6256-4b9d-b21e-c7dee00b4d6d None None] MFA Rules not processed for user `17f2d58e22e7459ba833c0553af1fb66`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:19.012914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-83ccb971-6256-4b9d-b21e-c7dee00b4d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:19.110136 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1118/2180] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:19.111370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0abb9e-4461-41fb-9d10-8d075608d66e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:19.121291 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0abb9e-4461-41fb-9d10-8d075608d66e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:19.126209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97955eff-68bd-4e99-aaa3-649613efae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:19.126985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97955eff-68bd-4e99-aaa3-649613efae88 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.127428 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97955eff-68bd-4e99-aaa3-649613efae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.127806 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97955eff-68bd-4e99-aaa3-649613efae88 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.128762 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97955eff-68bd-4e99-aaa3-649613efae88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:19.129168 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97955eff-68bd-4e99-aaa3-649613efae88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:19.130974 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97955eff-68bd-4e99-aaa3-649613efae88 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:19.133062 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:19.152193 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1063/2181] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:19.155726 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccb971-6256-4b9d-b21e-c7dee00b4d6d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:19.159338 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1119/2182] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:13:19.166741 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97955eff-68bd-4e99-aaa3-649613efae88 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:19.168074 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ccb971-6256-4b9d-b21e-c7dee00b4d6d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:19.170445 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-97955eff-68bd-4e99-aaa3-649613efae88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:19.175279 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86850d-aa9d-4fec-bed2-536d734119e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:19.176104 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86850d-aa9d-4fec-bed2-536d734119e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.176449 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86850d-aa9d-4fec-bed2-536d734119e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.176794 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86850d-aa9d-4fec-bed2-536d734119e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.177934 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86850d-aa9d-4fec-bed2-536d734119e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:19.180003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86850d-aa9d-4fec-bed2-536d734119e0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:19.197875 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:19.221856 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1064/2183] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:19 2022] POST /identity/v3/projects => generated 383 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:19.224091 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86850d-aa9d-4fec-bed2-536d734119e0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:19.252402 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97955eff-68bd-4e99-aaa3-649613efae88 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:19.307728 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86850d-aa9d-4fec-bed2-536d734119e0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:19.312902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549113d-a826-4bf5-b6bf-9ac45d783b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:19.313628 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549113d-a826-4bf5-b6bf-9ac45d783b29 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.313913 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549113d-a826-4bf5-b6bf-9ac45d783b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.314187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d549113d-a826-4bf5-b6bf-9ac45d783b29 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.314932 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549113d-a826-4bf5-b6bf-9ac45d783b29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:19.317029 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d549113d-a826-4bf5-b6bf-9ac45d783b29 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:19.318010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f657c6d-a7c9-462a-adf7-4ab33b290e08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:19.319249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f657c6d-a7c9-462a-adf7-4ab33b290e08 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.319722 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f657c6d-a7c9-462a-adf7-4ab33b290e08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.320146 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f657c6d-a7c9-462a-adf7-4ab33b290e08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.352096 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1065/2184] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:19 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:19.354865 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549113d-a826-4bf5-b6bf-9ac45d783b29 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:19.368445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d549113d-a826-4bf5-b6bf-9ac45d783b29 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:19.375385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34dc8b-d72d-4011-91b5-e9d9daa9da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:19.376073 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34dc8b-d72d-4011-91b5-e9d9daa9da09 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.376358 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34dc8b-d72d-4011-91b5-e9d9daa9da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.376636 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34dc8b-d72d-4011-91b5-e9d9daa9da09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.377432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34dc8b-d72d-4011-91b5-e9d9daa9da09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:19.379059 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34dc8b-d72d-4011-91b5-e9d9daa9da09 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:19.389868 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1066/2185] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:19.394467 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34dc8b-d72d-4011-91b5-e9d9daa9da09 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:19.409251 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f657c6d-a7c9-462a-adf7-4ab33b290e08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:19.411550 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34dc8b-d72d-4011-91b5-e9d9daa9da09 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:19.413216 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f657c6d-a7c9-462a-adf7-4ab33b290e08 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:19.419069 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a5851-a111-49ea-acea-87762d5ffb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:19.419871 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a5851-a111-49ea-acea-87762d5ffb03 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.420154 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a5851-a111-49ea-acea-87762d5ffb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.420513 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760a5851-a111-49ea-acea-87762d5ffb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.421320 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a5851-a111-49ea-acea-87762d5ffb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:19.423005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760a5851-a111-49ea-acea-87762d5ffb03 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:19.438717 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1067/2187] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:19.438998 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1120/2187] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:19.442879 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a5851-a111-49ea-acea-87762d5ffb03 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:19.459935 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760a5851-a111-49ea-acea-87762d5ffb03 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:19.465367 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1ecde-0d0d-4f58-8855-be5f70d5f7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:19.466664 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1ecde-0d0d-4f58-8855-be5f70d5f7b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.466947 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1ecde-0d0d-4f58-8855-be5f70d5f7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.467221 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd1ecde-0d0d-4f58-8855-be5f70d5f7b2 admin admin] PATH_INFO: `/v3/projects/542390d138ad46d8810d5ea395244caf/users/3ddaa03e407f414a8221d0f70c2a7db4/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.488062 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1ecde-0d0d-4f58-8855-be5f70d5f7b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=542390d138ad46d8810d5ea395244caf, user_id=3ddaa03e407f414a8221d0f70c2a7db4, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:19.491021 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd1ecde-0d0d-4f58-8855-be5f70d5f7b2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:19.514976 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1068/2188] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:19 2022] PUT /identity/v3/projects/542390d138ad46d8810d5ea395244caf/users/3ddaa03e407f414a8221d0f70c2a7db4/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:19.529320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739acffe-5626-4878-98c9-865fee9744e0 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.529730 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739acffe-5626-4878-98c9-865fee9744e0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.530130 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739acffe-5626-4878-98c9-865fee9744e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.578552 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-739acffe-5626-4878-98c9-865fee9744e0 None None] MFA Rules not processed for user `3ddaa03e407f414a8221d0f70c2a7db4`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:19.580161 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-739acffe-5626-4878-98c9-865fee9744e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:19.591758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1ecde-0d0d-4f58-8855-be5f70d5f7b2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:19.668899 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1121/2189] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:19.673549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739acffe-5626-4878-98c9-865fee9744e0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:19.685996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd1ecde-0d0d-4f58-8855-be5f70d5f7b2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:19.689874 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739acffe-5626-4878-98c9-865fee9744e0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:19.691073 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a0799-3215-469d-87fa-a0bc2525955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:19.692079 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a0799-3215-469d-87fa-a0bc2525955d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.692439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a0799-3215-469d-87fa-a0bc2525955d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.692778 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a0799-3215-469d-87fa-a0bc2525955d admin admin] PATH_INFO: `/v3/users/11bad26a5c9449e0853d79f03692afbc` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.694176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a0799-3215-469d-87fa-a0bc2525955d admin admin] RBAC: Authorizing `identity:delete_user(user_id=11bad26a5c9449e0853d79f03692afbc)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:19.696431 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a0799-3215-469d-87fa-a0bc2525955d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:19.699498 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a4550-2f5c-4095-939a-175307ead2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:19.701255 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a4550-2f5c-4095-939a-175307ead2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.701752 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a4550-2f5c-4095-939a-175307ead2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.702191 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808a4550-2f5c-4095-939a-175307ead2e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.703086 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a4550-2f5c-4095-939a-175307ead2e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:19.705775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808a4550-2f5c-4095-939a-175307ead2e7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:19.710909 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:19.720008 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:19.741091 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1122/2190] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:19 2022] POST /identity/v3/projects => generated 381 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:19.742173 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a4550-2f5c-4095-939a-175307ead2e7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:19.767388 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-927a0799-3215-469d-87fa-a0bc2525955d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11bad26a5c9449e0853d79f03692afbc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:19.768244 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-927a0799-3215-469d-87fa-a0bc2525955d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11bad26a5c9449e0853d79f03692afbc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:19.769053 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-927a0799-3215-469d-87fa-a0bc2525955d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11bad26a5c9449e0853d79f03692afbc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:19.776674 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-927a0799-3215-469d-87fa-a0bc2525955d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11bad26a5c9449e0853d79f03692afbc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:19.793027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-927a0799-3215-469d-87fa-a0bc2525955d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11bad26a5c9449e0853d79f03692afbc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:19.817862 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1069/2191] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:19 2022] DELETE /identity/v3/users/11bad26a5c9449e0853d79f03692afbc => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:19.822429 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c309c5-22ec-49d5-a23a-2f2b4cc3ee4e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.822721 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c309c5-22ec-49d5-a23a-2f2b4cc3ee4e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.823404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c309c5-22ec-49d5-a23a-2f2b4cc3ee4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.836338 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808a4550-2f5c-4095-939a-175307ead2e7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:19.843258 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-54c309c5-22ec-49d5-a23a-2f2b4cc3ee4e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:19.844598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-54c309c5-22ec-49d5-a23a-2f2b4cc3ee4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:19.918754 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91076125-9961-44df-8412-91687d208826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:19.920225 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91076125-9961-44df-8412-91687d208826 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.920612 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91076125-9961-44df-8412-91687d208826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.920968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91076125-9961-44df-8412-91687d208826 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.921871 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91076125-9961-44df-8412-91687d208826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:19.924054 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1070/2192] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:19.924578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91076125-9961-44df-8412-91687d208826 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:19.934832 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c309c5-22ec-49d5-a23a-2f2b4cc3ee4e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:19.936329 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-54c309c5-22ec-49d5-a23a-2f2b4cc3ee4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:19.955335 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1123/2193] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:19 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:19.956757 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91076125-9961-44df-8412-91687d208826 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:19.958613 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-91076125-9961-44df-8412-91687d208826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:19.971055 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91076125-9961-44df-8412-91687d208826 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:19.975934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce318af-4649-4493-a69b-c7348d90a233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:19.976603 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce318af-4649-4493-a69b-c7348d90a233 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:19.976888 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce318af-4649-4493-a69b-c7348d90a233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:19.977168 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce318af-4649-4493-a69b-c7348d90a233 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:19.977910 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce318af-4649-4493-a69b-c7348d90a233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:19.979595 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce318af-4649-4493-a69b-c7348d90a233 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:19.995803 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1124/2194] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:13:19.997234 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce318af-4649-4493-a69b-c7348d90a233 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:20.010384 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce318af-4649-4493-a69b-c7348d90a233 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:20.014856 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba284216-d8e4-4b5b-a702-744523a0f04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:20.015760 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba284216-d8e4-4b5b-a702-744523a0f04c admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.016827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba284216-d8e4-4b5b-a702-744523a0f04c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.017303 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba284216-d8e4-4b5b-a702-744523a0f04c admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.018207 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba284216-d8e4-4b5b-a702-744523a0f04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:20.021431 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba284216-d8e4-4b5b-a702-744523a0f04c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:20.061707 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1125/2195] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:19 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:13:20.066102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba284216-d8e4-4b5b-a702-744523a0f04c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:20.084291 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba284216-d8e4-4b5b-a702-744523a0f04c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:20.084291 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb7629-782e-44b3-b5d8-50669a4757dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:20.087035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c309c5-22ec-49d5-a23a-2f2b4cc3ee4e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:20.091533 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb7629-782e-44b3-b5d8-50669a4757dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.091820 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb7629-782e-44b3-b5d8-50669a4757dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.092251 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb7629-782e-44b3-b5d8-50669a4757dc admin admin] PATH_INFO: `/v3/projects/3ad2b8e7312f4bb1ad8d76232168f14b/users/dff6598e00bc456cb8ea406e8b05089b/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.092766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56465603-84dc-4add-a619-73a2784296c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:20.093676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56465603-84dc-4add-a619-73a2784296c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.094119 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56465603-84dc-4add-a619-73a2784296c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.094547 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56465603-84dc-4add-a619-73a2784296c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.120814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56465603-84dc-4add-a619-73a2784296c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:20.131175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56465603-84dc-4add-a619-73a2784296c4 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:20.133294 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb7629-782e-44b3-b5d8-50669a4757dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ad2b8e7312f4bb1ad8d76232168f14b, user_id=dff6598e00bc456cb8ea406e8b05089b, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:20.141134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8eb7629-782e-44b3-b5d8-50669a4757dc admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:20.167711 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1071/2196] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:13:20.196290 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1126/2197] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:20 2022] PUT /identity/v3/projects/3ad2b8e7312f4bb1ad8d76232168f14b/users/dff6598e00bc456cb8ea406e8b05089b/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:20.217528 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793b824-1dbf-4f6d-9bf5-b6ae10f3256e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.217828 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793b824-1dbf-4f6d-9bf5-b6ae10f3256e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.218107 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9793b824-1dbf-4f6d-9bf5-b6ae10f3256e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.289220 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9793b824-1dbf-4f6d-9bf5-b6ae10f3256e None None] MFA Rules not processed for user `dff6598e00bc456cb8ea406e8b05089b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:20.290872 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9793b824-1dbf-4f6d-9bf5-b6ae10f3256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:20.364754 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:20.452649 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1072/2198] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:20.456855 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb7629-782e-44b3-b5d8-50669a4757dc admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:20.539862 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:20.585578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8eb7629-782e-44b3-b5d8-50669a4757dc admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:20.591646 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ec4ed-810c-4504-93b6-6f09bcfe0260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:20.592377 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ec4ed-810c-4504-93b6-6f09bcfe0260 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.592656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ec4ed-810c-4504-93b6-6f09bcfe0260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.592941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22ec4ed-810c-4504-93b6-6f09bcfe0260 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.593719 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ec4ed-810c-4504-93b6-6f09bcfe0260 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:20.595884 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22ec4ed-810c-4504-93b6-6f09bcfe0260 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:20.602700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793b824-1dbf-4f6d-9bf5-b6ae10f3256e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:20.605144 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9793b824-1dbf-4f6d-9bf5-b6ae10f3256e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:20.639996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9793b824-1dbf-4f6d-9bf5-b6ae10f3256e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:20.644844 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e4df3-d646-49dc-b511-929c4c10ac03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:20.645722 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e4df3-d646-49dc-b511-929c4c10ac03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.645998 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e4df3-d646-49dc-b511-929c4c10ac03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.646271 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e4df3-d646-49dc-b511-929c4c10ac03 admin admin] PATH_INFO: `/v3/projects/d3aeba794eaf4d7a862a746d92b357ff` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.647667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e4df3-d646-49dc-b511-929c4c10ac03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3aeba794eaf4d7a862a746d92b357ff)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:20.649850 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e4df3-d646-49dc-b511-929c4c10ac03 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:20.651649 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1127/2199] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:20 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:20.655490 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ec4ed-810c-4504-93b6-6f09bcfe0260 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:20.723540 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-101e4df3-d646-49dc-b511-929c4c10ac03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3aeba794eaf4d7a862a746d92b357ff', 'request_id': 'req-101e4df3-d646-49dc-b511-929c4c10ac03'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:20.733015 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-101e4df3-d646-49dc-b511-929c4c10ac03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3aeba794eaf4d7a862a746d92b357ff', 'request_id': 'req-101e4df3-d646-49dc-b511-929c4c10ac03'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:20.740951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-101e4df3-d646-49dc-b511-929c4c10ac03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3aeba794eaf4d7a862a746d92b357ff', 'request_id': 'req-101e4df3-d646-49dc-b511-929c4c10ac03'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:20.750905 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22ec4ed-810c-4504-93b6-6f09bcfe0260 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:20.758142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-101e4df3-d646-49dc-b511-929c4c10ac03 admin admin] The token cache is being invalidate because project d3aeba794eaf4d7a862a746d92b357ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:20.758580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-101e4df3-d646-49dc-b511-929c4c10ac03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:20.759446 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-101e4df3-d646-49dc-b511-929c4c10ac03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:20.764064 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1073/2200] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:20 2022] DELETE /identity/v3/projects/d3aeba794eaf4d7a862a746d92b357ff => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:20.765601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e4df3-d646-49dc-b511-929c4c10ac03 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:20.770319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-101e4df3-d646-49dc-b511-929c4c10ac03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:20.827899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb4522-7733-47aa-ad59-a46318d099e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:20.828581 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb4522-7733-47aa-ad59-a46318d099e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.828862 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb4522-7733-47aa-ad59-a46318d099e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.829250 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffb4522-7733-47aa-ad59-a46318d099e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.830022 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb4522-7733-47aa-ad59-a46318d099e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:20.832024 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffb4522-7733-47aa-ad59-a46318d099e8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:20.852880 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e4df3-d646-49dc-b511-929c4c10ac03 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:20.858054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f17f4-e495-43f9-b44b-284a0d205832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:20.859163 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f17f4-e495-43f9-b44b-284a0d205832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.859570 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f17f4-e495-43f9-b44b-284a0d205832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.860151 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1128/2201] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:20 2022] POST /identity/v3/users => generated 299 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:20.863003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f17f4-e495-43f9-b44b-284a0d205832 admin admin] PATH_INFO: `/v3/users/17f2d58e22e7459ba833c0553af1fb66` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.864129 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb4522-7733-47aa-ad59-a46318d099e8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:20.864750 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f17f4-e495-43f9-b44b-284a0d205832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17f2d58e22e7459ba833c0553af1fb66)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:20.866308 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6ffb4522-7733-47aa-ad59-a46318d099e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:20.866944 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f17f4-e495-43f9-b44b-284a0d205832 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:20.880799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffb4522-7733-47aa-ad59-a46318d099e8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:20.888717 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba27226-5dba-4437-aa4c-90fe911946d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:20.889752 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba27226-5dba-4437-aa4c-90fe911946d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.890195 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba27226-5dba-4437-aa4c-90fe911946d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.890619 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba27226-5dba-4437-aa4c-90fe911946d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.891587 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba27226-5dba-4437-aa4c-90fe911946d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:20.893358 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba27226-5dba-4437-aa4c-90fe911946d5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:20.905114 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1129/2202] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:20.909458 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba27226-5dba-4437-aa4c-90fe911946d5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:20.920656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba27226-5dba-4437-aa4c-90fe911946d5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:20.925927 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730e8a6-ab66-434b-9a3e-b628e6ef8faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:20.926892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730e8a6-ab66-434b-9a3e-b628e6ef8faa admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:20.927180 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730e8a6-ab66-434b-9a3e-b628e6ef8faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:20.927851 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730e8a6-ab66-434b-9a3e-b628e6ef8faa admin admin] PATH_INFO: `/v3/projects/37a2f3b0d7a34f05a61a3882af2d896a/users/65e336a96f6245f89d4e70ab4f1c8642/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:20.929274 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-009f17f4-e495-43f9-b44b-284a0d205832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17f2d58e22e7459ba833c0553af1fb66'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:20.929951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-009f17f4-e495-43f9-b44b-284a0d205832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17f2d58e22e7459ba833c0553af1fb66'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:20.930731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-009f17f4-e495-43f9-b44b-284a0d205832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17f2d58e22e7459ba833c0553af1fb66'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:20.936761 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:20.940726 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-009f17f4-e495-43f9-b44b-284a0d205832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17f2d58e22e7459ba833c0553af1fb66'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:20.944688 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730e8a6-ab66-434b-9a3e-b628e6ef8faa admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a2f3b0d7a34f05a61a3882af2d896a, user_id=65e336a96f6245f89d4e70ab4f1c8642, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:20.947531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6730e8a6-ab66-434b-9a3e-b628e6ef8faa admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:20.955270 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-009f17f4-e495-43f9-b44b-284a0d205832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17f2d58e22e7459ba833c0553af1fb66'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:20.967634 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1130/2203] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:20 2022] PUT /identity/v3/projects/37a2f3b0d7a34f05a61a3882af2d896a/users/65e336a96f6245f89d4e70ab4f1c8642/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:20.971453 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1074/2204] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:20 2022] DELETE /identity/v3/users/17f2d58e22e7459ba833c0553af1fb66 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:20.972876 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f17f4-e495-43f9-b44b-284a0d205832 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:20.978105 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-009f17f4-e495-43f9-b44b-284a0d205832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:21.057912 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f17f4-e495-43f9-b44b-284a0d205832 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:21.063344 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27970a9-524f-46d2-b8e2-41595e4e8e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:21.064138 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27970a9-524f-46d2-b8e2-41595e4e8e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.064518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27970a9-524f-46d2-b8e2-41595e4e8e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.064888 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27970a9-524f-46d2-b8e2-41595e4e8e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.065725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27970a9-524f-46d2-b8e2-41595e4e8e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:21.067457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27970a9-524f-46d2-b8e2-41595e4e8e94 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:21.080190 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1075/2205] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:13:21.084853 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730e8a6-ab66-434b-9a3e-b628e6ef8faa admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:21.120848 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:21.154649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fcf1e-58db-4ecd-afd5-968435b3b813 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.155008 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fcf1e-58db-4ecd-afd5-968435b3b813 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.155320 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fcf1e-58db-4ecd-afd5-968435b3b813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.165849 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730e8a6-ab66-434b-9a3e-b628e6ef8faa admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:21.170870 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368992f-c1c9-4231-997e-ad04535d31e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:21.172133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368992f-c1c9-4231-997e-ad04535d31e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.172358 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368992f-c1c9-4231-997e-ad04535d31e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.172694 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368992f-c1c9-4231-997e-ad04535d31e1 admin admin] PATH_INFO: `/v3/projects/37a2f3b0d7a34f05a61a3882af2d896a/users/65e336a96f6245f89d4e70ab4f1c8642/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.174929 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368992f-c1c9-4231-997e-ad04535d31e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37a2f3b0d7a34f05a61a3882af2d896a, user_id=65e336a96f6245f89d4e70ab4f1c8642, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:21.175215 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a35fcf1e-58db-4ecd-afd5-968435b3b813 None None] MFA Rules not processed for user `9a0398a0ec144dfcbcc4c92fc54d4dee`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:21.176486 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a35fcf1e-58db-4ecd-afd5-968435b3b813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:21.178223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368992f-c1c9-4231-997e-ad04535d31e1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:21.191188 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1131/2206] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:21 2022] PUT /identity/v3/projects/37a2f3b0d7a34f05a61a3882af2d896a/users/65e336a96f6245f89d4e70ab4f1c8642/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:21.201489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286c062-b61a-42c8-a29c-2c35b434380d None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.202137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286c062-b61a-42c8-a29c-2c35b434380d None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.202137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b286c062-b61a-42c8-a29c-2c35b434380d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.231174 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b286c062-b61a-42c8-a29c-2c35b434380d None None] MFA Rules not processed for user `65e336a96f6245f89d4e70ab4f1c8642`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:21.232539 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b286c062-b61a-42c8-a29c-2c35b434380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:21.245493 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1076/2207] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:21.272713 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fcf1e-58db-4ecd-afd5-968435b3b813 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:21.279042 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a35fcf1e-58db-4ecd-afd5-968435b3b813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:21.299942 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fcf1e-58db-4ecd-afd5-968435b3b813 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:21.318620 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1132/2208] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:21.330827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286c062-b61a-42c8-a29c-2c35b434380d None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:21.332233 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b286c062-b61a-42c8-a29c-2c35b434380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:21.370278 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d84dd6-8720-40f0-9e81-32fc3f5d2ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:21.371115 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d84dd6-8720-40f0-9e81-32fc3f5d2ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.371939 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d84dd6-8720-40f0-9e81-32fc3f5d2ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.372212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d84dd6-8720-40f0-9e81-32fc3f5d2ed8 admin admin] PATH_INFO: `/v3/projects/baa5c943992b41a489216f79e053c7cd` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.373413 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d84dd6-8720-40f0-9e81-32fc3f5d2ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baa5c943992b41a489216f79e053c7cd)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:21.375425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d84dd6-8720-40f0-9e81-32fc3f5d2ed8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:21.388175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:21.399231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b286c062-b61a-42c8-a29c-2c35b434380d None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:21.403183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858c346c-981d-4114-9469-0d848d95433a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:21.403948 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c346c-981d-4114-9469-0d848d95433a service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.404272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c346c-981d-4114-9469-0d848d95433a service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.404514 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858c346c-981d-4114-9469-0d848d95433a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.407281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-858c346c-981d-4114-9469-0d848d95433a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:21.438851 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54d84dd6-8720-40f0-9e81-32fc3f5d2ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baa5c943992b41a489216f79e053c7cd', 'request_id': 'req-54d84dd6-8720-40f0-9e81-32fc3f5d2ed8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:21.449770 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54d84dd6-8720-40f0-9e81-32fc3f5d2ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baa5c943992b41a489216f79e053c7cd', 'request_id': 'req-54d84dd6-8720-40f0-9e81-32fc3f5d2ed8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:21.458235 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54d84dd6-8720-40f0-9e81-32fc3f5d2ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baa5c943992b41a489216f79e053c7cd', 'request_id': 'req-54d84dd6-8720-40f0-9e81-32fc3f5d2ed8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:21.474848 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54d84dd6-8720-40f0-9e81-32fc3f5d2ed8 admin admin] The token cache is being invalidate because project baa5c943992b41a489216f79e053c7cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:21.475991 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54d84dd6-8720-40f0-9e81-32fc3f5d2ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:21.476820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-54d84dd6-8720-40f0-9e81-32fc3f5d2ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:21.478738 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1077/2209] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:21 2022] DELETE /identity/v3/projects/baa5c943992b41a489216f79e053c7cd => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:21.483737 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9c93-4393-4dbe-acbd-01166941642b None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.484235 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9c93-4393-4dbe-acbd-01166941642b None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.484590 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a9c93-4393-4dbe-acbd-01166941642b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.491953 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c346c-981d-4114-9469-0d848d95433a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:21.495345 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858c346c-981d-4114-9469-0d848d95433a service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:21.499652 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:21.508943 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bb8a9c93-4393-4dbe-acbd-01166941642b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:21.510335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bb8a9c93-4393-4dbe-acbd-01166941642b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:21.511335 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1133/2210] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:13:21.608670 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1078/2211] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:21.610589 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b939c4-46e1-4ea2-871d-80eb34b9a9ba None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.611038 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b939c4-46e1-4ea2-871d-80eb34b9a9ba None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.611340 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b939c4-46e1-4ea2-871d-80eb34b9a9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.638180 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-31b939c4-46e1-4ea2-871d-80eb34b9a9ba None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:21.640290 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-31b939c4-46e1-4ea2-871d-80eb34b9a9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:21.653135 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1134/2212] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:21.657999 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9c93-4393-4dbe-acbd-01166941642b None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:21.672986 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a9c93-4393-4dbe-acbd-01166941642b None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:21.679579 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e660b-5b4e-48ae-9966-a3d93de23582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:21.680387 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e660b-5b4e-48ae-9966-a3d93de23582 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.680775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e660b-5b4e-48ae-9966-a3d93de23582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.681283 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33e660b-5b4e-48ae-9966-a3d93de23582 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.682146 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e660b-5b4e-48ae-9966-a3d93de23582 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:21.682544 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e660b-5b4e-48ae-9966-a3d93de23582 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:21.684370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33e660b-5b4e-48ae-9966-a3d93de23582 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:21.699070 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1079/2213] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:13:21.704042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b939c4-46e1-4ea2-871d-80eb34b9a9ba None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:21.713646 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b939c4-46e1-4ea2-871d-80eb34b9a9ba None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:21.719248 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fa557-fc18-4d00-abc9-65cf8b8c4e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:21.720068 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fa557-fc18-4d00-abc9-65cf8b8c4e20 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.720413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fa557-fc18-4d00-abc9-65cf8b8c4e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.720699 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135fa557-fc18-4d00-abc9-65cf8b8c4e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.721561 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fa557-fc18-4d00-abc9-65cf8b8c4e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:21.723795 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135fa557-fc18-4d00-abc9-65cf8b8c4e20 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:21.783265 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1135/2214] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:21 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:21.787489 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e660b-5b4e-48ae-9966-a3d93de23582 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:21.803085 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33e660b-5b4e-48ae-9966-a3d93de23582 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:21.912832 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d7665-9d20-4b19-9c2b-f4e16b52ca26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:21.913694 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d7665-9d20-4b19-9c2b-f4e16b52ca26 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.913975 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d7665-9d20-4b19-9c2b-f4e16b52ca26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.914255 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d7665-9d20-4b19-9c2b-f4e16b52ca26 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.915395 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d7665-9d20-4b19-9c2b-f4e16b52ca26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:21.919039 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d7665-9d20-4b19-9c2b-f4e16b52ca26 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:21.956158 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1080/2215] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:21 2022] POST /identity/v3/users => generated 289 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:21.959818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fa557-fc18-4d00-abc9-65cf8b8c4e20 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:21.972756 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135fa557-fc18-4d00-abc9-65cf8b8c4e20 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:21.981309 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca8bc3-5cbd-4b75-b286-8aac52bd5e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:21.982003 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca8bc3-5cbd-4b75-b286-8aac52bd5e31 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:21.982296 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca8bc3-5cbd-4b75-b286-8aac52bd5e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:21.982579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca8bc3-5cbd-4b75-b286-8aac52bd5e31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:21.983341 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca8bc3-5cbd-4b75-b286-8aac52bd5e31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:21.985153 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca8bc3-5cbd-4b75-b286-8aac52bd5e31 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:22.000412 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1136/2216] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:22.001954 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d7665-9d20-4b19-9c2b-f4e16b52ca26 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:22.019155 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d7665-9d20-4b19-9c2b-f4e16b52ca26 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:22.024969 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272060d-19ab-4411-92b7-df6f51f3bd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:22.025709 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272060d-19ab-4411-92b7-df6f51f3bd30 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:22.025996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272060d-19ab-4411-92b7-df6f51f3bd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:22.026267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272060d-19ab-4411-92b7-df6f51f3bd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:22.033044 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272060d-19ab-4411-92b7-df6f51f3bd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:22.034608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272060d-19ab-4411-92b7-df6f51f3bd30 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:22.049524 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1081/2217] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:22 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:22.050941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca8bc3-5cbd-4b75-b286-8aac52bd5e31 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:22.062700 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca8bc3-5cbd-4b75-b286-8aac52bd5e31 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:22.067370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348e113-facd-4710-a120-094d1a8e1f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:22.068273 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348e113-facd-4710-a120-094d1a8e1f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:22.068556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348e113-facd-4710-a120-094d1a8e1f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:22.068863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e348e113-facd-4710-a120-094d1a8e1f21 admin admin] PATH_INFO: `/v3/projects/44c0538a8d354819a1662f529700f98e/users/76a9ac282cce4c78bfbcf1c5134a31a5/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:22.088867 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348e113-facd-4710-a120-094d1a8e1f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c0538a8d354819a1662f529700f98e, user_id=76a9ac282cce4c78bfbcf1c5134a31a5, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:22.091769 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e348e113-facd-4710-a120-094d1a8e1f21 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:22.107121 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1137/2218] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:22 2022] PUT /identity/v3/projects/44c0538a8d354819a1662f529700f98e/users/76a9ac282cce4c78bfbcf1c5134a31a5/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:22.117432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd25e7a-d43f-4087-9c5a-9fe3c4f256b5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:22.117731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd25e7a-d43f-4087-9c5a-9fe3c4f256b5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:22.118012 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd25e7a-d43f-4087-9c5a-9fe3c4f256b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:22.130767 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:22.147229 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6bd25e7a-d43f-4087-9c5a-9fe3c4f256b5 None None] MFA Rules not processed for user `76a9ac282cce4c78bfbcf1c5134a31a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:22.148488 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6bd25e7a-d43f-4087-9c5a-9fe3c4f256b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:22.219188 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1082/2219] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:22.232035 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348e113-facd-4710-a120-094d1a8e1f21 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:22.234051 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e348e113-facd-4710-a120-094d1a8e1f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:22.297045 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e348e113-facd-4710-a120-094d1a8e1f21 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:22.305406 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c63d38-919d-4e1c-ac4a-5ec5ba31fb43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:22.306239 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c63d38-919d-4e1c-ac4a-5ec5ba31fb43 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:22.306678 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c63d38-919d-4e1c-ac4a-5ec5ba31fb43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:22.307046 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c63d38-919d-4e1c-ac4a-5ec5ba31fb43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:22.321290 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c63d38-919d-4e1c-ac4a-5ec5ba31fb43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:22.322761 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c63d38-919d-4e1c-ac4a-5ec5ba31fb43 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:22.334277 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1138/2220] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:23.453820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0243c7-233a-4ebd-ab63-d3515ccaf646 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:23.454463 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0243c7-233a-4ebd-ab63-d3515ccaf646 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:23.454463 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0243c7-233a-4ebd-ab63-d3515ccaf646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:23.473820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-aa0243c7-233a-4ebd-ab63-d3515ccaf646 None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:23.474947 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-aa0243c7-233a-4ebd-ab63-d3515ccaf646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:23.534339 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1083/2221] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:13:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:23.547026 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c63d38-919d-4e1c-ac4a-5ec5ba31fb43 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:23.548519 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-19c63d38-919d-4e1c-ac4a-5ec5ba31fb43 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:23.619774 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c63d38-919d-4e1c-ac4a-5ec5ba31fb43 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:23.625558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccbd7c-47c0-40c0-9eef-8dfbc7d700e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:23.626320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccbd7c-47c0-40c0-9eef-8dfbc7d700e8 service swift] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:23.626608 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccbd7c-47c0-40c0-9eef-8dfbc7d700e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:23.626895 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ccbd7c-47c0-40c0-9eef-8dfbc7d700e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:23.635704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccbd7c-47c0-40c0-9eef-8dfbc7d700e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:23.637317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ccbd7c-47c0-40c0-9eef-8dfbc7d700e8 service swift] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:23.646199 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1139/2222] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:13:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:13:24.379272 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0243c7-233a-4ebd-ab63-d3515ccaf646 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:24.384333 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-aa0243c7-233a-4ebd-ab63-d3515ccaf646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:24.413625 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0243c7-233a-4ebd-ab63-d3515ccaf646 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:24.417976 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b6121-a5ee-43b9-9d62-c64ed02d6dfe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:24.418996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b6121-a5ee-43b9-9d62-c64ed02d6dfe service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:24.419456 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b6121-a5ee-43b9-9d62-c64ed02d6dfe service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:24.419905 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b6121-a5ee-43b9-9d62-c64ed02d6dfe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:24.422230 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a45b6121-a5ee-43b9-9d62-c64ed02d6dfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:24.555846 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b6121-a5ee-43b9-9d62-c64ed02d6dfe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:24.558846 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b6121-a5ee-43b9-9d62-c64ed02d6dfe service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:24.572839 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1084/2223] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:25.283228 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccbd7c-47c0-40c0-9eef-8dfbc7d700e8 service swift] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:25.293184 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ccbd7c-47c0-40c0-9eef-8dfbc7d700e8 service swift] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:25.296797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce836bc-de61-412d-8e8d-28ca90ece046 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:25.297443 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce836bc-de61-412d-8e8d-28ca90ece046 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:25.297734 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce836bc-de61-412d-8e8d-28ca90ece046 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:25.298009 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce836bc-de61-412d-8e8d-28ca90ece046 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:25.300160 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0ce836bc-de61-412d-8e8d-28ca90ece046 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:25.331865 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:25.371170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce836bc-de61-412d-8e8d-28ca90ece046 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:25.372615 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce836bc-de61-412d-8e8d-28ca90ece046 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:25.385570 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1140/2224] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:29.557082 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b6121-a5ee-43b9-9d62-c64ed02d6dfe service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:29.562654 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a45b6121-a5ee-43b9-9d62-c64ed02d6dfe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:29.671781 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:29.739377 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b6121-a5ee-43b9-9d62-c64ed02d6dfe service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:29.747256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a83a65-ac9a-4065-adfc-cff2d6df6eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:29.747256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a83a65-ac9a-4065-adfc-cff2d6df6eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:29.747572 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a83a65-ac9a-4065-adfc-cff2d6df6eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:29.747656 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a83a65-ac9a-4065-adfc-cff2d6df6eec admin admin] PATH_INFO: `/v3/users/3ddaa03e407f414a8221d0f70c2a7db4` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:29.749063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a83a65-ac9a-4065-adfc-cff2d6df6eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ddaa03e407f414a8221d0f70c2a7db4)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:29.751364 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a83a65-ac9a-4065-adfc-cff2d6df6eec admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:29.831410 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d0a83a65-ac9a-4065-adfc-cff2d6df6eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ddaa03e407f414a8221d0f70c2a7db4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:29.832184 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d0a83a65-ac9a-4065-adfc-cff2d6df6eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ddaa03e407f414a8221d0f70c2a7db4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:29.832869 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d0a83a65-ac9a-4065-adfc-cff2d6df6eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ddaa03e407f414a8221d0f70c2a7db4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:29.851147 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d0a83a65-ac9a-4065-adfc-cff2d6df6eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ddaa03e407f414a8221d0f70c2a7db4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:29.873694 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d0a83a65-ac9a-4065-adfc-cff2d6df6eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ddaa03e407f414a8221d0f70c2a7db4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:29.904472 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1085/2225] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:29 2022] DELETE /identity/v3/users/3ddaa03e407f414a8221d0f70c2a7db4 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:29.906524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827b3ca-f5fc-4fc0-a9da-006254c4bd87 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:29.907038 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827b3ca-f5fc-4fc0-a9da-006254c4bd87 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:29.907038 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827b3ca-f5fc-4fc0-a9da-006254c4bd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:29.930713 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e827b3ca-f5fc-4fc0-a9da-006254c4bd87 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:29.932616 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e827b3ca-f5fc-4fc0-a9da-006254c4bd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:30.050404 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1141/2226] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:30.051330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a83a65-ac9a-4065-adfc-cff2d6df6eec admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:30.053060 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d0a83a65-ac9a-4065-adfc-cff2d6df6eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:30.165680 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a83a65-ac9a-4065-adfc-cff2d6df6eec admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:30.170733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca33374-23ab-4ec2-b692-3655630c2602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:30.171595 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca33374-23ab-4ec2-b692-3655630c2602 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:30.172161 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca33374-23ab-4ec2-b692-3655630c2602 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:30.172594 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca33374-23ab-4ec2-b692-3655630c2602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:30.185015 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca33374-23ab-4ec2-b692-3655630c2602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:30.188050 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca33374-23ab-4ec2-b692-3655630c2602 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:30.199873 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1086/2227] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:30.505282 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827b3ca-f5fc-4fc0-a9da-006254c4bd87 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:30.506956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e827b3ca-f5fc-4fc0-a9da-006254c4bd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:30.523566 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827b3ca-f5fc-4fc0-a9da-006254c4bd87 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:30.528577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:30.529502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:30.529776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:30.530050 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4 admin admin] PATH_INFO: `/v3/projects/542390d138ad46d8810d5ea395244caf` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:30.532877 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=542390d138ad46d8810d5ea395244caf)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:30.535030 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:30.591520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '542390d138ad46d8810d5ea395244caf', 'request_id': 'req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:30.598352 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '542390d138ad46d8810d5ea395244caf', 'request_id': 'req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:30.606061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '542390d138ad46d8810d5ea395244caf', 'request_id': 'req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:30.625650 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4 admin admin] The token cache is being invalidate because project 542390d138ad46d8810d5ea395244caf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:30.626189 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:30.627192 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:30.629207 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1142/2228] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:30 2022] DELETE /identity/v3/projects/542390d138ad46d8810d5ea395244caf => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:30.633538 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca33374-23ab-4ec2-b692-3655630c2602 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:30.643951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca33374-23ab-4ec2-b692-3655630c2602 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:30.728714 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f05553-f868-46bc-896f-19b70b28efb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:30.729858 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f05553-f868-46bc-896f-19b70b28efb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:30.730334 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f05553-f868-46bc-896f-19b70b28efb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:30.730790 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f05553-f868-46bc-896f-19b70b28efb1 admin admin] PATH_INFO: `/v3/users/dff6598e00bc456cb8ea406e8b05089b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:30.732432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f05553-f868-46bc-896f-19b70b28efb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dff6598e00bc456cb8ea406e8b05089b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:30.735153 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f05553-f868-46bc-896f-19b70b28efb1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:30.741411 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:30.827597 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f7f05553-f868-46bc-896f-19b70b28efb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dff6598e00bc456cb8ea406e8b05089b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:30.828260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f7f05553-f868-46bc-896f-19b70b28efb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dff6598e00bc456cb8ea406e8b05089b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:30.828916 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f7f05553-f868-46bc-896f-19b70b28efb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dff6598e00bc456cb8ea406e8b05089b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:30.837066 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f7f05553-f868-46bc-896f-19b70b28efb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dff6598e00bc456cb8ea406e8b05089b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:30.851763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f7f05553-f868-46bc-896f-19b70b28efb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dff6598e00bc456cb8ea406e8b05089b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:30.875332 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1087/2229] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:30 2022] DELETE /identity/v3/users/dff6598e00bc456cb8ea406e8b05089b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:31.215219 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:31.217978 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:31.245273 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdfa9be-0b35-438c-8770-7f6eb3e9ddb4 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:31.334741 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:31.361211 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:31.362428 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:31.362917 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:31.363637 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab admin admin] PATH_INFO: `/v3/projects/3ad2b8e7312f4bb1ad8d76232168f14b` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:31.368117 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ad2b8e7312f4bb1ad8d76232168f14b)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:31.370691 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:31.466208 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ad2b8e7312f4bb1ad8d76232168f14b', 'request_id': 'req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.478826 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ad2b8e7312f4bb1ad8d76232168f14b', 'request_id': 'req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.485436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ad2b8e7312f4bb1ad8d76232168f14b', 'request_id': 'req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.506470 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab admin admin] The token cache is being invalidate because project 3ad2b8e7312f4bb1ad8d76232168f14b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:31.506772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.507632 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.509421 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1143/2230] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:31 2022] DELETE /identity/v3/projects/3ad2b8e7312f4bb1ad8d76232168f14b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:31.513644 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f05553-f868-46bc-896f-19b70b28efb1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:31.515106 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f7f05553-f868-46bc-896f-19b70b28efb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:31.528665 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f05553-f868-46bc-896f-19b70b28efb1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:31.589181 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d5127-973e-45fb-b378-e9a70fa6500a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:31.590085 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d5127-973e-45fb-b378-e9a70fa6500a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:31.590367 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d5127-973e-45fb-b378-e9a70fa6500a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:31.590644 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d5127-973e-45fb-b378-e9a70fa6500a admin admin] PATH_INFO: `/v3/users/65e336a96f6245f89d4e70ab4f1c8642` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:31.591905 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d5127-973e-45fb-b378-e9a70fa6500a admin admin] RBAC: Authorizing `identity:delete_user(user_id=65e336a96f6245f89d4e70ab4f1c8642)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:31.593875 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78d5127-973e-45fb-b378-e9a70fa6500a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:31.648396 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d78d5127-973e-45fb-b378-e9a70fa6500a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65e336a96f6245f89d4e70ab4f1c8642'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.649993 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d78d5127-973e-45fb-b378-e9a70fa6500a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65e336a96f6245f89d4e70ab4f1c8642'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.650727 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d78d5127-973e-45fb-b378-e9a70fa6500a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65e336a96f6245f89d4e70ab4f1c8642'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.658184 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d78d5127-973e-45fb-b378-e9a70fa6500a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65e336a96f6245f89d4e70ab4f1c8642'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.671005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d78d5127-973e-45fb-b378-e9a70fa6500a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65e336a96f6245f89d4e70ab4f1c8642'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:31.681900 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:31.687753 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1088/2231] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:31 2022] DELETE /identity/v3/users/65e336a96f6245f89d4e70ab4f1c8642 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:31.987134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:31.989050 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:32.016825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb24c5c7-8a26-4414-8c38-4e9918fb46ab admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:32.084058 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705756e-9b64-47d0-82b3-a551f5010c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:32.085040 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705756e-9b64-47d0-82b3-a551f5010c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:32.085412 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705756e-9b64-47d0-82b3-a551f5010c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:32.085590 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705756e-9b64-47d0-82b3-a551f5010c7f admin admin] PATH_INFO: `/v3/projects/37a2f3b0d7a34f05a61a3882af2d896a` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:32.087096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705756e-9b64-47d0-82b3-a551f5010c7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=37a2f3b0d7a34f05a61a3882af2d896a)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:32.089355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705756e-9b64-47d0-82b3-a551f5010c7f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:32.152444 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f705756e-9b64-47d0-82b3-a551f5010c7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37a2f3b0d7a34f05a61a3882af2d896a', 'request_id': 'req-f705756e-9b64-47d0-82b3-a551f5010c7f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:32.165041 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f705756e-9b64-47d0-82b3-a551f5010c7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37a2f3b0d7a34f05a61a3882af2d896a', 'request_id': 'req-f705756e-9b64-47d0-82b3-a551f5010c7f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:32.173906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f705756e-9b64-47d0-82b3-a551f5010c7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37a2f3b0d7a34f05a61a3882af2d896a', 'request_id': 'req-f705756e-9b64-47d0-82b3-a551f5010c7f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:32.193076 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f705756e-9b64-47d0-82b3-a551f5010c7f admin admin] The token cache is being invalidate because project 37a2f3b0d7a34f05a61a3882af2d896a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:32.193371 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f705756e-9b64-47d0-82b3-a551f5010c7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:32.194118 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f705756e-9b64-47d0-82b3-a551f5010c7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:32.195909 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1144/2232] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:31 2022] DELETE /identity/v3/projects/37a2f3b0d7a34f05a61a3882af2d896a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:32.201179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579271e-8916-402c-9a0e-88db47638619 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:32.201557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579271e-8916-402c-9a0e-88db47638619 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:32.201895 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7579271e-8916-402c-9a0e-88db47638619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:32.220978 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7579271e-8916-402c-9a0e-88db47638619 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:32.222303 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7579271e-8916-402c-9a0e-88db47638619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:32.286815 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1089/2233] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:32.296425 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ae4c4-925b-43ef-aa4c-9a446b67f720 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:32.296958 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ae4c4-925b-43ef-aa4c-9a446b67f720 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:32.296958 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9ae4c4-925b-43ef-aa4c-9a446b67f720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:32.304629 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:32.317262 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fd9ae4c4-925b-43ef-aa4c-9a446b67f720 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:32.318493 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fd9ae4c4-925b-43ef-aa4c-9a446b67f720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:32.327248 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1145/2234] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:32.331676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579271e-8916-402c-9a0e-88db47638619 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:32.341389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7579271e-8916-402c-9a0e-88db47638619 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:32.345903 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d294ac-2683-4333-a811-900d2fd55eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:32.346563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d294ac-2683-4333-a811-900d2fd55eec admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:32.346845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d294ac-2683-4333-a811-900d2fd55eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:32.347115 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d294ac-2683-4333-a811-900d2fd55eec admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:32.347885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d294ac-2683-4333-a811-900d2fd55eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:32.348191 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d294ac-2683-4333-a811-900d2fd55eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:32.349803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d294ac-2683-4333-a811-900d2fd55eec admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:32.362150 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1090/2235] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:13:32.366908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ae4c4-925b-43ef-aa4c-9a446b67f720 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:32.377041 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9ae4c4-925b-43ef-aa4c-9a446b67f720 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:32.382223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d88e5-bf1c-41f8-9074-ecf987b5cdde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:32.382907 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d88e5-bf1c-41f8-9074-ecf987b5cdde admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:32.383192 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d88e5-bf1c-41f8-9074-ecf987b5cdde admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:32.383510 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d88e5-bf1c-41f8-9074-ecf987b5cdde admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:32.384218 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d88e5-bf1c-41f8-9074-ecf987b5cdde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:32.386169 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d88e5-bf1c-41f8-9074-ecf987b5cdde admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:32.416507 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1146/2236] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:32 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:32.420855 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d294ac-2683-4333-a811-900d2fd55eec admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:32.431606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d294ac-2683-4333-a811-900d2fd55eec admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:32.514247 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf844e7a-b722-4d37-a393-2ba224a60dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:32.514923 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf844e7a-b722-4d37-a393-2ba224a60dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:32.515212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf844e7a-b722-4d37-a393-2ba224a60dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:32.515532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf844e7a-b722-4d37-a393-2ba224a60dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:32.516228 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf844e7a-b722-4d37-a393-2ba224a60dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:32.518281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf844e7a-b722-4d37-a393-2ba224a60dc1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:32.548124 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1091/2237] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:32 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:32.553251 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d88e5-bf1c-41f8-9074-ecf987b5cdde admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:32.567733 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d88e5-bf1c-41f8-9074-ecf987b5cdde admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:32.574386 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2671c8c-6fac-411a-ab57-911ea37b0937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:32.575574 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2671c8c-6fac-411a-ab57-911ea37b0937 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:32.576050 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2671c8c-6fac-411a-ab57-911ea37b0937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:32.576570 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2671c8c-6fac-411a-ab57-911ea37b0937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:32.577558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2671c8c-6fac-411a-ab57-911ea37b0937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:32.579746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2671c8c-6fac-411a-ab57-911ea37b0937 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:32.592742 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1147/2238] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:32.596646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf844e7a-b722-4d37-a393-2ba224a60dc1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:32.617200 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf844e7a-b722-4d37-a393-2ba224a60dc1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:32.623878 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21eb4b-f08c-4886-9511-4a4874f1a1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:32.624684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21eb4b-f08c-4886-9511-4a4874f1a1fe admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:32.625004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21eb4b-f08c-4886-9511-4a4874f1a1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:32.625315 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21eb4b-f08c-4886-9511-4a4874f1a1fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:32.626118 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21eb4b-f08c-4886-9511-4a4874f1a1fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:32.631824 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21eb4b-f08c-4886-9511-4a4874f1a1fe admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:32.652299 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1092/2239] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:32 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:32.656797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2671c8c-6fac-411a-ab57-911ea37b0937 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:32.674431 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2671c8c-6fac-411a-ab57-911ea37b0937 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:32.682558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b470bc2-40f7-4ea8-90a6-1eef2d8f183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:32.683606 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b470bc2-40f7-4ea8-90a6-1eef2d8f183c admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:32.683769 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b470bc2-40f7-4ea8-90a6-1eef2d8f183c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:32.684044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b470bc2-40f7-4ea8-90a6-1eef2d8f183c admin admin] PATH_INFO: `/v3/projects/82043930a7424e3590924889079b7b7f/users/765f4ad165d14a67a61790928b160eb4/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:32.707631 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b470bc2-40f7-4ea8-90a6-1eef2d8f183c admin admin] RBAC: Authorizing `identity:create_grant(project_id=82043930a7424e3590924889079b7b7f, user_id=765f4ad165d14a67a61790928b160eb4, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:32.711382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b470bc2-40f7-4ea8-90a6-1eef2d8f183c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:32.741941 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1148/2240] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:32 2022] PUT /identity/v3/projects/82043930a7424e3590924889079b7b7f/users/765f4ad165d14a67a61790928b160eb4/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:32.744031 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331200eb-71e9-4a4d-bcd9-2ab30e71dd86 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:32.744328 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331200eb-71e9-4a4d-bcd9-2ab30e71dd86 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:32.744609 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331200eb-71e9-4a4d-bcd9-2ab30e71dd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:32.776133 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-331200eb-71e9-4a4d-bcd9-2ab30e71dd86 None None] MFA Rules not processed for user `765f4ad165d14a67a61790928b160eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:32.777635 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-331200eb-71e9-4a4d-bcd9-2ab30e71dd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:32.846007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:32.862825 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1093/2241] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:32.944186 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b470bc2-40f7-4ea8-90a6-1eef2d8f183c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:32.946173 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6b470bc2-40f7-4ea8-90a6-1eef2d8f183c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:33.030510 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b470bc2-40f7-4ea8-90a6-1eef2d8f183c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:33.036018 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a58d-8789-4555-9339-04fecab3ad6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:33.036984 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a58d-8789-4555-9339-04fecab3ad6e service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:33.037535 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a58d-8789-4555-9339-04fecab3ad6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:33.038004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a58d-8789-4555-9339-04fecab3ad6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:33.053896 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5a58d-8789-4555-9339-04fecab3ad6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:33.056305 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5a58d-8789-4555-9339-04fecab3ad6e service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:33.067414 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1149/2242] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:37.071116 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331200eb-71e9-4a4d-bcd9-2ab30e71dd86 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:37.072687 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-331200eb-71e9-4a4d-bcd9-2ab30e71dd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:37.157404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331200eb-71e9-4a4d-bcd9-2ab30e71dd86 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:37.162475 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bffdd-e234-4ab2-8a74-d8f90b1b463a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:37.163552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bffdd-e234-4ab2-8a74-d8f90b1b463a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:37.163673 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bffdd-e234-4ab2-8a74-d8f90b1b463a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:37.164055 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bffdd-e234-4ab2-8a74-d8f90b1b463a admin admin] PATH_INFO: `/v3/users/b9e9ac94e391429887296c4da62f30b5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:37.165335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bffdd-e234-4ab2-8a74-d8f90b1b463a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e9ac94e391429887296c4da62f30b5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:37.167271 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bffdd-e234-4ab2-8a74-d8f90b1b463a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:37.233606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d69bffdd-e234-4ab2-8a74-d8f90b1b463a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e9ac94e391429887296c4da62f30b5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:37.234374 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d69bffdd-e234-4ab2-8a74-d8f90b1b463a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e9ac94e391429887296c4da62f30b5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:37.235051 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d69bffdd-e234-4ab2-8a74-d8f90b1b463a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e9ac94e391429887296c4da62f30b5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:37.242314 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d69bffdd-e234-4ab2-8a74-d8f90b1b463a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e9ac94e391429887296c4da62f30b5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:37.254581 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d69bffdd-e234-4ab2-8a74-d8f90b1b463a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e9ac94e391429887296c4da62f30b5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:37.268161 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1094/2243] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:37 2022] DELETE /identity/v3/users/b9e9ac94e391429887296c4da62f30b5 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:37.468685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a58d-8789-4555-9339-04fecab3ad6e service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:37.480091 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a58d-8789-4555-9339-04fecab3ad6e service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:37.549071 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b275621-e207-49ac-b36c-752896db5c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:37.549966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b275621-e207-49ac-b36c-752896db5c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:37.550252 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b275621-e207-49ac-b36c-752896db5c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:37.550579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b275621-e207-49ac-b36c-752896db5c6e admin admin] PATH_INFO: `/v3/projects/b8d043fc94e647b5864b2d44ae419fa5` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:37.551802 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b275621-e207-49ac-b36c-752896db5c6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8d043fc94e647b5864b2d44ae419fa5)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:37.554461 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b275621-e207-49ac-b36c-752896db5c6e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:37.597636 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:37.600720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3b275621-e207-49ac-b36c-752896db5c6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8d043fc94e647b5864b2d44ae419fa5', 'request_id': 'req-3b275621-e207-49ac-b36c-752896db5c6e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:37.607978 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3b275621-e207-49ac-b36c-752896db5c6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8d043fc94e647b5864b2d44ae419fa5', 'request_id': 'req-3b275621-e207-49ac-b36c-752896db5c6e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:37.613554 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3b275621-e207-49ac-b36c-752896db5c6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8d043fc94e647b5864b2d44ae419fa5', 'request_id': 'req-3b275621-e207-49ac-b36c-752896db5c6e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:37.627445 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3b275621-e207-49ac-b36c-752896db5c6e admin admin] The token cache is being invalidate because project b8d043fc94e647b5864b2d44ae419fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:37.627731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3b275621-e207-49ac-b36c-752896db5c6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:37.628338 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3b275621-e207-49ac-b36c-752896db5c6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:37.629917 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1150/2244] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:37 2022] DELETE /identity/v3/projects/b8d043fc94e647b5864b2d44ae419fa5 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:37.634201 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bffdd-e234-4ab2-8a74-d8f90b1b463a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:37.635657 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d69bffdd-e234-4ab2-8a74-d8f90b1b463a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:37.649252 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bffdd-e234-4ab2-8a74-d8f90b1b463a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:37.710240 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace795d5-4fe5-407f-99bb-30eb8b57a544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:37.711236 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace795d5-4fe5-407f-99bb-30eb8b57a544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:37.711621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace795d5-4fe5-407f-99bb-30eb8b57a544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:37.711902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace795d5-4fe5-407f-99bb-30eb8b57a544 admin admin] PATH_INFO: `/v3/users/1807540cdedf4c828a492c964eee7db5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:37.713147 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace795d5-4fe5-407f-99bb-30eb8b57a544 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1807540cdedf4c828a492c964eee7db5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:37.715182 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace795d5-4fe5-407f-99bb-30eb8b57a544 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:37.730853 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:37.764224 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ace795d5-4fe5-407f-99bb-30eb8b57a544 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1807540cdedf4c828a492c964eee7db5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:37.765005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ace795d5-4fe5-407f-99bb-30eb8b57a544 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1807540cdedf4c828a492c964eee7db5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:37.765710 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ace795d5-4fe5-407f-99bb-30eb8b57a544 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1807540cdedf4c828a492c964eee7db5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:37.773148 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ace795d5-4fe5-407f-99bb-30eb8b57a544 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1807540cdedf4c828a492c964eee7db5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:37.785066 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ace795d5-4fe5-407f-99bb-30eb8b57a544 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1807540cdedf4c828a492c964eee7db5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:37.807360 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1095/2245] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:37 2022] DELETE /identity/v3/users/1807540cdedf4c828a492c964eee7db5 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:38.080061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b275621-e207-49ac-b36c-752896db5c6e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:38.082225 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3b275621-e207-49ac-b36c-752896db5c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:38.096293 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b275621-e207-49ac-b36c-752896db5c6e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:38.162034 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904a9dae-13c3-4e29-af43-c4b02809668f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:38.162915 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a9dae-13c3-4e29-af43-c4b02809668f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:38.163200 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a9dae-13c3-4e29-af43-c4b02809668f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:38.163504 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904a9dae-13c3-4e29-af43-c4b02809668f admin admin] PATH_INFO: `/v3/projects/b04ce510ad96411d85d3e9227e4c3e74` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:38.164825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a9dae-13c3-4e29-af43-c4b02809668f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b04ce510ad96411d85d3e9227e4c3e74)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:38.166755 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904a9dae-13c3-4e29-af43-c4b02809668f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:38.226967 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-904a9dae-13c3-4e29-af43-c4b02809668f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b04ce510ad96411d85d3e9227e4c3e74', 'request_id': 'req-904a9dae-13c3-4e29-af43-c4b02809668f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:38.233150 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-904a9dae-13c3-4e29-af43-c4b02809668f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b04ce510ad96411d85d3e9227e4c3e74', 'request_id': 'req-904a9dae-13c3-4e29-af43-c4b02809668f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:38.239339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-904a9dae-13c3-4e29-af43-c4b02809668f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b04ce510ad96411d85d3e9227e4c3e74', 'request_id': 'req-904a9dae-13c3-4e29-af43-c4b02809668f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:38.265809 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-904a9dae-13c3-4e29-af43-c4b02809668f admin admin] The token cache is being invalidate because project b04ce510ad96411d85d3e9227e4c3e74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:38.266231 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-904a9dae-13c3-4e29-af43-c4b02809668f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:38.266818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-904a9dae-13c3-4e29-af43-c4b02809668f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:38.268813 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1151/2246] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:38 2022] DELETE /identity/v3/projects/b04ce510ad96411d85d3e9227e4c3e74 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:38.273941 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd4c5f-2077-4698-9299-2a8f255498bd None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:38.274878 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd4c5f-2077-4698-9299-2a8f255498bd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:38.275285 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bd4c5f-2077-4698-9299-2a8f255498bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:38.300809 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-81bd4c5f-2077-4698-9299-2a8f255498bd None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:38.302039 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-81bd4c5f-2077-4698-9299-2a8f255498bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:38.373248 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1096/2247] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:38.381035 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe2694-e48c-47ad-ade1-b8cf30fa2d54 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:38.382000 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe2694-e48c-47ad-ade1-b8cf30fa2d54 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:38.382292 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defe2694-e48c-47ad-ade1-b8cf30fa2d54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:38.401843 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-defe2694-e48c-47ad-ade1-b8cf30fa2d54 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:38.403090 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-defe2694-e48c-47ad-ade1-b8cf30fa2d54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:38.412640 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1152/2248] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:38.417092 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd4c5f-2077-4698-9299-2a8f255498bd None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:38.427572 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bd4c5f-2077-4698-9299-2a8f255498bd None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:38.432843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa9db5-201a-42a1-a904-5102b9ef7165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:38.433524 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa9db5-201a-42a1-a904-5102b9ef7165 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:38.433806 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa9db5-201a-42a1-a904-5102b9ef7165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:38.434097 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa9db5-201a-42a1-a904-5102b9ef7165 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:38.434849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa9db5-201a-42a1-a904-5102b9ef7165 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:38.435329 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa9db5-201a-42a1-a904-5102b9ef7165 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:38.436976 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fa9db5-201a-42a1-a904-5102b9ef7165 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:38.453860 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1097/2249] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:13:38.459861 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe2694-e48c-47ad-ade1-b8cf30fa2d54 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:38.472445 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defe2694-e48c-47ad-ade1-b8cf30fa2d54 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:38.478742 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16960289-0e02-40c2-8d47-a4b314044d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:38.479834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16960289-0e02-40c2-8d47-a4b314044d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:38.480125 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16960289-0e02-40c2-8d47-a4b314044d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:38.480407 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16960289-0e02-40c2-8d47-a4b314044d47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:38.481126 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16960289-0e02-40c2-8d47-a4b314044d47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:38.483155 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16960289-0e02-40c2-8d47-a4b314044d47 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:38.516228 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1153/2250] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:38 2022] POST /identity/v3/projects => generated 361 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:38.520252 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa9db5-201a-42a1-a904-5102b9ef7165 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:38.531362 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa9db5-201a-42a1-a904-5102b9ef7165 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:38.627980 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1b9c0-b371-48cd-9934-32dfb5ed97c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:38.628707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1b9c0-b371-48cd-9934-32dfb5ed97c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:38.633985 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1b9c0-b371-48cd-9934-32dfb5ed97c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:38.634578 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e1b9c0-b371-48cd-9934-32dfb5ed97c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:38.635829 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1b9c0-b371-48cd-9934-32dfb5ed97c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:38.638201 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e1b9c0-b371-48cd-9934-32dfb5ed97c5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:38.669161 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1098/2251] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:38 2022] POST /identity/v3/users => generated 281 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:38.673390 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16960289-0e02-40c2-8d47-a4b314044d47 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:38.696237 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16960289-0e02-40c2-8d47-a4b314044d47 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:38.702538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e7360-a57e-424a-9e29-bcecad80e227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:38.707794 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e7360-a57e-424a-9e29-bcecad80e227 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:38.708894 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e7360-a57e-424a-9e29-bcecad80e227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:38.709238 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e7360-a57e-424a-9e29-bcecad80e227 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:38.710183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e7360-a57e-424a-9e29-bcecad80e227 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:38.712194 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e7360-a57e-424a-9e29-bcecad80e227 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:38.735266 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1154/2252] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:38.739244 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1b9c0-b371-48cd-9934-32dfb5ed97c5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:38.750973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e1b9c0-b371-48cd-9934-32dfb5ed97c5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:38.757736 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef54f557-e5f3-4d31-9c05-21371a275da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:38.758604 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54f557-e5f3-4d31-9c05-21371a275da8 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:38.759000 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54f557-e5f3-4d31-9c05-21371a275da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:38.759811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef54f557-e5f3-4d31-9c05-21371a275da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:38.760796 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54f557-e5f3-4d31-9c05-21371a275da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:38.763989 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef54f557-e5f3-4d31-9c05-21371a275da8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:38.783414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:38.800104 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1099/2253] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:38.802538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e7360-a57e-424a-9e29-bcecad80e227 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:38.831224 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e7360-a57e-424a-9e29-bcecad80e227 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:38.837914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85798b6e-1a64-4d96-8f4d-bba14b4b9b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:38.842199 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85798b6e-1a64-4d96-8f4d-bba14b4b9b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:38.842407 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85798b6e-1a64-4d96-8f4d-bba14b4b9b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:38.842683 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85798b6e-1a64-4d96-8f4d-bba14b4b9b40 admin admin] PATH_INFO: `/v3/projects/a1d4326e3c494785a03058d5a6ac04ac/users/8061e6c47d44435fb5cb0571bf9313c8/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:38.861632 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85798b6e-1a64-4d96-8f4d-bba14b4b9b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1d4326e3c494785a03058d5a6ac04ac, user_id=8061e6c47d44435fb5cb0571bf9313c8, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:38.865042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85798b6e-1a64-4d96-8f4d-bba14b4b9b40 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:38.882465 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:38.891416 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1155/2254] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:38 2022] PUT /identity/v3/projects/a1d4326e3c494785a03058d5a6ac04ac/users/8061e6c47d44435fb5cb0571bf9313c8/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:38.901730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c1403-1d77-4efd-bc4e-2d5dad596147 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:38.902066 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c1403-1d77-4efd-bc4e-2d5dad596147 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:38.902377 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c1403-1d77-4efd-bc4e-2d5dad596147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:38.940161 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0d9c1403-1d77-4efd-bc4e-2d5dad596147 None None] MFA Rules not processed for user `8061e6c47d44435fb5cb0571bf9313c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:38.941991 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0d9c1403-1d77-4efd-bc4e-2d5dad596147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:39.032695 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1100/2255] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:39.066392 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85798b6e-1a64-4d96-8f4d-bba14b4b9b40 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:39.074284 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-85798b6e-1a64-4d96-8f4d-bba14b4b9b40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:39.173139 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85798b6e-1a64-4d96-8f4d-bba14b4b9b40 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:39.177494 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65d777d-3cf4-4675-a300-3b91577ae389 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:39.178166 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d777d-3cf4-4675-a300-3b91577ae389 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:39.178451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d777d-3cf4-4675-a300-3b91577ae389 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:39.178728 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65d777d-3cf4-4675-a300-3b91577ae389 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:39.189549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d777d-3cf4-4675-a300-3b91577ae389 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:39.190676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65d777d-3cf4-4675-a300-3b91577ae389 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:39.201222 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1156/2256] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:39.218068 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c1403-1d77-4efd-bc4e-2d5dad596147 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:39.286766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c1403-1d77-4efd-bc4e-2d5dad596147 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:39.291343 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0add402-a7b5-47e2-a83a-733bf99e390c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:39.292213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0add402-a7b5-47e2-a83a-733bf99e390c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:39.292494 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0add402-a7b5-47e2-a83a-733bf99e390c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:39.292815 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0add402-a7b5-47e2-a83a-733bf99e390c admin admin] PATH_INFO: `/v3/users/8061e6c47d44435fb5cb0571bf9313c8` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:39.294142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0add402-a7b5-47e2-a83a-733bf99e390c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8061e6c47d44435fb5cb0571bf9313c8)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:39.296107 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0add402-a7b5-47e2-a83a-733bf99e390c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:39.345158 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c0add402-a7b5-47e2-a83a-733bf99e390c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8061e6c47d44435fb5cb0571bf9313c8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:39.345806 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c0add402-a7b5-47e2-a83a-733bf99e390c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8061e6c47d44435fb5cb0571bf9313c8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:39.346444 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c0add402-a7b5-47e2-a83a-733bf99e390c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8061e6c47d44435fb5cb0571bf9313c8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:39.354188 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c0add402-a7b5-47e2-a83a-733bf99e390c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8061e6c47d44435fb5cb0571bf9313c8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:39.365620 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c0add402-a7b5-47e2-a83a-733bf99e390c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8061e6c47d44435fb5cb0571bf9313c8'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:39.380498 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1101/2257] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:39 2022] DELETE /identity/v3/users/8061e6c47d44435fb5cb0571bf9313c8 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:39.385535 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d907e-46ea-4f12-8285-e7e156fc70c0 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:39.385852 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d907e-46ea-4f12-8285-e7e156fc70c0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:39.386115 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d907e-46ea-4f12-8285-e7e156fc70c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:39.404062 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-121d907e-46ea-4f12-8285-e7e156fc70c0 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:39.405241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-121d907e-46ea-4f12-8285-e7e156fc70c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:39.471605 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1157/2258] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:39.481265 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0add402-a7b5-47e2-a83a-733bf99e390c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:39.482927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c0add402-a7b5-47e2-a83a-733bf99e390c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:39.495046 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:39.545858 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0add402-a7b5-47e2-a83a-733bf99e390c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:39.550008 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69783bb8-a439-4786-a71e-4661e9670dd1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:39.550684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69783bb8-a439-4786-a71e-4661e9670dd1 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:39.550951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69783bb8-a439-4786-a71e-4661e9670dd1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:39.551230 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69783bb8-a439-4786-a71e-4661e9670dd1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:39.561720 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69783bb8-a439-4786-a71e-4661e9670dd1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:39.563184 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69783bb8-a439-4786-a71e-4661e9670dd1 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:39.574602 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1102/2259] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:39.923750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d907e-46ea-4f12-8285-e7e156fc70c0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:39.925402 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-121d907e-46ea-4f12-8285-e7e156fc70c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:39.942327 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d907e-46ea-4f12-8285-e7e156fc70c0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:39.949072 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c1be5-33a6-437d-bc67-40ae5a227aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:39.950325 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c1be5-33a6-437d-bc67-40ae5a227aa1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:39.950719 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c1be5-33a6-437d-bc67-40ae5a227aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:39.951132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c1be5-33a6-437d-bc67-40ae5a227aa1 admin admin] PATH_INFO: `/v3/projects/a1d4326e3c494785a03058d5a6ac04ac` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:39.952683 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c1be5-33a6-437d-bc67-40ae5a227aa1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1d4326e3c494785a03058d5a6ac04ac)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:39.956595 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c1be5-33a6-437d-bc67-40ae5a227aa1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:40.038228 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-124c1be5-33a6-437d-bc67-40ae5a227aa1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1d4326e3c494785a03058d5a6ac04ac', 'request_id': 'req-124c1be5-33a6-437d-bc67-40ae5a227aa1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:40.045820 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-124c1be5-33a6-437d-bc67-40ae5a227aa1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1d4326e3c494785a03058d5a6ac04ac', 'request_id': 'req-124c1be5-33a6-437d-bc67-40ae5a227aa1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:40.073937 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-124c1be5-33a6-437d-bc67-40ae5a227aa1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1d4326e3c494785a03058d5a6ac04ac', 'request_id': 'req-124c1be5-33a6-437d-bc67-40ae5a227aa1'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:40.101240 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-124c1be5-33a6-437d-bc67-40ae5a227aa1 admin admin] The token cache is being invalidate because project a1d4326e3c494785a03058d5a6ac04ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:40.103933 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-124c1be5-33a6-437d-bc67-40ae5a227aa1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:40.105185 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-124c1be5-33a6-437d-bc67-40ae5a227aa1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:40.114822 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a8437-aef8-452d-b429-97e10852c420 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:40.115124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a8437-aef8-452d-b429-97e10852c420 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:40.115479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898a8437-aef8-452d-b429-97e10852c420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:40.116900 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1158/2260] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:39 2022] DELETE /identity/v3/projects/a1d4326e3c494785a03058d5a6ac04ac => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:40.150570 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-898a8437-aef8-452d-b429-97e10852c420 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:40.154314 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-898a8437-aef8-452d-b429-97e10852c420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:40.208868 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c1be5-33a6-437d-bc67-40ae5a227aa1 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:40.211562 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-124c1be5-33a6-437d-bc67-40ae5a227aa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:40.255756 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1103/2261] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:40.263562 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7400a76-59dc-4ebb-affc-5156c31439f7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:40.263996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7400a76-59dc-4ebb-affc-5156c31439f7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:40.264288 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7400a76-59dc-4ebb-affc-5156c31439f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:40.269594 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:40.304202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f7400a76-59dc-4ebb-affc-5156c31439f7 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:40.306207 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f7400a76-59dc-4ebb-affc-5156c31439f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:40.315517 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1104/2262] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:40.319202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7400a76-59dc-4ebb-affc-5156c31439f7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:40.330461 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7400a76-59dc-4ebb-affc-5156c31439f7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:40.338196 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ce2b4-2f10-450b-a7c4-02312ac1a983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:40.339108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ce2b4-2f10-450b-a7c4-02312ac1a983 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:40.339564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ce2b4-2f10-450b-a7c4-02312ac1a983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:40.340007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7ce2b4-2f10-450b-a7c4-02312ac1a983 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:40.341782 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ce2b4-2f10-450b-a7c4-02312ac1a983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:40.342249 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ce2b4-2f10-450b-a7c4-02312ac1a983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:40.344285 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7ce2b4-2f10-450b-a7c4-02312ac1a983 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:40.362858 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1105/2263] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:13:40.367454 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ce2b4-2f10-450b-a7c4-02312ac1a983 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:40.371626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c1be5-33a6-437d-bc67-40ae5a227aa1 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:40.378422 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d262f394-796f-42b1-9e00-31be82c22aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:40.379611 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262f394-796f-42b1-9e00-31be82c22aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:40.379944 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262f394-796f-42b1-9e00-31be82c22aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:40.380225 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d262f394-796f-42b1-9e00-31be82c22aa0 admin admin] PATH_INFO: `/v3/users/76a9ac282cce4c78bfbcf1c5134a31a5` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:40.381878 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262f394-796f-42b1-9e00-31be82c22aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76a9ac282cce4c78bfbcf1c5134a31a5)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:40.383951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d262f394-796f-42b1-9e00-31be82c22aa0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:40.388564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7ce2b4-2f10-450b-a7c4-02312ac1a983 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:40.394382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0a234-8710-472b-bbd6-9a7f503a096b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:40.397448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0a234-8710-472b-bbd6-9a7f503a096b admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:40.398071 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0a234-8710-472b-bbd6-9a7f503a096b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:40.398711 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0a234-8710-472b-bbd6-9a7f503a096b admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:40.399507 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0a234-8710-472b-bbd6-9a7f503a096b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:40.401465 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0a234-8710-472b-bbd6-9a7f503a096b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:40.440144 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1106/2264] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:40 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:40.445267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0a234-8710-472b-bbd6-9a7f503a096b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:40.451359 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d262f394-796f-42b1-9e00-31be82c22aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76a9ac282cce4c78bfbcf1c5134a31a5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:40.452092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d262f394-796f-42b1-9e00-31be82c22aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76a9ac282cce4c78bfbcf1c5134a31a5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:40.464571 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d262f394-796f-42b1-9e00-31be82c22aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76a9ac282cce4c78bfbcf1c5134a31a5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:40.466653 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d262f394-796f-42b1-9e00-31be82c22aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76a9ac282cce4c78bfbcf1c5134a31a5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:40.478204 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d262f394-796f-42b1-9e00-31be82c22aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76a9ac282cce4c78bfbcf1c5134a31a5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:40.514376 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1159/2265] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:40 2022] DELETE /identity/v3/users/76a9ac282cce4c78bfbcf1c5134a31a5 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:40.519066 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27754f33-ef0a-4ddf-a6c8-2bfbadf60b65 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:40.520864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27754f33-ef0a-4ddf-a6c8-2bfbadf60b65 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:40.521218 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27754f33-ef0a-4ddf-a6c8-2bfbadf60b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:40.550108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-27754f33-ef0a-4ddf-a6c8-2bfbadf60b65 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:40.551896 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-27754f33-ef0a-4ddf-a6c8-2bfbadf60b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:40.555522 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0a234-8710-472b-bbd6-9a7f503a096b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:40.571756 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:40.619983 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a93fc8-f116-46e9-b403-0f43eb2d9449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:40.620883 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a93fc8-f116-46e9-b403-0f43eb2d9449 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:40.622093 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a93fc8-f116-46e9-b403-0f43eb2d9449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:40.622545 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a93fc8-f116-46e9-b403-0f43eb2d9449 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:40.623567 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a93fc8-f116-46e9-b403-0f43eb2d9449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:40.625673 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a93fc8-f116-46e9-b403-0f43eb2d9449 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:40.654895 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1107/2266] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:40 2022] POST /identity/v3/users => generated 287 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:40.656396 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a93fc8-f116-46e9-b403-0f43eb2d9449 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:40.658479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-04a93fc8-f116-46e9-b403-0f43eb2d9449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:40.671863 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a93fc8-f116-46e9-b403-0f43eb2d9449 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:40.677954 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3519c6-9f9d-4783-9251-daa44ceba81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:40.678890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3519c6-9f9d-4783-9251-daa44ceba81a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:40.679271 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3519c6-9f9d-4783-9251-daa44ceba81a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:40.681398 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3519c6-9f9d-4783-9251-daa44ceba81a admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:40.682341 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3519c6-9f9d-4783-9251-daa44ceba81a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:40.684643 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3519c6-9f9d-4783-9251-daa44ceba81a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:40.714588 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1108/2267] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:13:40.714914 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1160/2268] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:40.722018 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3519c6-9f9d-4783-9251-daa44ceba81a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:40.722561 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27754f33-ef0a-4ddf-a6c8-2bfbadf60b65 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:40.727430 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-27754f33-ef0a-4ddf-a6c8-2bfbadf60b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:40.738334 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3519c6-9f9d-4783-9251-daa44ceba81a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:40.743918 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1f488-384a-4ac2-8a09-5144e2622fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:40.744686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1f488-384a-4ac2-8a09-5144e2622fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:40.745038 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1f488-384a-4ac2-8a09-5144e2622fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:40.745524 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1f488-384a-4ac2-8a09-5144e2622fc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:40.746607 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1f488-384a-4ac2-8a09-5144e2622fc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:40.748536 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1f488-384a-4ac2-8a09-5144e2622fc6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:40.765139 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1109/2269] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:40.766647 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1f488-384a-4ac2-8a09-5144e2622fc6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:40.786083 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1f488-384a-4ac2-8a09-5144e2622fc6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:40.791253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d27aca-d67f-4570-aa1e-77cd8643a0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:40.792215 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d27aca-d67f-4570-aa1e-77cd8643a0cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:40.792471 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d27aca-d67f-4570-aa1e-77cd8643a0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:40.792890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d27aca-d67f-4570-aa1e-77cd8643a0cf admin admin] PATH_INFO: `/v3/projects/8c2dae7c45ad48cebacb50282ed0154d/users/412ae0713f2f49bd8b8c6bf37b64acc4/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:40.804293 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:40.810099 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27754f33-ef0a-4ddf-a6c8-2bfbadf60b65 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:40.810921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d27aca-d67f-4570-aa1e-77cd8643a0cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2dae7c45ad48cebacb50282ed0154d, user_id=412ae0713f2f49bd8b8c6bf37b64acc4, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:40.813875 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d27aca-d67f-4570-aa1e-77cd8643a0cf admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:40.814714 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a96f7-eeb2-4c8a-84fe-c9ce37e4ea99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:40.815679 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a96f7-eeb2-4c8a-84fe-c9ce37e4ea99 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:40.816826 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a96f7-eeb2-4c8a-84fe-c9ce37e4ea99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:40.817437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474a96f7-eeb2-4c8a-84fe-c9ce37e4ea99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:40.831540 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a96f7-eeb2-4c8a-84fe-c9ce37e4ea99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:40.833485 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474a96f7-eeb2-4c8a-84fe-c9ce37e4ea99 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:40.834686 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1110/2270] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:40 2022] PUT /identity/v3/projects/8c2dae7c45ad48cebacb50282ed0154d/users/412ae0713f2f49bd8b8c6bf37b64acc4/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:40.846319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f08513-6f79-4b1a-80e4-8c99c5800be7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:40.846319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f08513-6f79-4b1a-80e4-8c99c5800be7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:40.846319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f08513-6f79-4b1a-80e4-8c99c5800be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:40.857723 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1161/2271] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:40.895971 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-77f08513-6f79-4b1a-80e4-8c99c5800be7 None None] MFA Rules not processed for user `412ae0713f2f49bd8b8c6bf37b64acc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:40.897383 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-77f08513-6f79-4b1a-80e4-8c99c5800be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:41.027897 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1111/2272] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:41.039247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a96f7-eeb2-4c8a-84fe-c9ce37e4ea99 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:41.041184 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-474a96f7-eeb2-4c8a-84fe-c9ce37e4ea99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:41.126564 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474a96f7-eeb2-4c8a-84fe-c9ce37e4ea99 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:41.194086 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63fd203-5c2d-4fe1-9eda-53d65a8a4c95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:41.194759 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fd203-5c2d-4fe1-9eda-53d65a8a4c95 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:41.195509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fd203-5c2d-4fe1-9eda-53d65a8a4c95 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:41.195509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63fd203-5c2d-4fe1-9eda-53d65a8a4c95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:41.204831 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fd203-5c2d-4fe1-9eda-53d65a8a4c95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:41.206362 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63fd203-5c2d-4fe1-9eda-53d65a8a4c95 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:41.216408 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1162/2273] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:41.242300 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f08513-6f79-4b1a-80e4-8c99c5800be7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:41.244198 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-77f08513-6f79-4b1a-80e4-8c99c5800be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:41.306048 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:41.335956 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f08513-6f79-4b1a-80e4-8c99c5800be7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:41.342658 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac4591-7af3-4419-83b3-88fd560f52b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:41.343686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac4591-7af3-4419-83b3-88fd560f52b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:41.343968 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac4591-7af3-4419-83b3-88fd560f52b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:41.344296 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac4591-7af3-4419-83b3-88fd560f52b7 admin admin] PATH_INFO: `/v3/projects/44c0538a8d354819a1662f529700f98e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:41.345533 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac4591-7af3-4419-83b3-88fd560f52b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44c0538a8d354819a1662f529700f98e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:41.347516 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac4591-7af3-4419-83b3-88fd560f52b7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:41.416930 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c8ac4591-7af3-4419-83b3-88fd560f52b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44c0538a8d354819a1662f529700f98e', 'request_id': 'req-c8ac4591-7af3-4419-83b3-88fd560f52b7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:41.425397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c8ac4591-7af3-4419-83b3-88fd560f52b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44c0538a8d354819a1662f529700f98e', 'request_id': 'req-c8ac4591-7af3-4419-83b3-88fd560f52b7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:41.433820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c8ac4591-7af3-4419-83b3-88fd560f52b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44c0538a8d354819a1662f529700f98e', 'request_id': 'req-c8ac4591-7af3-4419-83b3-88fd560f52b7'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:41.448500 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c8ac4591-7af3-4419-83b3-88fd560f52b7 admin admin] The token cache is being invalidate because project 44c0538a8d354819a1662f529700f98e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:41.448800 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c8ac4591-7af3-4419-83b3-88fd560f52b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:41.449799 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c8ac4591-7af3-4419-83b3-88fd560f52b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:41.451406 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1112/2274] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:41 2022] DELETE /identity/v3/projects/44c0538a8d354819a1662f529700f98e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:41.457128 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68eceb-34d8-4699-9632-466a290534b8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:41.457493 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68eceb-34d8-4699-9632-466a290534b8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:41.457841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68eceb-34d8-4699-9632-466a290534b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:41.487480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-6e68eceb-34d8-4699-9632-466a290534b8 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:41.488690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6e68eceb-34d8-4699-9632-466a290534b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:41.565735 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1163/2275] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:41.567429 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab2faf-f5d3-47cb-9987-116ddf0db88d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:41.567629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab2faf-f5d3-47cb-9987-116ddf0db88d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:41.567973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab2faf-f5d3-47cb-9987-116ddf0db88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:41.588699 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b7ab2faf-f5d3-47cb-9987-116ddf0db88d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:41.590123 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b7ab2faf-f5d3-47cb-9987-116ddf0db88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:41.603281 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1113/2276] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:41.604802 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68eceb-34d8-4699-9632-466a290534b8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:41.615918 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68eceb-34d8-4699-9632-466a290534b8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:41.621647 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8913b4-bd4a-44e1-9206-cc4f6f7cdf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:41.622343 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8913b4-bd4a-44e1-9206-cc4f6f7cdf04 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:41.622726 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8913b4-bd4a-44e1-9206-cc4f6f7cdf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:41.622969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8913b4-bd4a-44e1-9206-cc4f6f7cdf04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:41.623745 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8913b4-bd4a-44e1-9206-cc4f6f7cdf04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:41.624052 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8913b4-bd4a-44e1-9206-cc4f6f7cdf04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:41.625878 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8913b4-bd4a-44e1-9206-cc4f6f7cdf04 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:41.638326 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1164/2277] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:13:41.642927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab2faf-f5d3-47cb-9987-116ddf0db88d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:41.652893 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab2faf-f5d3-47cb-9987-116ddf0db88d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:41.657650 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4691e-2352-446c-93d2-bc6f3c8a255c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:41.658315 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4691e-2352-446c-93d2-bc6f3c8a255c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:41.658601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4691e-2352-446c-93d2-bc6f3c8a255c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:41.658912 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4691e-2352-446c-93d2-bc6f3c8a255c admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:41.659684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4691e-2352-446c-93d2-bc6f3c8a255c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:41.661601 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4691e-2352-446c-93d2-bc6f3c8a255c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:41.687929 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1114/2278] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:41 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:41.692187 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8913b4-bd4a-44e1-9206-cc4f6f7cdf04 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:41.702704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8913b4-bd4a-44e1-9206-cc4f6f7cdf04 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:41.735382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:41.759471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e9d11-b617-4661-ad1d-c02ec8d30be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:41.760163 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e9d11-b617-4661-ad1d-c02ec8d30be6 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:41.760445 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e9d11-b617-4661-ad1d-c02ec8d30be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:41.760718 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1e9d11-b617-4661-ad1d-c02ec8d30be6 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:41.761412 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e9d11-b617-4661-ad1d-c02ec8d30be6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:41.763342 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1e9d11-b617-4661-ad1d-c02ec8d30be6 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:41.789982 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1165/2279] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:41 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:41.791309 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4691e-2352-446c-93d2-bc6f3c8a255c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:41.802102 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4691e-2352-446c-93d2-bc6f3c8a255c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:41.808335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe67e93-32fa-46a4-bf75-dc7ac0fa4d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:41.808988 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe67e93-32fa-46a4-bf75-dc7ac0fa4d66 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:41.809275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe67e93-32fa-46a4-bf75-dc7ac0fa4d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:41.809554 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe67e93-32fa-46a4-bf75-dc7ac0fa4d66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:41.810304 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe67e93-32fa-46a4-bf75-dc7ac0fa4d66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:41.811999 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe67e93-32fa-46a4-bf75-dc7ac0fa4d66 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:41.823390 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1115/2280] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:41.827564 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e9d11-b617-4661-ad1d-c02ec8d30be6 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:41.840923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1e9d11-b617-4661-ad1d-c02ec8d30be6 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:41.847256 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b118e39-a803-4fd4-aea3-b78c300406ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:41.848232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b118e39-a803-4fd4-aea3-b78c300406ff admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:41.848566 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b118e39-a803-4fd4-aea3-b78c300406ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:41.848913 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b118e39-a803-4fd4-aea3-b78c300406ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:41.849746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b118e39-a803-4fd4-aea3-b78c300406ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:41.851673 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b118e39-a803-4fd4-aea3-b78c300406ff admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:41.862570 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1166/2281] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:13:41.866970 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe67e93-32fa-46a4-bf75-dc7ac0fa4d66 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:41.877710 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe67e93-32fa-46a4-bf75-dc7ac0fa4d66 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:41.882951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aa9ef-6100-43af-a306-e83186293ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:41.883875 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aa9ef-6100-43af-a306-e83186293ba1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:41.884198 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aa9ef-6100-43af-a306-e83186293ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:41.884481 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243aa9ef-6100-43af-a306-e83186293ba1 admin admin] PATH_INFO: `/v3/projects/a4be688b1a0b45abb57037a86d0592d9/users/bcd31690a80742fb9cd35ea1bbcd229b/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:41.900190 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243aa9ef-6100-43af-a306-e83186293ba1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4be688b1a0b45abb57037a86d0592d9, user_id=bcd31690a80742fb9cd35ea1bbcd229b, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:41.902898 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243aa9ef-6100-43af-a306-e83186293ba1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:41.916783 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1116/2282] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:41 2022] PUT /identity/v3/projects/a4be688b1a0b45abb57037a86d0592d9/users/bcd31690a80742fb9cd35ea1bbcd229b/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:41.927650 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c443795-7495-4f50-beb8-029a9f917b39 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:41.927982 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c443795-7495-4f50-beb8-029a9f917b39 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:41.928265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c443795-7495-4f50-beb8-029a9f917b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:41.956163 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5c443795-7495-4f50-beb8-029a9f917b39 None None] MFA Rules not processed for user `bcd31690a80742fb9cd35ea1bbcd229b`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:41.957324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5c443795-7495-4f50-beb8-029a9f917b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:42.023647 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1167/2283] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:41 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:42.035416 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aa9ef-6100-43af-a306-e83186293ba1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:42.037298 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-243aa9ef-6100-43af-a306-e83186293ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:42.100864 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243aa9ef-6100-43af-a306-e83186293ba1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:42.104687 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4cee3-209c-4df3-837a-d6e2d04894f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbdf910e67d4185a0ae14edf34ee3b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:42.105362 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4cee3-209c-4df3-837a-d6e2d04894f7 service glance] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:42.105635 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4cee3-209c-4df3-837a-d6e2d04894f7 service glance] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:42.105915 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4cee3-209c-4df3-837a-d6e2d04894f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:42.115546 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4cee3-209c-4df3-837a-d6e2d04894f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:42.117108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4cee3-209c-4df3-837a-d6e2d04894f7 service glance] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:42.131454 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1117/2284] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:44.354716 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c443795-7495-4f50-beb8-029a9f917b39 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:44.356308 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5c443795-7495-4f50-beb8-029a9f917b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:44.422549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c443795-7495-4f50-beb8-029a9f917b39 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:44.427694 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3982306-4b2d-4707-8587-7301f1566dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:44.428680 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3982306-4b2d-4707-8587-7301f1566dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:44.428963 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3982306-4b2d-4707-8587-7301f1566dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:44.429241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3982306-4b2d-4707-8587-7301f1566dd8 admin admin] PATH_INFO: `/v3/users/412ae0713f2f49bd8b8c6bf37b64acc4` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:44.430676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3982306-4b2d-4707-8587-7301f1566dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=412ae0713f2f49bd8b8c6bf37b64acc4)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:44.432772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3982306-4b2d-4707-8587-7301f1566dd8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:44.486069 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:44.488296 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c3982306-4b2d-4707-8587-7301f1566dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '412ae0713f2f49bd8b8c6bf37b64acc4'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:44.489247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c3982306-4b2d-4707-8587-7301f1566dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '412ae0713f2f49bd8b8c6bf37b64acc4'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:44.502797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c3982306-4b2d-4707-8587-7301f1566dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '412ae0713f2f49bd8b8c6bf37b64acc4'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:44.503474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c3982306-4b2d-4707-8587-7301f1566dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '412ae0713f2f49bd8b8c6bf37b64acc4'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:44.512619 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c3982306-4b2d-4707-8587-7301f1566dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '412ae0713f2f49bd8b8c6bf37b64acc4'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:44.531408 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1168/2285] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:44 2022] DELETE /identity/v3/users/412ae0713f2f49bd8b8c6bf37b64acc4 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:44.536758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c935b3-0e6b-4116-a5e2-ad8b48d77bc8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:44.537300 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c935b3-0e6b-4116-a5e2-ad8b48d77bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:44.537651 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c935b3-0e6b-4116-a5e2-ad8b48d77bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:44.556495 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-64c935b3-0e6b-4116-a5e2-ad8b48d77bc8 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:44.557715 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-64c935b3-0e6b-4116-a5e2-ad8b48d77bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:44.571796 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:44.624799 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1118/2286] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:44.635497 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3982306-4b2d-4707-8587-7301f1566dd8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:44.637103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c3982306-4b2d-4707-8587-7301f1566dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:44.698629 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3982306-4b2d-4707-8587-7301f1566dd8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:44.702279 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e00dd4-9d54-4b64-b3cc-3b272258b64a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:44.702929 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e00dd4-9d54-4b64-b3cc-3b272258b64a service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:44.703220 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e00dd4-9d54-4b64-b3cc-3b272258b64a service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:44.703532 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e00dd4-9d54-4b64-b3cc-3b272258b64a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:44.713737 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e00dd4-9d54-4b64-b3cc-3b272258b64a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:44.715199 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e00dd4-9d54-4b64-b3cc-3b272258b64a service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:44.725238 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1169/2287] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:44.811491 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c935b3-0e6b-4116-a5e2-ad8b48d77bc8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:44.814128 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-64c935b3-0e6b-4116-a5e2-ad8b48d77bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:44.830419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c935b3-0e6b-4116-a5e2-ad8b48d77bc8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:44.835849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9f399-2547-4afe-b6c8-586c47ccc434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:44.836970 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9f399-2547-4afe-b6c8-586c47ccc434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:44.837254 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9f399-2547-4afe-b6c8-586c47ccc434 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:44.837556 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b9f399-2547-4afe-b6c8-586c47ccc434 admin admin] PATH_INFO: `/v3/users/765f4ad165d14a67a61790928b160eb4` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:44.838755 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9f399-2547-4afe-b6c8-586c47ccc434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=765f4ad165d14a67a61790928b160eb4)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:44.840786 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b9f399-2547-4afe-b6c8-586c47ccc434 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:44.892994 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-74b9f399-2547-4afe-b6c8-586c47ccc434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765f4ad165d14a67a61790928b160eb4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:44.893933 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-74b9f399-2547-4afe-b6c8-586c47ccc434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765f4ad165d14a67a61790928b160eb4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:44.894721 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-74b9f399-2547-4afe-b6c8-586c47ccc434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765f4ad165d14a67a61790928b160eb4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:44.907014 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-74b9f399-2547-4afe-b6c8-586c47ccc434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765f4ad165d14a67a61790928b160eb4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:44.920078 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-74b9f399-2547-4afe-b6c8-586c47ccc434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765f4ad165d14a67a61790928b160eb4'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:44.935712 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1119/2288] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:13:44 2022] DELETE /identity/v3/users/765f4ad165d14a67a61790928b160eb4 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:44.940483 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54e328-0c29-429e-a188-bbfd30308a2c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:44.940779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54e328-0c29-429e-a188-bbfd30308a2c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:44.941063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f54e328-0c29-429e-a188-bbfd30308a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:44.959711 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3f54e328-0c29-429e-a188-bbfd30308a2c None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:44.960956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3f54e328-0c29-429e-a188-bbfd30308a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:45.036297 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9f399-2547-4afe-b6c8-586c47ccc434 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:45.037908 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-74b9f399-2547-4afe-b6c8-586c47ccc434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:45.059911 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1170/2289] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:45.070114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54e328-0c29-429e-a188-bbfd30308a2c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:45.072661 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3f54e328-0c29-429e-a188-bbfd30308a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:45.134678 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b9f399-2547-4afe-b6c8-586c47ccc434 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:45.139276 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f54e328-0c29-429e-a188-bbfd30308a2c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:45.140392 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748fb445-568a-4a8d-ac05-dff294e8d589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:45.141282 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fb445-568a-4a8d-ac05-dff294e8d589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.141566 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fb445-568a-4a8d-ac05-dff294e8d589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.141848 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fb445-568a-4a8d-ac05-dff294e8d589 admin admin] PATH_INFO: `/v3/projects/8c2dae7c45ad48cebacb50282ed0154d` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.143079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d75ce9-6d11-40cc-929c-6135e45c29d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:45.143237 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fb445-568a-4a8d-ac05-dff294e8d589 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c2dae7c45ad48cebacb50282ed0154d)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:45.143770 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d75ce9-6d11-40cc-929c-6135e45c29d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.144056 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d75ce9-6d11-40cc-929c-6135e45c29d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.144336 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d75ce9-6d11-40cc-929c-6135e45c29d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.145098 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748fb445-568a-4a8d-ac05-dff294e8d589 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:45.154897 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d75ce9-6d11-40cc-929c-6135e45c29d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:45.156766 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d75ce9-6d11-40cc-929c-6135e45c29d0 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:45.168246 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1171/2290] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:13:45.207232 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:45.221144 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-748fb445-568a-4a8d-ac05-dff294e8d589 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c2dae7c45ad48cebacb50282ed0154d', 'request_id': 'req-748fb445-568a-4a8d-ac05-dff294e8d589'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:45.229961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-748fb445-568a-4a8d-ac05-dff294e8d589 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c2dae7c45ad48cebacb50282ed0154d', 'request_id': 'req-748fb445-568a-4a8d-ac05-dff294e8d589'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:45.237202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-748fb445-568a-4a8d-ac05-dff294e8d589 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c2dae7c45ad48cebacb50282ed0154d', 'request_id': 'req-748fb445-568a-4a8d-ac05-dff294e8d589'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:45.255373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-748fb445-568a-4a8d-ac05-dff294e8d589 admin admin] The token cache is being invalidate because project 8c2dae7c45ad48cebacb50282ed0154d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:45.255679 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-748fb445-568a-4a8d-ac05-dff294e8d589 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:45.256572 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-748fb445-568a-4a8d-ac05-dff294e8d589 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:45.258643 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1120/2291] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:45 2022] DELETE /identity/v3/projects/8c2dae7c45ad48cebacb50282ed0154d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:45.263455 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf5e31-83b9-4c2c-88b6-9ee170fc0c25 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.263765 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf5e31-83b9-4c2c-88b6-9ee170fc0c25 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.264041 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf5e31-83b9-4c2c-88b6-9ee170fc0c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.292355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4abf5e31-83b9-4c2c-88b6-9ee170fc0c25 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:45.293526 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4abf5e31-83b9-4c2c-88b6-9ee170fc0c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:45.299076 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:45.382057 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1172/2292] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:45.389825 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b42314-9d84-4081-a783-3aa2179c5760 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.390141 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b42314-9d84-4081-a783-3aa2179c5760 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.390432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b42314-9d84-4081-a783-3aa2179c5760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.411177 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b9b42314-9d84-4081-a783-3aa2179c5760 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:45.412457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b9b42314-9d84-4081-a783-3aa2179c5760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:45.422465 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1121/2293] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:45.427020 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf5e31-83b9-4c2c-88b6-9ee170fc0c25 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:45.437844 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf5e31-83b9-4c2c-88b6-9ee170fc0c25 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:45.443446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccb727-a09e-4d80-abc7-8c1ff62cd017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:45.444134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccb727-a09e-4d80-abc7-8c1ff62cd017 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.444514 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccb727-a09e-4d80-abc7-8c1ff62cd017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.444692 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccb727-a09e-4d80-abc7-8c1ff62cd017 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.445477 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccb727-a09e-4d80-abc7-8c1ff62cd017 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:45.445820 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccb727-a09e-4d80-abc7-8c1ff62cd017 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:45.447509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ccb727-a09e-4d80-abc7-8c1ff62cd017 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:45.460595 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1173/2294] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:13:45.465152 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b42314-9d84-4081-a783-3aa2179c5760 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:45.474529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b42314-9d84-4081-a783-3aa2179c5760 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:45.480201 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2e11c-9c56-4616-9b07-f3074a6bb22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:45.480706 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2e11c-9c56-4616-9b07-f3074a6bb22a admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.480990 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2e11c-9c56-4616-9b07-f3074a6bb22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.481265 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d2e11c-9c56-4616-9b07-f3074a6bb22a admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.481958 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2e11c-9c56-4616-9b07-f3074a6bb22a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:45.483911 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d2e11c-9c56-4616-9b07-f3074a6bb22a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:45.487214 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccb727-a09e-4d80-abc7-8c1ff62cd017 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:45.489058 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e2ccb727-a09e-4d80-abc7-8c1ff62cd017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:45.505035 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccb727-a09e-4d80-abc7-8c1ff62cd017 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:45.510352 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a972e-3324-466c-b92c-2142cbce3d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:45.511479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a972e-3324-466c-b92c-2142cbce3d7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.512042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a972e-3324-466c-b92c-2142cbce3d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.512042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a972e-3324-466c-b92c-2142cbce3d7a admin admin] PATH_INFO: `/v3/projects/82043930a7424e3590924889079b7b7f` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.513452 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a972e-3324-466c-b92c-2142cbce3d7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=82043930a7424e3590924889079b7b7f)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:45.515491 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a972e-3324-466c-b92c-2142cbce3d7a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:45.516040 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1122/2295] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:45 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:45.532607 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2e11c-9c56-4616-9b07-f3074a6bb22a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:45.573129 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7d6a972e-3324-466c-b92c-2142cbce3d7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82043930a7424e3590924889079b7b7f', 'request_id': 'req-7d6a972e-3324-466c-b92c-2142cbce3d7a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:45.581314 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7d6a972e-3324-466c-b92c-2142cbce3d7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82043930a7424e3590924889079b7b7f', 'request_id': 'req-7d6a972e-3324-466c-b92c-2142cbce3d7a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:45.588061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7d6a972e-3324-466c-b92c-2142cbce3d7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82043930a7424e3590924889079b7b7f', 'request_id': 'req-7d6a972e-3324-466c-b92c-2142cbce3d7a'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:45.598339 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d2e11c-9c56-4616-9b07-f3074a6bb22a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:45.601868 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7d6a972e-3324-466c-b92c-2142cbce3d7a admin admin] The token cache is being invalidate because project 82043930a7424e3590924889079b7b7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:13:45.602161 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7d6a972e-3324-466c-b92c-2142cbce3d7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:45.602800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7d6a972e-3324-466c-b92c-2142cbce3d7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:13:45.604445 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1174/2296] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:13:45 2022] DELETE /identity/v3/projects/82043930a7424e3590924889079b7b7f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:45.609200 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3b6a5-847f-403f-b79c-b17f9da40a81 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.609544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3b6a5-847f-403f-b79c-b17f9da40a81 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.609845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3b6a5-847f-403f-b79c-b17f9da40a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.630678 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-71e3b6a5-847f-403f-b79c-b17f9da40a81 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:45.632109 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-71e3b6a5-847f-403f-b79c-b17f9da40a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:45.661309 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827cc4f-9f7e-420d-ba24-e26ce26e8afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:45.661992 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827cc4f-9f7e-420d-ba24-e26ce26e8afa admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.662273 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827cc4f-9f7e-420d-ba24-e26ce26e8afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.662546 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827cc4f-9f7e-420d-ba24-e26ce26e8afa admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.663234 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827cc4f-9f7e-420d-ba24-e26ce26e8afa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:45.671851 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827cc4f-9f7e-420d-ba24-e26ce26e8afa admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:45.697396 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1123/2297] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:45 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:45.700334 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1175/2298] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:45.701370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827cc4f-9f7e-420d-ba24-e26ce26e8afa admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:45.705436 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d827cc4f-9f7e-420d-ba24-e26ce26e8afa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:45.705779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff1e89-e736-4232-9efe-4c3bcc50ad2b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.706079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff1e89-e736-4232-9efe-4c3bcc50ad2b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.706357 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff1e89-e736-4232-9efe-4c3bcc50ad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.728973 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b7ff1e89-e736-4232-9efe-4c3bcc50ad2b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:45.730313 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b7ff1e89-e736-4232-9efe-4c3bcc50ad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:45.733667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827cc4f-9f7e-420d-ba24-e26ce26e8afa admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:45.740391 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5cec0-82d5-4c13-9d5c-1af5c3cdc333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:45.741476 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5cec0-82d5-4c13-9d5c-1af5c3cdc333 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.741959 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5cec0-82d5-4c13-9d5c-1af5c3cdc333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.742330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b5cec0-82d5-4c13-9d5c-1af5c3cdc333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.743359 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5cec0-82d5-4c13-9d5c-1af5c3cdc333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:45.744435 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1176/2299] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:45.746234 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b5cec0-82d5-4c13-9d5c-1af5c3cdc333 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:45.748437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff1e89-e736-4232-9efe-4c3bcc50ad2b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:45.758230 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1124/2300] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:45.759671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff1e89-e736-4232-9efe-4c3bcc50ad2b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:45.762106 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5cec0-82d5-4c13-9d5c-1af5c3cdc333 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:45.765375 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc91e42-c313-4cfc-a77e-1c30097820b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:45.766700 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc91e42-c313-4cfc-a77e-1c30097820b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.766994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc91e42-c313-4cfc-a77e-1c30097820b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.767338 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc91e42-c313-4cfc-a77e-1c30097820b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.768790 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc91e42-c313-4cfc-a77e-1c30097820b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:13:45.769083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc91e42-c313-4cfc-a77e-1c30097820b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:45.771893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc91e42-c313-4cfc-a77e-1c30097820b6 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:45.776900 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b5cec0-82d5-4c13-9d5c-1af5c3cdc333 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:45.780817 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:45.781850 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584caf2-56e6-4f13-a175-f918d807e539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:45.782369 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584caf2-56e6-4f13-a175-f918d807e539 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.782808 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584caf2-56e6-4f13-a175-f918d807e539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.782905 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f584caf2-56e6-4f13-a175-f918d807e539 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.783684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584caf2-56e6-4f13-a175-f918d807e539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:45.785168 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1177/2301] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:13:45.785489 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f584caf2-56e6-4f13-a175-f918d807e539 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:45.789272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc91e42-c313-4cfc-a77e-1c30097820b6 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:45.801072 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc91e42-c313-4cfc-a77e-1c30097820b6 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:45.815202 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1125/2302] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:13:45.819818 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584caf2-56e6-4f13-a175-f918d807e539 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:45.821193 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909e46c-7839-455a-8edd-515e4229f944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:45.821992 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909e46c-7839-455a-8edd-515e4229f944 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.822279 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909e46c-7839-455a-8edd-515e4229f944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.822555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909e46c-7839-455a-8edd-515e4229f944 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.823255 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909e46c-7839-455a-8edd-515e4229f944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:45.825421 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909e46c-7839-455a-8edd-515e4229f944 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:45.833358 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f584caf2-56e6-4f13-a175-f918d807e539 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:45.843350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa02a05-921f-47c1-a46d-613bd4f600ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:45.843350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa02a05-921f-47c1-a46d-613bd4f600ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.843350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa02a05-921f-47c1-a46d-613bd4f600ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.843350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa02a05-921f-47c1-a46d-613bd4f600ee admin admin] PATH_INFO: `/v3/projects/eeb22bb3227a42cd8cce008519e7f870/users/b7e654fe35564c52878bc60880954dde/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.849354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:45.866702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa02a05-921f-47c1-a46d-613bd4f600ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeb22bb3227a42cd8cce008519e7f870, user_id=b7e654fe35564c52878bc60880954dde, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:45.873043 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa02a05-921f-47c1-a46d-613bd4f600ee admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:45.876509 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1178/2303] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:13:45 2022] POST /identity/v3/projects => generated 377 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:13:45.881622 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909e46c-7839-455a-8edd-515e4229f944 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:45.894601 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1126/2304] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:45 2022] PUT /identity/v3/projects/eeb22bb3227a42cd8cce008519e7f870/users/b7e654fe35564c52878bc60880954dde/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:13:45.900304 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c8794-7b0f-41e8-a74e-6a6d6984c90d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:45.900596 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c8794-7b0f-41e8-a74e-6a6d6984c90d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:45.900876 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c8794-7b0f-41e8-a74e-6a6d6984c90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:45.921277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-681c8794-7b0f-41e8-a74e-6a6d6984c90d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:45.922497 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-681c8794-7b0f-41e8-a74e-6a6d6984c90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:45.959530 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909e46c-7839-455a-8edd-515e4229f944 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:45.994030 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1127/2305] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:46.004794 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c8794-7b0f-41e8-a74e-6a6d6984c90d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:46.006332 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-681c8794-7b0f-41e8-a74e-6a6d6984c90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:46.034827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f750d1-3350-4655-ab62-faf73e675fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:46.035553 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f750d1-3350-4655-ab62-faf73e675fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:46.036232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f750d1-3350-4655-ab62-faf73e675fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:46.036533 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f750d1-3350-4655-ab62-faf73e675fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:46.037249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f750d1-3350-4655-ab62-faf73e675fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:46.039804 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f750d1-3350-4655-ab62-faf73e675fb4 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:46.069970 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1179/2306] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:13:45 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:13:46.074025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f750d1-3350-4655-ab62-faf73e675fb4 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:46.082532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c8794-7b0f-41e8-a74e-6a6d6984c90d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:46.085684 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f750d1-3350-4655-ab62-faf73e675fb4 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:46.086585 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbffd5-9e13-495f-adf0-abdeef1040a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:46.087344 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbffd5-9e13-495f-adf0-abdeef1040a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:46.087695 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbffd5-9e13-495f-adf0-abdeef1040a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:46.088225 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbffd5-9e13-495f-adf0-abdeef1040a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:46.090633 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02feb7-a897-45a7-80c2-b35fafa69027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:46.091264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02feb7-a897-45a7-80c2-b35fafa69027 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:46.091770 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02feb7-a897-45a7-80c2-b35fafa69027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:46.092147 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02feb7-a897-45a7-80c2-b35fafa69027 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:46.093637 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02feb7-a897-45a7-80c2-b35fafa69027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:46.095854 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a02feb7-a897-45a7-80c2-b35fafa69027 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:46.099124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbffd5-9e13-495f-adf0-abdeef1040a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:46.100714 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbffd5-9e13-495f-adf0-abdeef1040a8 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:46.110356 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1180/2307] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:13:46.111642 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1128/2308] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:13:46.114261 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02feb7-a897-45a7-80c2-b35fafa69027 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:46.124509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02feb7-a897-45a7-80c2-b35fafa69027 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:46.129704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da18f43-1df8-4a25-91c6-c636cca1f3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:46.130377 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da18f43-1df8-4a25-91c6-c636cca1f3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:46.130677 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da18f43-1df8-4a25-91c6-c636cca1f3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:46.130947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da18f43-1df8-4a25-91c6-c636cca1f3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:46.131710 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da18f43-1df8-4a25-91c6-c636cca1f3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:46.133402 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da18f43-1df8-4a25-91c6-c636cca1f3c2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:46.145702 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1181/2309] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:13:46.150500 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbffd5-9e13-495f-adf0-abdeef1040a8 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:46.160692 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbffd5-9e13-495f-adf0-abdeef1040a8 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:46.165476 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e85b3-c15a-4109-a926-270df56aebf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:46.166359 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e85b3-c15a-4109-a926-270df56aebf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:46.166637 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e85b3-c15a-4109-a926-270df56aebf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:46.166911 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e85b3-c15a-4109-a926-270df56aebf3 admin admin] PATH_INFO: `/v3/projects/f939fe11bf294c2e92ed1f8e9c5d43e2/users/b6e93b46abca4638a2c5ca6615c8972a/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:46.188037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e85b3-c15a-4109-a926-270df56aebf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f939fe11bf294c2e92ed1f8e9c5d43e2, user_id=b6e93b46abca4638a2c5ca6615c8972a, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:46.191041 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613e85b3-c15a-4109-a926-270df56aebf3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:46.208845 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1129/2310] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:13:46 2022] PUT /identity/v3/projects/f939fe11bf294c2e92ed1f8e9c5d43e2/users/b6e93b46abca4638a2c5ca6615c8972a/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:13:46.214384 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dfe8d-ae8f-4fbd-b49c-12ce0852888b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:46.214715 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dfe8d-ae8f-4fbd-b49c-12ce0852888b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:46.214996 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208dfe8d-ae8f-4fbd-b49c-12ce0852888b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:46.236530 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-208dfe8d-ae8f-4fbd-b49c-12ce0852888b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:46.237899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-208dfe8d-ae8f-4fbd-b49c-12ce0852888b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:46.289600 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:46.307385 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1182/2311] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:13:46.326749 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e85b3-c15a-4109-a926-270df56aebf3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:46.412678 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e85b3-c15a-4109-a926-270df56aebf3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:46.419121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd6af4-acb8-4bfd-8426-6835b6d8a2b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:46.419832 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd6af4-acb8-4bfd-8426-6835b6d8a2b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:46.420165 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd6af4-acb8-4bfd-8426-6835b6d8a2b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:46.420448 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd6af4-acb8-4bfd-8426-6835b6d8a2b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:46.435757 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd6af4-acb8-4bfd-8426-6835b6d8a2b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:46.437420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd6af4-acb8-4bfd-8426-6835b6d8a2b2 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:46.455605 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1130/2312] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:46.929817 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad9791-8c05-4e7a-8b77-91f034e010b0 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:46.930398 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad9791-8c05-4e7a-8b77-91f034e010b0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:46.930577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ad9791-8c05-4e7a-8b77-91f034e010b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:46.978879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-73ad9791-8c05-4e7a-8b77-91f034e010b0 None None] MFA Rules not processed for user `b7e654fe35564c52878bc60880954dde`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:46.980275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-73ad9791-8c05-4e7a-8b77-91f034e010b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:47.108812 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1183/2313] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:47.116913 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd6af4-acb8-4bfd-8426-6835b6d8a2b2 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:47.121806 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7fcd6af4-acb8-4bfd-8426-6835b6d8a2b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:47.141140 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:47.209092 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd6af4-acb8-4bfd-8426-6835b6d8a2b2 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:47.219743 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfe72c-ae68-4780-a3de-bcf1985aee32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:47.220444 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfe72c-ae68-4780-a3de-bcf1985aee32 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:47.221301 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfe72c-ae68-4780-a3de-bcf1985aee32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:47.221551 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cfe72c-ae68-4780-a3de-bcf1985aee32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:47.239130 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfe72c-ae68-4780-a3de-bcf1985aee32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:47.241581 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cfe72c-ae68-4780-a3de-bcf1985aee32 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:47.258750 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1131/2314] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:47.345605 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cd4dc-7ace-4b20-aae1-90876ec6b1e2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:47.345835 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cd4dc-7ace-4b20-aae1-90876ec6b1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:47.348644 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9cd4dc-7ace-4b20-aae1-90876ec6b1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:47.375543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4a9cd4dc-7ace-4b20-aae1-90876ec6b1e2 None None] MFA Rules not processed for user `b6e93b46abca4638a2c5ca6615c8972a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:47.376935 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4a9cd4dc-7ace-4b20-aae1-90876ec6b1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:47.479453 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1184/2315] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:47.488050 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfe72c-ae68-4780-a3de-bcf1985aee32 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:13:47.489690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-96cfe72c-ae68-4780-a3de-bcf1985aee32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:47.502529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cfe72c-ae68-4780-a3de-bcf1985aee32 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:13:47.506915 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f19f75a-e3ed-4594-9ceb-ace49ba50086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:13:47.507611 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19f75a-e3ed-4594-9ceb-ace49ba50086 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:47.507969 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19f75a-e3ed-4594-9ceb-ace49ba50086 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:47.508223 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f19f75a-e3ed-4594-9ceb-ace49ba50086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:47.522351 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19f75a-e3ed-4594-9ceb-ace49ba50086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:13:47.524378 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f19f75a-e3ed-4594-9ceb-ace49ba50086 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:13:47.535424 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1132/2316] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:13:47 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:13:48.769517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9dc56-eb6e-4d04-8ac1-3a1ea0de1fc6 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:48.770451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9dc56-eb6e-4d04-8ac1-3a1ea0de1fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:48.770451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9dc56-eb6e-4d04-8ac1-3a1ea0de1fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:48.797959 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4bb9dc56-eb6e-4d04-8ac1-3a1ea0de1fc6 None None] MFA Rules not processed for user `b7e654fe35564c52878bc60880954dde`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:48.799264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4bb9dc56-eb6e-4d04-8ac1-3a1ea0de1fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:48.808438 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1185/2317] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:48.990253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b84e8-c8e6-4eb5-b526-3fb281056552 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:13:48.990893 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b84e8-c8e6-4eb5-b526-3fb281056552 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:13:48.990893 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b84e8-c8e6-4eb5-b526-3fb281056552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:13:49.008648 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1c3b84e8-c8e6-4eb5-b526-3fb281056552 None None] MFA Rules not processed for user `b6e93b46abca4638a2c5ca6615c8972a`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:13:49.009880 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1c3b84e8-c8e6-4eb5-b526-3fb281056552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:13:49.017407 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1133/2318] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:13:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:13:58.791080 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=70 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:13:59.003526 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=32 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:08.326182 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9dc56-eb6e-4d04-8ac1-3a1ea0de1fc6 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:08.337218 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9dc56-eb6e-4d04-8ac1-3a1ea0de1fc6 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:08.342160 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3f505c-dd34-46e8-b31d-da8988a4c27f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:08.342858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f505c-dd34-46e8-b31d-da8988a4c27f service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:08.343137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f505c-dd34-46e8-b31d-da8988a4c27f service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:08.343443 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3f505c-dd34-46e8-b31d-da8988a4c27f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:08.345229 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9e3f505c-dd34-46e8-b31d-da8988a4c27f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:08.408067 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f505c-dd34-46e8-b31d-da8988a4c27f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:08.409517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3f505c-dd34-46e8-b31d-da8988a4c27f service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:08.419228 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1186/2319] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:15.839490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b84e8-c8e6-4eb5-b526-3fb281056552 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:15.841062 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1c3b84e8-c8e6-4eb5-b526-3fb281056552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:15.855620 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b84e8-c8e6-4eb5-b526-3fb281056552 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:15.872001 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90c2be-db1d-42cc-9f3c-720df46e4e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:15.873331 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90c2be-db1d-42cc-9f3c-720df46e4e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:15.873772 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90c2be-db1d-42cc-9f3c-720df46e4e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:15.874201 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90c2be-db1d-42cc-9f3c-720df46e4e56 admin admin] PATH_INFO: `/v3/users/bcd31690a80742fb9cd35ea1bbcd229b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:15.875732 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90c2be-db1d-42cc-9f3c-720df46e4e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcd31690a80742fb9cd35ea1bbcd229b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:15.877898 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90c2be-db1d-42cc-9f3c-720df46e4e56 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:15.942973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3a90c2be-db1d-42cc-9f3c-720df46e4e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcd31690a80742fb9cd35ea1bbcd229b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:15.943833 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3a90c2be-db1d-42cc-9f3c-720df46e4e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcd31690a80742fb9cd35ea1bbcd229b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:15.944312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3a90c2be-db1d-42cc-9f3c-720df46e4e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcd31690a80742fb9cd35ea1bbcd229b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:15.952419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3a90c2be-db1d-42cc-9f3c-720df46e4e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcd31690a80742fb9cd35ea1bbcd229b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:15.967042 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3a90c2be-db1d-42cc-9f3c-720df46e4e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcd31690a80742fb9cd35ea1bbcd229b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:15.985161 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1134/2320] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:14:15 2022] DELETE /identity/v3/users/bcd31690a80742fb9cd35ea1bbcd229b => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:14:15.989364 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab32fba-8411-46c0-a4ea-c774aefcf866 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:15.989909 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab32fba-8411-46c0-a4ea-c774aefcf866 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:15.989909 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab32fba-8411-46c0-a4ea-c774aefcf866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:16.009334 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-eab32fba-8411-46c0-a4ea-c774aefcf866 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:16.010752 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-eab32fba-8411-46c0-a4ea-c774aefcf866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:16.084268 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1187/2321] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:16.094568 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90c2be-db1d-42cc-9f3c-720df46e4e56 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:16.095953 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3a90c2be-db1d-42cc-9f3c-720df46e4e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:16.162991 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90c2be-db1d-42cc-9f3c-720df46e4e56 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:16.166651 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dee634-e074-4d09-8cef-a2e4fbbba7e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:16.167328 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dee634-e074-4d09-8cef-a2e4fbbba7e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:16.167617 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dee634-e074-4d09-8cef-a2e4fbbba7e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:16.167894 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dee634-e074-4d09-8cef-a2e4fbbba7e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:16.177642 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dee634-e074-4d09-8cef-a2e4fbbba7e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:16.179124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dee634-e074-4d09-8cef-a2e4fbbba7e9 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:16.189063 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1135/2322] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:16.509381 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab32fba-8411-46c0-a4ea-c774aefcf866 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:16.512393 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-eab32fba-8411-46c0-a4ea-c774aefcf866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:16.531454 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab32fba-8411-46c0-a4ea-c774aefcf866 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:16.548733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6488f69-ab7b-44fe-9821-9ba425b84b30 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:16.549027 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6488f69-ab7b-44fe-9821-9ba425b84b30 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:16.549305 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6488f69-ab7b-44fe-9821-9ba425b84b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:16.551550 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845fad74-aad3-463b-8563-01da5f2fad97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:16.553233 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fad74-aad3-463b-8563-01da5f2fad97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:16.553516 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fad74-aad3-463b-8563-01da5f2fad97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:16.553972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845fad74-aad3-463b-8563-01da5f2fad97 admin admin] PATH_INFO: `/v3/projects/a4be688b1a0b45abb57037a86d0592d9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:16.555189 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fad74-aad3-463b-8563-01da5f2fad97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4be688b1a0b45abb57037a86d0592d9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:16.557245 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845fad74-aad3-463b-8563-01da5f2fad97 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:16.581775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a6488f69-ab7b-44fe-9821-9ba425b84b30 None None] MFA Rules not processed for user `b7e654fe35564c52878bc60880954dde`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:16.583083 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a6488f69-ab7b-44fe-9821-9ba425b84b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:16.657571 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1136/2323] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:16.694324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-845fad74-aad3-463b-8563-01da5f2fad97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4be688b1a0b45abb57037a86d0592d9', 'request_id': 'req-845fad74-aad3-463b-8563-01da5f2fad97'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:16.723714 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-845fad74-aad3-463b-8563-01da5f2fad97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4be688b1a0b45abb57037a86d0592d9', 'request_id': 'req-845fad74-aad3-463b-8563-01da5f2fad97'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:16.736677 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-845fad74-aad3-463b-8563-01da5f2fad97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4be688b1a0b45abb57037a86d0592d9', 'request_id': 'req-845fad74-aad3-463b-8563-01da5f2fad97'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:16.753350 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-845fad74-aad3-463b-8563-01da5f2fad97 admin admin] The token cache is being invalidate because project a4be688b1a0b45abb57037a86d0592d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:14:16.753648 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-845fad74-aad3-463b-8563-01da5f2fad97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:16.754348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-845fad74-aad3-463b-8563-01da5f2fad97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:16.756144 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1188/2324] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:14:16 2022] DELETE /identity/v3/projects/a4be688b1a0b45abb57037a86d0592d9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:14:16.761264 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e540f1-90b8-4dd1-92ee-1fdd09d8827c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:16.761554 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e540f1-90b8-4dd1-92ee-1fdd09d8827c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:16.761834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e540f1-90b8-4dd1-92ee-1fdd09d8827c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:16.780650 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-16e540f1-90b8-4dd1-92ee-1fdd09d8827c None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:16.781871 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-16e540f1-90b8-4dd1-92ee-1fdd09d8827c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:16.799873 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:16.848462 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1137/2325] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:16.857527 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9fd05-667c-492a-a6da-50b07223dcdb None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:16.857823 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9fd05-667c-492a-a6da-50b07223dcdb None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:16.858131 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9fd05-667c-492a-a6da-50b07223dcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:16.877534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-add9fd05-667c-492a-a6da-50b07223dcdb None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:16.878864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-add9fd05-667c-492a-a6da-50b07223dcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:16.888149 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1189/2326] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:14:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:16.892740 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e540f1-90b8-4dd1-92ee-1fdd09d8827c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:16.903739 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e540f1-90b8-4dd1-92ee-1fdd09d8827c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:16.908717 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c213d2f-99bb-49df-a373-3bdb3f9bf286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:16.909362 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c213d2f-99bb-49df-a373-3bdb3f9bf286 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:16.909814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c213d2f-99bb-49df-a373-3bdb3f9bf286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:16.910266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c213d2f-99bb-49df-a373-3bdb3f9bf286 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:16.911004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c213d2f-99bb-49df-a373-3bdb3f9bf286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:14:16.911322 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c213d2f-99bb-49df-a373-3bdb3f9bf286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:16.912955 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c213d2f-99bb-49df-a373-3bdb3f9bf286 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:16.931066 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1138/2327] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:14:16.932451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9fd05-667c-492a-a6da-50b07223dcdb None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:16.941983 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9fd05-667c-492a-a6da-50b07223dcdb None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:16.948023 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f74631-c3a0-41d5-8eb5-909eac62130f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:16.948834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f74631-c3a0-41d5-8eb5-909eac62130f admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:16.949186 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f74631-c3a0-41d5-8eb5-909eac62130f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:16.949681 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f74631-c3a0-41d5-8eb5-909eac62130f admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:16.950817 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f74631-c3a0-41d5-8eb5-909eac62130f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:16.953103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f74631-c3a0-41d5-8eb5-909eac62130f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:16.962954 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:16.987114 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1190/2328] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:14:16 2022] POST /identity/v3/projects => generated 369 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:14:16.988762 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c213d2f-99bb-49df-a373-3bdb3f9bf286 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:16.999542 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c213d2f-99bb-49df-a373-3bdb3f9bf286 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:17.061614 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e46386-d9c5-41d5-8c6b-f548bcb425cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:17.062227 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e46386-d9c5-41d5-8c6b-f548bcb425cf admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:17.062506 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e46386-d9c5-41d5-8c6b-f548bcb425cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:17.062792 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e46386-d9c5-41d5-8c6b-f548bcb425cf admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:17.064281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e46386-d9c5-41d5-8c6b-f548bcb425cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:17.066613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e46386-d9c5-41d5-8c6b-f548bcb425cf admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:17.095202 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f74631-c3a0-41d5-8eb5-909eac62130f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:17.095709 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1139/2329] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:14:16 2022] POST /identity/v3/users => generated 285 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:14:17.106101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f74631-c3a0-41d5-8eb5-909eac62130f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:17.110782 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19a6e3-d1e1-46d7-84e9-6b2ae0271621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:17.111566 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19a6e3-d1e1-46d7-84e9-6b2ae0271621 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:17.111922 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19a6e3-d1e1-46d7-84e9-6b2ae0271621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:17.112269 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c19a6e3-d1e1-46d7-84e9-6b2ae0271621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:17.113110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19a6e3-d1e1-46d7-84e9-6b2ae0271621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:17.114798 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c19a6e3-d1e1-46d7-84e9-6b2ae0271621 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:17.128955 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1191/2330] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:14:17.133122 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e46386-d9c5-41d5-8c6b-f548bcb425cf admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:17.146720 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e46386-d9c5-41d5-8c6b-f548bcb425cf admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:17.153377 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08393ad-f528-4082-80f6-54afd1457556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:17.154192 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08393ad-f528-4082-80f6-54afd1457556 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:17.154556 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08393ad-f528-4082-80f6-54afd1457556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:17.154837 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08393ad-f528-4082-80f6-54afd1457556 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:17.156168 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08393ad-f528-4082-80f6-54afd1457556 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:17.158008 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08393ad-f528-4082-80f6-54afd1457556 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:17.178587 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1140/2331] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:14:17.180960 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19a6e3-d1e1-46d7-84e9-6b2ae0271621 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:17.192470 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c19a6e3-d1e1-46d7-84e9-6b2ae0271621 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:17.198718 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f0ecf-f870-4a01-b9ad-734d22d608b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:17.199104 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f0ecf-f870-4a01-b9ad-734d22d608b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:17.199416 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f0ecf-f870-4a01-b9ad-734d22d608b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:17.199688 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51f0ecf-f870-4a01-b9ad-734d22d608b8 admin admin] PATH_INFO: `/v3/projects/4b02cf7bdd1a45f2bf44057ade2d0e6c/users/cd25a75303b142078ffe9af6600ab1df/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:17.215668 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f0ecf-f870-4a01-b9ad-734d22d608b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b02cf7bdd1a45f2bf44057ade2d0e6c, user_id=cd25a75303b142078ffe9af6600ab1df, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:17.218384 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51f0ecf-f870-4a01-b9ad-734d22d608b8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:17.232864 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1192/2332] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:14:17 2022] PUT /identity/v3/projects/4b02cf7bdd1a45f2bf44057ade2d0e6c/users/cd25a75303b142078ffe9af6600ab1df/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:14:17.243256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b962bbc-ff1f-4642-b517-b0959f8ba0cb None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:17.243580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b962bbc-ff1f-4642-b517-b0959f8ba0cb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:17.243866 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b962bbc-ff1f-4642-b517-b0959f8ba0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:17.273047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2b962bbc-ff1f-4642-b517-b0959f8ba0cb None None] MFA Rules not processed for user `cd25a75303b142078ffe9af6600ab1df`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:17.274313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2b962bbc-ff1f-4642-b517-b0959f8ba0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:17.346195 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1141/2333] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:14:17 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:17.358448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f0ecf-f870-4a01-b9ad-734d22d608b8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:17.361676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d51f0ecf-f870-4a01-b9ad-734d22d608b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:17.437121 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51f0ecf-f870-4a01-b9ad-734d22d608b8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:17.441242 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbafebf-88f4-4d65-b9a3-8a3eff7e405f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbdf910e67d4185a0ae14edf34ee3b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:17.441916 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbafebf-88f4-4d65-b9a3-8a3eff7e405f service glance] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:17.442201 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbafebf-88f4-4d65-b9a3-8a3eff7e405f service glance] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:17.442598 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbafebf-88f4-4d65-b9a3-8a3eff7e405f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:17.453551 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbafebf-88f4-4d65-b9a3-8a3eff7e405f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:17.455269 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbafebf-88f4-4d65-b9a3-8a3eff7e405f service glance] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:17.471522 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1193/2334] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:17 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:23.248798 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ec632-42e8-4ab1-affb-532dee84858c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:23.249300 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ec632-42e8-4ab1-affb-532dee84858c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:23.249404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ec632-42e8-4ab1-affb-532dee84858c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:23.269812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d33ec632-42e8-4ab1-affb-532dee84858c None None] MFA Rules not processed for user `1b8154ce6b6b40b4959bf354ccb5c59d`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:23.271045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d33ec632-42e8-4ab1-affb-532dee84858c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:23.281169 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:23.339388 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1142/2335] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:14:23 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:14:27.466535 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:33.332666 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=18 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:42.178401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbafebf-88f4-4d65-b9a3-8a3eff7e405f service glance] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:42.181535 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fbbafebf-88f4-4d65-b9a3-8a3eff7e405f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:42.270856 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbafebf-88f4-4d65-b9a3-8a3eff7e405f service glance] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:42.276314 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095ac55-8081-4902-bc3e-498c27b054fb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333db0711d0f41fe8066ba5b9d91dacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:42.276987 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095ac55-8081-4902-bc3e-498c27b054fb service placement] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:42.278093 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095ac55-8081-4902-bc3e-498c27b054fb service placement] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:42.278380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095ac55-8081-4902-bc3e-498c27b054fb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:42.280225 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7095ac55-8081-4902-bc3e-498c27b054fb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:42.292571 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095ac55-8081-4902-bc3e-498c27b054fb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:42.294203 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095ac55-8081-4902-bc3e-498c27b054fb service placement] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:42.307888 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1194/2336] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:47.440434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30688439-7a05-41e8-be9a-d9f2b58b8713 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:47.440945 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30688439-7a05-41e8-be9a-d9f2b58b8713 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:47.441183 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30688439-7a05-41e8-be9a-d9f2b58b8713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:47.459702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-30688439-7a05-41e8-be9a-d9f2b58b8713 None None] MFA Rules not processed for user `1e7d0f401530454ba0cae0f5e9d6e0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:47.460912 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-30688439-7a05-41e8-be9a-d9f2b58b8713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:47.519216 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1143/2337] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:14:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:52.303610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=32 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:57.512178 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=25 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:14:57.724133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f27c-c44f-45eb-8126-d35138372621 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:57.724749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f27c-c44f-45eb-8126-d35138372621 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:57.724749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f27c-c44f-45eb-8126-d35138372621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:57.744448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-aab9f27c-c44f-45eb-8126-d35138372621 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:57.746951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-aab9f27c-c44f-45eb-8126-d35138372621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:57.827768 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1195/2338] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Jul 24 01:14:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:57.851329 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30688439-7a05-41e8-be9a-d9f2b58b8713 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:57.853039 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-30688439-7a05-41e8-be9a-d9f2b58b8713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:57.930898 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30688439-7a05-41e8-be9a-d9f2b58b8713 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:57.938489 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16124ea-edf1-49e6-84a8-75e683d5018d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:57.939231 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16124ea-edf1-49e6-84a8-75e683d5018d service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:57.939614 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16124ea-edf1-49e6-84a8-75e683d5018d service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:57.939992 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16124ea-edf1-49e6-84a8-75e683d5018d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:57.948636 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16124ea-edf1-49e6-84a8-75e683d5018d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:57.950324 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16124ea-edf1-49e6-84a8-75e683d5018d service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:57.959866 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1144/2339] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:14:59.326118 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9f27c-c44f-45eb-8126-d35138372621 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:59.336165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9f27c-c44f-45eb-8126-d35138372621 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:59.348079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e2f6d-dac6-4429-ab12-cd6281357ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:59.349515 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e2f6d-dac6-4429-ab12-cd6281357ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:59.350585 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e2f6d-dac6-4429-ab12-cd6281357ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:59.351115 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e2f6d-dac6-4429-ab12-cd6281357ccf admin admin] PATH_INFO: `/v3/users/cd25a75303b142078ffe9af6600ab1df` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:59.352955 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e2f6d-dac6-4429-ab12-cd6281357ccf admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd25a75303b142078ffe9af6600ab1df)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:59.360769 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e2f6d-dac6-4429-ab12-cd6281357ccf admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:59.418845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-346e2f6d-dac6-4429-ab12-cd6281357ccf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd25a75303b142078ffe9af6600ab1df'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:59.419623 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-346e2f6d-dac6-4429-ab12-cd6281357ccf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd25a75303b142078ffe9af6600ab1df'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:59.431028 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-346e2f6d-dac6-4429-ab12-cd6281357ccf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd25a75303b142078ffe9af6600ab1df'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:59.433040 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-346e2f6d-dac6-4429-ab12-cd6281357ccf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd25a75303b142078ffe9af6600ab1df'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:59.442345 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-346e2f6d-dac6-4429-ab12-cd6281357ccf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd25a75303b142078ffe9af6600ab1df'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:14:59.462450 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1196/2340] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:14:59 2022] DELETE /identity/v3/users/cd25a75303b142078ffe9af6600ab1df => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:14:59.466786 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062c9c5-8ae9-4571-907c-1ec35e4272df None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:59.467344 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062c9c5-8ae9-4571-907c-1ec35e4272df None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:59.467344 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062c9c5-8ae9-4571-907c-1ec35e4272df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:59.488368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9062c9c5-8ae9-4571-907c-1ec35e4272df None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:14:59.489588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9062c9c5-8ae9-4571-907c-1ec35e4272df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:59.550242 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1145/2341] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:14:59.561155 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e2f6d-dac6-4429-ab12-cd6281357ccf admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:14:59.562737 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-346e2f6d-dac6-4429-ab12-cd6281357ccf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:14:59.620533 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e2f6d-dac6-4429-ab12-cd6281357ccf admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:14:59.624680 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad90a670-79d6-466c-b265-0d5367402877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:14:59.625329 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90a670-79d6-466c-b265-0d5367402877 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:14:59.625621 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90a670-79d6-466c-b265-0d5367402877 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:14:59.625904 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad90a670-79d6-466c-b265-0d5367402877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:14:59.638193 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90a670-79d6-466c-b265-0d5367402877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:14:59.639732 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad90a670-79d6-466c-b265-0d5367402877 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:14:59.649900 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1197/2342] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:14:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:15:00.292357 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062c9c5-8ae9-4571-907c-1ec35e4272df None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:00.293947 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9062c9c5-8ae9-4571-907c-1ec35e4272df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:00.307689 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062c9c5-8ae9-4571-907c-1ec35e4272df None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:00.313444 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32b93b-5898-43ed-8241-b890308b0087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:00.314333 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32b93b-5898-43ed-8241-b890308b0087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:00.314619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32b93b-5898-43ed-8241-b890308b0087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:00.314900 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32b93b-5898-43ed-8241-b890308b0087 admin admin] PATH_INFO: `/v3/projects/4b02cf7bdd1a45f2bf44057ade2d0e6c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:00.316393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32b93b-5898-43ed-8241-b890308b0087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b02cf7bdd1a45f2bf44057ade2d0e6c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:00.318252 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32b93b-5898-43ed-8241-b890308b0087 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:00.367108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dd32b93b-5898-43ed-8241-b890308b0087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b02cf7bdd1a45f2bf44057ade2d0e6c', 'request_id': 'req-dd32b93b-5898-43ed-8241-b890308b0087'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:00.374861 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dd32b93b-5898-43ed-8241-b890308b0087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b02cf7bdd1a45f2bf44057ade2d0e6c', 'request_id': 'req-dd32b93b-5898-43ed-8241-b890308b0087'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:00.380598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dd32b93b-5898-43ed-8241-b890308b0087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b02cf7bdd1a45f2bf44057ade2d0e6c', 'request_id': 'req-dd32b93b-5898-43ed-8241-b890308b0087'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:00.391907 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dd32b93b-5898-43ed-8241-b890308b0087 admin admin] The token cache is being invalidate because project 4b02cf7bdd1a45f2bf44057ade2d0e6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:15:00.392198 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dd32b93b-5898-43ed-8241-b890308b0087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:00.392879 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dd32b93b-5898-43ed-8241-b890308b0087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:00.394429 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1146/2343] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:15:00 2022] DELETE /identity/v3/projects/4b02cf7bdd1a45f2bf44057ade2d0e6c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:15:02.898181 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c5571-6b63-4f21-be4d-b528c6c98830 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:02.898886 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c5571-6b63-4f21-be4d-b528c6c98830 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:02.899167 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c5571-6b63-4f21-be4d-b528c6c98830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:02.919004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ff0c5571-6b63-4f21-be4d-b528c6c98830 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:02.920071 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ff0c5571-6b63-4f21-be4d-b528c6c98830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:02.932053 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:03.017525 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1198/2344] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Jul 24 01:15:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:03.041934 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32b93b-5898-43ed-8241-b890308b0087 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:03.044393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dd32b93b-5898-43ed-8241-b890308b0087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:03.057938 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:03.154280 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32b93b-5898-43ed-8241-b890308b0087 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:03.163681 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82e5d9-d54e-4443-900c-b105f5f3b37a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:03.164393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82e5d9-d54e-4443-900c-b105f5f3b37a service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:03.164683 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82e5d9-d54e-4443-900c-b105f5f3b37a service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:03.164963 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82e5d9-d54e-4443-900c-b105f5f3b37a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:03.176749 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82e5d9-d54e-4443-900c-b105f5f3b37a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:03.178460 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82e5d9-d54e-4443-900c-b105f5f3b37a service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:03.203160 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1147/2345] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:04.544210 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f2551-08f1-4ce3-b0c0-c3f0a9b05927 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:04.544629 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f2551-08f1-4ce3-b0c0-c3f0a9b05927 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:04.544767 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f2551-08f1-4ce3-b0c0-c3f0a9b05927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:04.564087 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-d01f2551-08f1-4ce3-b0c0-c3f0a9b05927 None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:04.565309 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d01f2551-08f1-4ce3-b0c0-c3f0a9b05927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:04.622570 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1199/2346] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:15:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:04.663420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82e5d9-d54e-4443-900c-b105f5f3b37a service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:04.664930 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0c82e5d9-d54e-4443-900c-b105f5f3b37a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:04.740226 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82e5d9-d54e-4443-900c-b105f5f3b37a service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:04.745753 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc35055-c511-4d1d-b8a0-8e42c3f112b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:04.746415 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc35055-c511-4d1d-b8a0-8e42c3f112b1 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:04.746699 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc35055-c511-4d1d-b8a0-8e42c3f112b1 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:04.746975 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc35055-c511-4d1d-b8a0-8e42c3f112b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:04.755430 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc35055-c511-4d1d-b8a0-8e42c3f112b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:04.757037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc35055-c511-4d1d-b8a0-8e42c3f112b1 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:04.765516 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1148/2347] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:15:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:15:09.430836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ccaf2-4d7c-4fe9-94b1-54fe302bfab7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:09.431854 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ccaf2-4d7c-4fe9-94b1-54fe302bfab7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:09.432515 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ccaf2-4d7c-4fe9-94b1-54fe302bfab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:09.469188 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ec1ccaf2-4d7c-4fe9-94b1-54fe302bfab7 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:09.471707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ec1ccaf2-4d7c-4fe9-94b1-54fe302bfab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:09.486525 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1200/2348] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Jul 24 01:15:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:09.516738 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc35055-c511-4d1d-b8a0-8e42c3f112b1 service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:09.554200 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc35055-c511-4d1d-b8a0-8e42c3f112b1 service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:09.565037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e290c-fed7-4958-a517-896ca4ff82fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:09.566001 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e290c-fed7-4958-a517-896ca4ff82fe service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:09.566443 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e290c-fed7-4958-a517-896ca4ff82fe service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:09.566877 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667e290c-fed7-4958-a517-896ca4ff82fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:09.580251 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e290c-fed7-4958-a517-896ca4ff82fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:09.583092 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667e290c-fed7-4958-a517-896ca4ff82fe service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:09.598383 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1149/2349] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:14.620712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff357db0-25eb-4334-96a5-5fbbba6d5b9b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:14.621663 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff357db0-25eb-4334-96a5-5fbbba6d5b9b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:14.622137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff357db0-25eb-4334-96a5-5fbbba6d5b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:14.660561 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ff357db0-25eb-4334-96a5-5fbbba6d5b9b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:14.663947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ff357db0-25eb-4334-96a5-5fbbba6d5b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:14.674884 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1201/2350] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Jul 24 01:15:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:15:14.700847 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e290c-fed7-4958-a517-896ca4ff82fe service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:14.702772 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-667e290c-fed7-4958-a517-896ca4ff82fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:14.723452 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667e290c-fed7-4958-a517-896ca4ff82fe service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:14.731190 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb6366-ce18-4376-a8b6-198e2bacab58 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:14.732353 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb6366-ce18-4376-a8b6-198e2bacab58 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:14.732862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb6366-ce18-4376-a8b6-198e2bacab58 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:14.733363 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdb6366-ce18-4376-a8b6-198e2bacab58 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:14.745184 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb6366-ce18-4376-a8b6-198e2bacab58 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:14.747594 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdb6366-ce18-4376-a8b6-198e2bacab58 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:14.765463 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1150/2351] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:20.157707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ba3c3-d570-45bd-92d6-8658369caff2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:20.158303 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ba3c3-d570-45bd-92d6-8658369caff2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:20.158303 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ba3c3-d570-45bd-92d6-8658369caff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:20.179278 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-de6ba3c3-d570-45bd-92d6-8658369caff2 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:20.180524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-de6ba3c3-d570-45bd-92d6-8658369caff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:20.190846 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1202/2352] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Jul 24 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:20.248377 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb6366-ce18-4376-a8b6-198e2bacab58 service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:20.264641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdb6366-ce18-4376-a8b6-198e2bacab58 service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:20.271672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1dccb-61d1-4c64-8edd-f58f2d42742a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:20.272314 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1dccb-61d1-4c64-8edd-f58f2d42742a service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:20.272592 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1dccb-61d1-4c64-8edd-f58f2d42742a service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:20.272845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f1dccb-61d1-4c64-8edd-f58f2d42742a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:20.281580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1dccb-61d1-4c64-8edd-f58f2d42742a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:20.283178 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f1dccb-61d1-4c64-8edd-f58f2d42742a service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:20.293282 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1151/2353] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:20.952307 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51378b-a237-4f38-a744-a5ff4e4441af None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:20.952598 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51378b-a237-4f38-a744-a5ff4e4441af None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:20.952878 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df51378b-a237-4f38-a744-a5ff4e4441af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:20.972524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-df51378b-a237-4f38-a744-a5ff4e4441af None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:20.973727 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-df51378b-a237-4f38-a744-a5ff4e4441af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:20.981468 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1203/2354] 10.222.0.42 () {58 vars in 967 bytes} [Sun Jul 24 01:15:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:20.995764 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1dccb-61d1-4c64-8edd-f58f2d42742a service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:21.007406 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f1dccb-61d1-4c64-8edd-f58f2d42742a service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:21.013076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa914f-88f3-42e2-9a79-fefcc0f3cd16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:21.013714 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa914f-88f3-42e2-9a79-fefcc0f3cd16 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:21.014005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa914f-88f3-42e2-9a79-fefcc0f3cd16 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:21.014273 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fa914f-88f3-42e2-9a79-fefcc0f3cd16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:21.022690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa914f-88f3-42e2-9a79-fefcc0f3cd16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:21.024323 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fa914f-88f3-42e2-9a79-fefcc0f3cd16 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:21.032588 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1152/2355] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:15:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:15:23.015235 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51378b-a237-4f38-a744-a5ff4e4441af None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:23.016946 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-df51378b-a237-4f38-a744-a5ff4e4441af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:23.031403 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df51378b-a237-4f38-a744-a5ff4e4441af None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:23.035889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48147b7c-5320-49e2-a871-12dbd8cbed7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:23.036891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48147b7c-5320-49e2-a871-12dbd8cbed7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:23.037123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48147b7c-5320-49e2-a871-12dbd8cbed7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:23.037416 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48147b7c-5320-49e2-a871-12dbd8cbed7d admin admin] PATH_INFO: `/v3/users/b7e654fe35564c52878bc60880954dde` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:23.038837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48147b7c-5320-49e2-a871-12dbd8cbed7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e654fe35564c52878bc60880954dde)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:23.040818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48147b7c-5320-49e2-a871-12dbd8cbed7d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:23.223453 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-48147b7c-5320-49e2-a871-12dbd8cbed7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e654fe35564c52878bc60880954dde'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:23.224196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-48147b7c-5320-49e2-a871-12dbd8cbed7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e654fe35564c52878bc60880954dde'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:23.233658 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-48147b7c-5320-49e2-a871-12dbd8cbed7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e654fe35564c52878bc60880954dde'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:23.234374 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-48147b7c-5320-49e2-a871-12dbd8cbed7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e654fe35564c52878bc60880954dde'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:23.241655 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-48147b7c-5320-49e2-a871-12dbd8cbed7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e654fe35564c52878bc60880954dde'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:23.258555 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1204/2356] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:15:23 2022] DELETE /identity/v3/users/b7e654fe35564c52878bc60880954dde => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:15:23.436897 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa914f-88f3-42e2-9a79-fefcc0f3cd16 service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:23.450779 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fa914f-88f3-42e2-9a79-fefcc0f3cd16 service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:23.489004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:23.516643 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e72034-c2d1-4323-8811-a28c1f630151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:23.517515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e72034-c2d1-4323-8811-a28c1f630151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:23.517797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e72034-c2d1-4323-8811-a28c1f630151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:23.518075 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e72034-c2d1-4323-8811-a28c1f630151 admin admin] PATH_INFO: `/v3/projects/eeb22bb3227a42cd8cce008519e7f870` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:23.519256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e72034-c2d1-4323-8811-a28c1f630151 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeb22bb3227a42cd8cce008519e7f870)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:23.521200 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e72034-c2d1-4323-8811-a28c1f630151 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:23.568112 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53e72034-c2d1-4323-8811-a28c1f630151 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeb22bb3227a42cd8cce008519e7f870', 'request_id': 'req-53e72034-c2d1-4323-8811-a28c1f630151'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:23.576136 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53e72034-c2d1-4323-8811-a28c1f630151 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeb22bb3227a42cd8cce008519e7f870', 'request_id': 'req-53e72034-c2d1-4323-8811-a28c1f630151'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:23.581899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53e72034-c2d1-4323-8811-a28c1f630151 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeb22bb3227a42cd8cce008519e7f870', 'request_id': 'req-53e72034-c2d1-4323-8811-a28c1f630151'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:23.593449 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53e72034-c2d1-4323-8811-a28c1f630151 admin admin] The token cache is being invalidate because project eeb22bb3227a42cd8cce008519e7f870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:15:23.593796 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53e72034-c2d1-4323-8811-a28c1f630151 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:23.594533 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-53e72034-c2d1-4323-8811-a28c1f630151 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:23.596415 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1153/2357] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:15:23 2022] DELETE /identity/v3/projects/eeb22bb3227a42cd8cce008519e7f870 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:15:23.601903 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4fe7a-2c72-4847-a65e-1220d3821bf2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:23.602245 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4fe7a-2c72-4847-a65e-1220d3821bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:23.602526 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe4fe7a-2c72-4847-a65e-1220d3821bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:23.615889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:23.621542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-bfe4fe7a-2c72-4847-a65e-1220d3821bf2 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:23.623463 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-bfe4fe7a-2c72-4847-a65e-1220d3821bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:23.686791 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1205/2358] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:23.695266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e3c9-47c2-4758-a91b-39303152c1bb None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:23.695587 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e3c9-47c2-4758-a91b-39303152c1bb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:23.695864 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e3c9-47c2-4758-a91b-39303152c1bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:23.714805 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7894e3c9-47c2-4758-a91b-39303152c1bb None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:23.716037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7894e3c9-47c2-4758-a91b-39303152c1bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:23.724636 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1154/2359] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:15:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:23.728973 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4fe7a-2c72-4847-a65e-1220d3821bf2 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:23.738819 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe4fe7a-2c72-4847-a65e-1220d3821bf2 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:23.744368 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c92315-a6f7-43ee-a9b1-4668c5032428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:23.744958 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c92315-a6f7-43ee-a9b1-4668c5032428 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:23.745240 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c92315-a6f7-43ee-a9b1-4668c5032428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:23.745531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c92315-a6f7-43ee-a9b1-4668c5032428 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:23.746252 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c92315-a6f7-43ee-a9b1-4668c5032428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:15:23.746562 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c92315-a6f7-43ee-a9b1-4668c5032428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:23.748222 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c92315-a6f7-43ee-a9b1-4668c5032428 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:23.760114 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1206/2360] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:15:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:15:23.764324 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e3c9-47c2-4758-a91b-39303152c1bb None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:23.774049 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e3c9-47c2-4758-a91b-39303152c1bb None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:23.779218 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce6008-ed5e-4105-89f3-b8b2a062ef8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:23.779903 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce6008-ed5e-4105-89f3-b8b2a062ef8d admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:23.780188 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce6008-ed5e-4105-89f3-b8b2a062ef8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:23.780565 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fce6008-ed5e-4105-89f3-b8b2a062ef8d admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:23.781256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce6008-ed5e-4105-89f3-b8b2a062ef8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:23.783186 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fce6008-ed5e-4105-89f3-b8b2a062ef8d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:23.817618 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1155/2361] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:15:23 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:15:23.818841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c92315-a6f7-43ee-a9b1-4668c5032428 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:23.829226 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c92315-a6f7-43ee-a9b1-4668c5032428 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:23.887640 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add86c8a-a155-4798-9c2c-949dde1c3f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:23.888306 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add86c8a-a155-4798-9c2c-949dde1c3f44 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:23.888583 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add86c8a-a155-4798-9c2c-949dde1c3f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:23.888856 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add86c8a-a155-4798-9c2c-949dde1c3f44 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:23.889540 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add86c8a-a155-4798-9c2c-949dde1c3f44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:23.891539 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add86c8a-a155-4798-9c2c-949dde1c3f44 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:23.911904 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1207/2362] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:15:23 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:15:23.916152 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce6008-ed5e-4105-89f3-b8b2a062ef8d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:23.927260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fce6008-ed5e-4105-89f3-b8b2a062ef8d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:23.933049 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af07a9d-0d58-4d07-ba7c-ab59911908e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:23.933707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af07a9d-0d58-4d07-ba7c-ab59911908e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:23.933982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af07a9d-0d58-4d07-ba7c-ab59911908e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:23.934291 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af07a9d-0d58-4d07-ba7c-ab59911908e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:23.935007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af07a9d-0d58-4d07-ba7c-ab59911908e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:23.936684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af07a9d-0d58-4d07-ba7c-ab59911908e5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:23.947549 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1156/2363] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:15:23.951631 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add86c8a-a155-4798-9c2c-949dde1c3f44 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:23.961654 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add86c8a-a155-4798-9c2c-949dde1c3f44 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:23.966427 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34cfd5-5109-4d51-b72e-fcdb7070ac5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:23.966969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34cfd5-5109-4d51-b72e-fcdb7070ac5e admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:23.967251 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34cfd5-5109-4d51-b72e-fcdb7070ac5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:23.967553 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34cfd5-5109-4d51-b72e-fcdb7070ac5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:23.968279 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34cfd5-5109-4d51-b72e-fcdb7070ac5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:23.969875 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34cfd5-5109-4d51-b72e-fcdb7070ac5e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:23.979989 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1208/2364] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:15:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:15:23.984304 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af07a9d-0d58-4d07-ba7c-ab59911908e5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:23.994717 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af07a9d-0d58-4d07-ba7c-ab59911908e5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:24.000192 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ef37cf-f5f4-4c04-bd17-90e5f3f8c2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:24.001116 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef37cf-f5f4-4c04-bd17-90e5f3f8c2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:24.001394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef37cf-f5f4-4c04-bd17-90e5f3f8c2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:24.001661 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef37cf-f5f4-4c04-bd17-90e5f3f8c2e3 admin admin] PATH_INFO: `/v3/projects/edd06e657ed948869456aebb7fe286d8/users/a577a1a4b45b405d88611a62bb5f5fff/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:24.016897 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef37cf-f5f4-4c04-bd17-90e5f3f8c2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd06e657ed948869456aebb7fe286d8, user_id=a577a1a4b45b405d88611a62bb5f5fff, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:24.019637 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ef37cf-f5f4-4c04-bd17-90e5f3f8c2e3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:24.035146 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1157/2365] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:15:23 2022] PUT /identity/v3/projects/edd06e657ed948869456aebb7fe286d8/users/a577a1a4b45b405d88611a62bb5f5fff/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:15:24.045660 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9327973-cc38-4252-b36d-14ce62b3eea4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:24.046155 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9327973-cc38-4252-b36d-14ce62b3eea4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:24.046351 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9327973-cc38-4252-b36d-14ce62b3eea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:24.078647 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e9327973-cc38-4252-b36d-14ce62b3eea4 None None] MFA Rules not processed for user `a577a1a4b45b405d88611a62bb5f5fff`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:24.079889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e9327973-cc38-4252-b36d-14ce62b3eea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:24.121312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30367d81-4556-4a35-8eb0-30ec0a4e5fdb None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:24.121602 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30367d81-4556-4a35-8eb0-30ec0a4e5fdb None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:24.121891 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30367d81-4556-4a35-8eb0-30ec0a4e5fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:24.140296 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-30367d81-4556-4a35-8eb0-30ec0a4e5fdb None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:24.141533 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-30367d81-4556-4a35-8eb0-30ec0a4e5fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:24.143986 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1209/2366] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:15:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:15:24.154853 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9327973-cc38-4252-b36d-14ce62b3eea4 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:24.156237 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e9327973-cc38-4252-b36d-14ce62b3eea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:24.161204 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:24.195941 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:24.207083 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1158/2367] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Jul 24 01:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:15:24.218880 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9327973-cc38-4252-b36d-14ce62b3eea4 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:24.223040 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4108d7-b9d7-4f4f-bcbf-f4f2fced8e24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:24.223735 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4108d7-b9d7-4f4f-bcbf-f4f2fced8e24 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:24.224018 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4108d7-b9d7-4f4f-bcbf-f4f2fced8e24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:24.224452 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4108d7-b9d7-4f4f-bcbf-f4f2fced8e24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:24.232633 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30367d81-4556-4a35-8eb0-30ec0a4e5fdb None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:24.234015 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-30367d81-4556-4a35-8eb0-30ec0a4e5fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:24.234275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4108d7-b9d7-4f4f-bcbf-f4f2fced8e24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:24.235759 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4108d7-b9d7-4f4f-bcbf-f4f2fced8e24 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:24.245237 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1210/2368] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:24.305403 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30367d81-4556-4a35-8eb0-30ec0a4e5fdb None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:24.311574 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3041f-2715-4e02-96bf-0ea80532361f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:24.312212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3041f-2715-4e02-96bf-0ea80532361f service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:24.312496 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3041f-2715-4e02-96bf-0ea80532361f service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:24.312810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3041f-2715-4e02-96bf-0ea80532361f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:24.321089 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3041f-2715-4e02-96bf-0ea80532361f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:24.322702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3041f-2715-4e02-96bf-0ea80532361f service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:24.332844 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1159/2369] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:15:34.240966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=25 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:34.328009 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=35 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:34.334041 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4108d7-b9d7-4f4f-bcbf-f4f2fced8e24 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:34.345893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4108d7-b9d7-4f4f-bcbf-f4f2fced8e24 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:34.351316 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390ac54-6dfd-4d49-89a4-18f20ddb7d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:34.352196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390ac54-6dfd-4d49-89a4-18f20ddb7d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:34.352471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390ac54-6dfd-4d49-89a4-18f20ddb7d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:34.352750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390ac54-6dfd-4d49-89a4-18f20ddb7d29 admin admin] PATH_INFO: `/v3/users/a577a1a4b45b405d88611a62bb5f5fff` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:34.353998 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390ac54-6dfd-4d49-89a4-18f20ddb7d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a577a1a4b45b405d88611a62bb5f5fff)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:34.355960 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390ac54-6dfd-4d49-89a4-18f20ddb7d29 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:34.407099 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7390ac54-6dfd-4d49-89a4-18f20ddb7d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a577a1a4b45b405d88611a62bb5f5fff'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:34.407845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7390ac54-6dfd-4d49-89a4-18f20ddb7d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a577a1a4b45b405d88611a62bb5f5fff'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:34.418785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7390ac54-6dfd-4d49-89a4-18f20ddb7d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a577a1a4b45b405d88611a62bb5f5fff'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:34.419444 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7390ac54-6dfd-4d49-89a4-18f20ddb7d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a577a1a4b45b405d88611a62bb5f5fff'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:34.426872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-7390ac54-6dfd-4d49-89a4-18f20ddb7d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a577a1a4b45b405d88611a62bb5f5fff'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:34.443819 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1211/2370] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:15:34 2022] DELETE /identity/v3/users/a577a1a4b45b405d88611a62bb5f5fff => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:15:34.448438 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4c74b-e98c-4bc5-b178-fa916cbabd32 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:34.448731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4c74b-e98c-4bc5-b178-fa916cbabd32 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:34.449010 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d4c74b-e98c-4bc5-b178-fa916cbabd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:34.467416 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-09d4c74b-e98c-4bc5-b178-fa916cbabd32 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:34.468992 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-09d4c74b-e98c-4bc5-b178-fa916cbabd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:34.531794 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1160/2371] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:34.545358 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390ac54-6dfd-4d49-89a4-18f20ddb7d29 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:34.546957 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7390ac54-6dfd-4d49-89a4-18f20ddb7d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:34.604198 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390ac54-6dfd-4d49-89a4-18f20ddb7d29 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:34.607797 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4774c2-2d58-4741-ae48-1e21a306e9ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:34.608453 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4774c2-2d58-4741-ae48-1e21a306e9ff service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:34.608732 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4774c2-2d58-4741-ae48-1e21a306e9ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:34.609002 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4774c2-2d58-4741-ae48-1e21a306e9ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:34.618504 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4774c2-2d58-4741-ae48-1e21a306e9ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:34.619974 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4774c2-2d58-4741-ae48-1e21a306e9ff service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:34.629368 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1212/2372] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:15:34.911123 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4c74b-e98c-4bc5-b178-fa916cbabd32 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:34.912644 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-09d4c74b-e98c-4bc5-b178-fa916cbabd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:34.927758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d4c74b-e98c-4bc5-b178-fa916cbabd32 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:34.933124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bc7af-bb60-428b-8009-aa1aacdbd66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:34.934007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bc7af-bb60-428b-8009-aa1aacdbd66d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:34.934319 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bc7af-bb60-428b-8009-aa1aacdbd66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:34.934575 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bc7af-bb60-428b-8009-aa1aacdbd66d admin admin] PATH_INFO: `/v3/projects/edd06e657ed948869456aebb7fe286d8` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:34.935920 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bc7af-bb60-428b-8009-aa1aacdbd66d admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd06e657ed948869456aebb7fe286d8)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:34.938059 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bc7af-bb60-428b-8009-aa1aacdbd66d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:34.990708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-532bc7af-bb60-428b-8009-aa1aacdbd66d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd06e657ed948869456aebb7fe286d8', 'request_id': 'req-532bc7af-bb60-428b-8009-aa1aacdbd66d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:34.998975 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-532bc7af-bb60-428b-8009-aa1aacdbd66d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd06e657ed948869456aebb7fe286d8', 'request_id': 'req-532bc7af-bb60-428b-8009-aa1aacdbd66d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:35.005497 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-532bc7af-bb60-428b-8009-aa1aacdbd66d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd06e657ed948869456aebb7fe286d8', 'request_id': 'req-532bc7af-bb60-428b-8009-aa1aacdbd66d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:35.016671 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-532bc7af-bb60-428b-8009-aa1aacdbd66d admin admin] The token cache is being invalidate because project edd06e657ed948869456aebb7fe286d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:15:35.016960 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-532bc7af-bb60-428b-8009-aa1aacdbd66d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:35.017632 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-532bc7af-bb60-428b-8009-aa1aacdbd66d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:15:35.019200 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1161/2373] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:15:34 2022] DELETE /identity/v3/projects/edd06e657ed948869456aebb7fe286d8 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:15:41.639889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2cd57-45f4-4ee1-b1ad-d7ce400bcbfe None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:41.640514 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2cd57-45f4-4ee1-b1ad-d7ce400bcbfe None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:41.640514 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc2cd57-45f4-4ee1-b1ad-d7ce400bcbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:41.662208 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-efc2cd57-45f4-4ee1-b1ad-d7ce400bcbfe None None] MFA Rules not processed for user `b6e93b46abca4638a2c5ca6615c8972a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:41.662208 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-efc2cd57-45f4-4ee1-b1ad-d7ce400bcbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:41.728502 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1213/2374] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:15:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:45.013723 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:51.717193 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=80,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:15:57.693118 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb02a38-1117-4084-b40f-4149cc744243 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:57.693580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb02a38-1117-4084-b40f-4149cc744243 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:57.693692 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb02a38-1117-4084-b40f-4149cc744243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:57.715344 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5eb02a38-1117-4084-b40f-4149cc744243 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:15:57.716565 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5eb02a38-1117-4084-b40f-4149cc744243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:57.777853 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1162/2375] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Jul 24 01:15:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:15:57.799644 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2cd57-45f4-4ee1-b1ad-d7ce400bcbfe None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:15:57.801556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-efc2cd57-45f4-4ee1-b1ad-d7ce400bcbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:15:57.882401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc2cd57-45f4-4ee1-b1ad-d7ce400bcbfe None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:15:57.888756 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43555052-ed83-4969-bb7e-bb8d9c2432a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:15:57.889415 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43555052-ed83-4969-bb7e-bb8d9c2432a1 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:15:57.889728 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43555052-ed83-4969-bb7e-bb8d9c2432a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:15:57.890004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43555052-ed83-4969-bb7e-bb8d9c2432a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:15:57.899398 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43555052-ed83-4969-bb7e-bb8d9c2432a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:15:57.901015 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43555052-ed83-4969-bb7e-bb8d9c2432a1 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:15:57.911025 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1214/2376] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:15:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:16:02.062440 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eec58-8a42-41a8-a948-ab18cdfae4b6 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:02.063045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eec58-8a42-41a8-a948-ab18cdfae4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:02.063045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69eec58-8a42-41a8-a948-ab18cdfae4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:02.085630 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f69eec58-8a42-41a8-a948-ab18cdfae4b6 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:02.086851 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f69eec58-8a42-41a8-a948-ab18cdfae4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:02.097607 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1163/2377] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Jul 24 01:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:02.127283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43555052-ed83-4969-bb7e-bb8d9c2432a1 service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:02.128951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-43555052-ed83-4969-bb7e-bb8d9c2432a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:02.144508 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43555052-ed83-4969-bb7e-bb8d9c2432a1 service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:02.151433 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41389b-4d12-45f4-82fe-36fbdd74ad4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:02.152169 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41389b-4d12-45f4-82fe-36fbdd74ad4e service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:02.152455 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41389b-4d12-45f4-82fe-36fbdd74ad4e service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:02.152730 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41389b-4d12-45f4-82fe-36fbdd74ad4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:02.161341 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41389b-4d12-45f4-82fe-36fbdd74ad4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:02.162954 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41389b-4d12-45f4-82fe-36fbdd74ad4e service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:02.172681 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1215/2378] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:16:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:16:06.169588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443ccac-f8df-440e-ab26-7f717eb0c20e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:06.170088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443ccac-f8df-440e-ab26-7f717eb0c20e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:06.170203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443ccac-f8df-440e-ab26-7f717eb0c20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:06.191764 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2443ccac-f8df-440e-ab26-7f717eb0c20e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:06.193047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2443ccac-f8df-440e-ab26-7f717eb0c20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:06.202908 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1164/2379] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Jul 24 01:16:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:06.232503 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41389b-4d12-45f4-82fe-36fbdd74ad4e service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:06.244172 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41389b-4d12-45f4-82fe-36fbdd74ad4e service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:06.250716 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4a773-2494-4ce4-a93d-c6acb9c4307c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:06.251396 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4a773-2494-4ce4-a93d-c6acb9c4307c service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:06.251679 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4a773-2494-4ce4-a93d-c6acb9c4307c service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:06.251943 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4a773-2494-4ce4-a93d-c6acb9c4307c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:06.260085 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4a773-2494-4ce4-a93d-c6acb9c4307c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:06.261670 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4a773-2494-4ce4-a93d-c6acb9c4307c service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:06.271231 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1216/2380] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:16:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:16:10.402421 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d0d24-612c-46ac-8b1d-7c1781ac0cf4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:10.402921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d0d24-612c-46ac-8b1d-7c1781ac0cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:10.403014 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d0d24-612c-46ac-8b1d-7c1781ac0cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:10.422620 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-8f7d0d24-612c-46ac-8b1d-7c1781ac0cf4 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:10.423961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8f7d0d24-612c-46ac-8b1d-7c1781ac0cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:10.433997 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1165/2381] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Jul 24 01:16:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:10.478746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4a773-2494-4ce4-a93d-c6acb9c4307c service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:10.490696 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4a773-2494-4ce4-a93d-c6acb9c4307c service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:10.498075 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b95e59-e20c-4643-9a75-b228e9d48704 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:10.498713 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b95e59-e20c-4643-9a75-b228e9d48704 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:10.498988 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b95e59-e20c-4643-9a75-b228e9d48704 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:10.499256 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b95e59-e20c-4643-9a75-b228e9d48704 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:10.507989 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b95e59-e20c-4643-9a75-b228e9d48704 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:10.509532 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b95e59-e20c-4643-9a75-b228e9d48704 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:10.519089 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1217/2382] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:16:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:16:14.638594 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3ca4d-96d3-40c2-96c9-b2f0d287eb51 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:14.639204 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3ca4d-96d3-40c2-96c9-b2f0d287eb51 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:14.639204 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3ca4d-96d3-40c2-96c9-b2f0d287eb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:14.661691 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-81e3ca4d-96d3-40c2-96c9-b2f0d287eb51 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:14.663681 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-81e3ca4d-96d3-40c2-96c9-b2f0d287eb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:14.672260 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1166/2383] 10.222.0.20 () {58 vars in 1016 bytes} [Sun Jul 24 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:14.696366 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b95e59-e20c-4643-9a75-b228e9d48704 service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:14.710556 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b95e59-e20c-4643-9a75-b228e9d48704 service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:14.717626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79f032-8ba9-4521-95ed-969757b9d40e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:14.718281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79f032-8ba9-4521-95ed-969757b9d40e service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:14.718564 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79f032-8ba9-4521-95ed-969757b9d40e service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:14.718842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a79f032-8ba9-4521-95ed-969757b9d40e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:14.728379 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79f032-8ba9-4521-95ed-969757b9d40e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:14.729956 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a79f032-8ba9-4521-95ed-969757b9d40e service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:14.740920 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1218/2384] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:16:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:16:24.653541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=39 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:24.735760 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=58 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:40.684908 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3ca4d-96d3-40c2-96c9-b2f0d287eb51 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:40.686555 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-81e3ca4d-96d3-40c2-96c9-b2f0d287eb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:40.744645 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3ca4d-96d3-40c2-96c9-b2f0d287eb51 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:40.749429 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb06d3-add7-4b4b-8fd4-7df9d6ca5833 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:40.750137 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb06d3-add7-4b4b-8fd4-7df9d6ca5833 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:40.750429 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb06d3-add7-4b4b-8fd4-7df9d6ca5833 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:40.750705 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb06d3-add7-4b4b-8fd4-7df9d6ca5833 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:40.752617 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3dcb06d3-add7-4b4b-8fd4-7df9d6ca5833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:40.771081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb06d3-add7-4b4b-8fd4-7df9d6ca5833 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:40.772610 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb06d3-add7-4b4b-8fd4-7df9d6ca5833 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:40.784051 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1167/2385] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:16:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:16:42.490727 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79f032-8ba9-4521-95ed-969757b9d40e service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:42.501279 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a79f032-8ba9-4521-95ed-969757b9d40e service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:42.505717 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8e8c4-d329-40e5-b16f-726ed02885ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:42.506357 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8e8c4-d329-40e5-b16f-726ed02885ef service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:42.506648 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8e8c4-d329-40e5-b16f-726ed02885ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:42.506913 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d8e8c4-d329-40e5-b16f-726ed02885ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:42.508848 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f1d8e8c4-d329-40e5-b16f-726ed02885ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:42.522189 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8e8c4-d329-40e5-b16f-726ed02885ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:42.523623 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d8e8c4-d329-40e5-b16f-726ed02885ef service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:42.536056 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1219/2386] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:16:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:16:48.400638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb06d3-add7-4b4b-8fd4-7df9d6ca5833 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:48.402255 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3dcb06d3-add7-4b4b-8fd4-7df9d6ca5833 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:48.416041 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb06d3-add7-4b4b-8fd4-7df9d6ca5833 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:48.420578 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d733cd57-a278-4086-b3d7-f4f097a4e734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:48.421460 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733cd57-a278-4086-b3d7-f4f097a4e734 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:48.421743 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733cd57-a278-4086-b3d7-f4f097a4e734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:48.422041 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d733cd57-a278-4086-b3d7-f4f097a4e734 admin admin] PATH_INFO: `/v3/users/b6e93b46abca4638a2c5ca6615c8972a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:48.423242 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733cd57-a278-4086-b3d7-f4f097a4e734 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6e93b46abca4638a2c5ca6615c8972a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:48.425662 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d733cd57-a278-4086-b3d7-f4f097a4e734 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:48.474411 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d733cd57-a278-4086-b3d7-f4f097a4e734 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6e93b46abca4638a2c5ca6615c8972a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:48.475109 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d733cd57-a278-4086-b3d7-f4f097a4e734 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6e93b46abca4638a2c5ca6615c8972a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:48.475826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d733cd57-a278-4086-b3d7-f4f097a4e734 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6e93b46abca4638a2c5ca6615c8972a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:48.483540 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d733cd57-a278-4086-b3d7-f4f097a4e734 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6e93b46abca4638a2c5ca6615c8972a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:48.496149 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-d733cd57-a278-4086-b3d7-f4f097a4e734 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6e93b46abca4638a2c5ca6615c8972a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:48.513326 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1168/2387] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:16:48 2022] DELETE /identity/v3/users/b6e93b46abca4638a2c5ca6615c8972a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:16:48.701130 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8e8c4-d329-40e5-b16f-726ed02885ef service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:48.711750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d8e8c4-d329-40e5-b16f-726ed02885ef service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:48.773991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b799c-6f67-4239-9a97-2bb07ea18f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:48.774927 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b799c-6f67-4239-9a97-2bb07ea18f28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:48.775209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b799c-6f67-4239-9a97-2bb07ea18f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:48.775519 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15b799c-6f67-4239-9a97-2bb07ea18f28 admin admin] PATH_INFO: `/v3/projects/f939fe11bf294c2e92ed1f8e9c5d43e2` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:48.776688 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b799c-6f67-4239-9a97-2bb07ea18f28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f939fe11bf294c2e92ed1f8e9c5d43e2)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:48.778610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15b799c-6f67-4239-9a97-2bb07ea18f28 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:48.828426 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d15b799c-6f67-4239-9a97-2bb07ea18f28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'request_id': 'req-d15b799c-6f67-4239-9a97-2bb07ea18f28'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:48.834475 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d15b799c-6f67-4239-9a97-2bb07ea18f28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'request_id': 'req-d15b799c-6f67-4239-9a97-2bb07ea18f28'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:48.840853 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d15b799c-6f67-4239-9a97-2bb07ea18f28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f939fe11bf294c2e92ed1f8e9c5d43e2', 'request_id': 'req-d15b799c-6f67-4239-9a97-2bb07ea18f28'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:48.854892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d15b799c-6f67-4239-9a97-2bb07ea18f28 admin admin] The token cache is being invalidate because project f939fe11bf294c2e92ed1f8e9c5d43e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:16:48.855179 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d15b799c-6f67-4239-9a97-2bb07ea18f28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:48.855845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d15b799c-6f67-4239-9a97-2bb07ea18f28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:16:48.857388 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1220/2388] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:16:48 2022] DELETE /identity/v3/projects/f939fe11bf294c2e92ed1f8e9c5d43e2 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:16:51.652649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80e4a-624f-4e9d-a805-ba64f8344221 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:51.653213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80e4a-624f-4e9d-a805-ba64f8344221 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:51.653213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc80e4a-624f-4e9d-a805-ba64f8344221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:51.670991 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5fc80e4a-624f-4e9d-a805-ba64f8344221 None None] MFA Rules not processed for user `1b8154ce6b6b40b4959bf354ccb5c59d`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:16:51.672196 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5fc80e4a-624f-4e9d-a805-ba64f8344221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:51.731439 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1169/2389] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:16:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:16:55.604464 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b799c-6f67-4239-9a97-2bb07ea18f28 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:55.606062 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d15b799c-6f67-4239-9a97-2bb07ea18f28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:55.683581 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15b799c-6f67-4239-9a97-2bb07ea18f28 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:55.689459 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ead6cf-923c-408e-aa7f-0db6e2c9c72c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:55.690123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ead6cf-923c-408e-aa7f-0db6e2c9c72c service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:55.690395 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ead6cf-923c-408e-aa7f-0db6e2c9c72c service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:55.690671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ead6cf-923c-408e-aa7f-0db6e2c9c72c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:55.692530 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-76ead6cf-923c-408e-aa7f-0db6e2c9c72c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:55.710832 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:16:55.758550 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ead6cf-923c-408e-aa7f-0db6e2c9c72c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:55.760283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ead6cf-923c-408e-aa7f-0db6e2c9c72c service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:55.770241 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1221/2390] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:16:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:16:56.712136 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc80e4a-624f-4e9d-a805-ba64f8344221 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:16:56.713662 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5fc80e4a-624f-4e9d-a805-ba64f8344221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:56.730088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc80e4a-624f-4e9d-a805-ba64f8344221 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:16:56.736621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9ea77-fd32-4c0e-afef-e37747e0cf5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:16:56.737259 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9ea77-fd32-4c0e-afef-e37747e0cf5e service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:16:56.737549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9ea77-fd32-4c0e-afef-e37747e0cf5e service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:16:56.737811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d9ea77-fd32-4c0e-afef-e37747e0cf5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:16:56.739766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-05d9ea77-fd32-4c0e-afef-e37747e0cf5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:16:56.750235 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9ea77-fd32-4c0e-afef-e37747e0cf5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:16:56.751857 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d9ea77-fd32-4c0e-afef-e37747e0cf5e service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:16:56.761152 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1170/2391] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:16:56 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:04.026325 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adde83-32d9-41fe-a8f0-fe5087e5f5e4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:04.026836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adde83-32d9-41fe-a8f0-fe5087e5f5e4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:04.027442 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adde83-32d9-41fe-a8f0-fe5087e5f5e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:04.053106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c3adde83-32d9-41fe-a8f0-fe5087e5f5e4 None None] MFA Rules not processed for user `1e7d0f401530454ba0cae0f5e9d6e0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:04.055854 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c3adde83-32d9-41fe-a8f0-fe5087e5f5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:04.066748 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1222/2392] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:17:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:04.533377 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9ea77-fd32-4c0e-afef-e37747e0cf5e service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:04.534926 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-05d9ea77-fd32-4c0e-afef-e37747e0cf5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:04.545525 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:04.601652 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d9ea77-fd32-4c0e-afef-e37747e0cf5e service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:04.605899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a53edd-0d92-46cf-ba47-ee993ada6ac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:04.606557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a53edd-0d92-46cf-ba47-ee993ada6ac8 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:04.606844 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a53edd-0d92-46cf-ba47-ee993ada6ac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:04.607249 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a53edd-0d92-46cf-ba47-ee993ada6ac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:04.609213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-81a53edd-0d92-46cf-ba47-ee993ada6ac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:04.619870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a53edd-0d92-46cf-ba47-ee993ada6ac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:04.621293 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a53edd-0d92-46cf-ba47-ee993ada6ac8 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:04.629943 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1171/2393] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:17:05.128344 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adde83-32d9-41fe-a8f0-fe5087e5f5e4 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:05.130486 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c3adde83-32d9-41fe-a8f0-fe5087e5f5e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:05.252510 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adde83-32d9-41fe-a8f0-fe5087e5f5e4 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:05.260092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8214a11-a9de-4299-a672-db64c3b5776b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333db0711d0f41fe8066ba5b9d91dacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:05.261302 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8214a11-a9de-4299-a672-db64c3b5776b service placement] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:05.261833 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8214a11-a9de-4299-a672-db64c3b5776b service placement] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:05.262878 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8214a11-a9de-4299-a672-db64c3b5776b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:05.265356 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c8214a11-a9de-4299-a672-db64c3b5776b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:05.278997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8214a11-a9de-4299-a672-db64c3b5776b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:05.280722 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8214a11-a9de-4299-a672-db64c3b5776b service placement] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:05.293866 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1223/2394] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:11.328125 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a53edd-0d92-46cf-ba47-ee993ada6ac8 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:11.329883 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-81a53edd-0d92-46cf-ba47-ee993ada6ac8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:11.343639 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a53edd-0d92-46cf-ba47-ee993ada6ac8 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:11.348238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384c699-730f-4643-bfef-dd3e58570fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:11.348909 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384c699-730f-4643-bfef-dd3e58570fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:11.349205 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384c699-730f-4643-bfef-dd3e58570fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:11.349488 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e384c699-730f-4643-bfef-dd3e58570fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:11.351674 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e384c699-730f-4643-bfef-dd3e58570fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:11.361766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384c699-730f-4643-bfef-dd3e58570fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:11.363218 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e384c699-730f-4643-bfef-dd3e58570fa1 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:11.371752 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1172/2395] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:15.289439 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=56 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:15.942808 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd57ff1-4f81-4e35-8ce5-7832b4fd4204 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:15.943101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd57ff1-4f81-4e35-8ce5-7832b4fd4204 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:15.943488 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd57ff1-4f81-4e35-8ce5-7832b4fd4204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:15.961813 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9fd57ff1-4f81-4e35-8ce5-7832b4fd4204 None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:15.963010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9fd57ff1-4f81-4e35-8ce5-7832b4fd4204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:16.018330 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1224/2396] 10.222.0.42 () {58 vars in 967 bytes} [Sun Jul 24 01:17:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:16.082735 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384c699-730f-4643-bfef-dd3e58570fa1 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:16.084246 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e384c699-730f-4643-bfef-dd3e58570fa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:16.161833 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e384c699-730f-4643-bfef-dd3e58570fa1 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:16.167130 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3617bd7-ba78-420b-85a1-0c55cacaa71e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:16.167850 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3617bd7-ba78-420b-85a1-0c55cacaa71e service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:16.168133 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3617bd7-ba78-420b-85a1-0c55cacaa71e service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:16.168409 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3617bd7-ba78-420b-85a1-0c55cacaa71e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:16.178141 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3617bd7-ba78-420b-85a1-0c55cacaa71e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:16.179797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3617bd7-ba78-420b-85a1-0c55cacaa71e service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:16.189130 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1173/2397] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:17:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:17:22.980594 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e012550-502d-49be-ab37-6e3197193102 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:22.981130 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e012550-502d-49be-ab37-6e3197193102 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:22.981130 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e012550-502d-49be-ab37-6e3197193102 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:22.982588 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1225/2398] 10.222.0.42 () {54 vars in 921 bytes} [Sun Jul 24 01:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:17:22.992944 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42d9a1-918d-417d-818c-25c3e000c7ff None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:22.993811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42d9a1-918d-417d-818c-25c3e000c7ff None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:22.994094 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e42d9a1-918d-417d-818c-25c3e000c7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:23.012440 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2e42d9a1-918d-417d-818c-25c3e000c7ff None None] MFA Rules not processed for user `333db0711d0f41fe8066ba5b9d91dacc`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:23.013654 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2e42d9a1-918d-417d-818c-25c3e000c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:23.023765 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1174/2399] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Jul 24 01:17:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:23.039112 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e012550-502d-49be-ab37-6e3197193102 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:23.041001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0e012550-502d-49be-ab37-6e3197193102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:23.056587 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42d9a1-918d-417d-818c-25c3e000c7ff None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:23.058681 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2e42d9a1-918d-417d-818c-25c3e000c7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:23.059863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e012550-502d-49be-ab37-6e3197193102 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:23.065171 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cacb8-ea91-4524-bd82-60c9780895ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333db0711d0f41fe8066ba5b9d91dacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:23.065844 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cacb8-ea91-4524-bd82-60c9780895ba service placement] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:23.066110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cacb8-ea91-4524-bd82-60c9780895ba service placement] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:23.066387 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cacb8-ea91-4524-bd82-60c9780895ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:23.075566 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cacb8-ea91-4524-bd82-60c9780895ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:23.077249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cacb8-ea91-4524-bd82-60c9780895ba service placement] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:23.087462 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1226/2400] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:23.133851 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e42d9a1-918d-417d-818c-25c3e000c7ff None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:23.138439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3eb70-bb16-4c63-a1fe-522ec3c468c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:23.139408 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3eb70-bb16-4c63-a1fe-522ec3c468c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:23.139710 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3eb70-bb16-4c63-a1fe-522ec3c468c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:23.139982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3eb70-bb16-4c63-a1fe-522ec3c468c7 admin admin] PATH_INFO: `/v3/users/9a0398a0ec144dfcbcc4c92fc54d4dee` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:23.141167 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3eb70-bb16-4c63-a1fe-522ec3c468c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0398a0ec144dfcbcc4c92fc54d4dee)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:23.143096 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a3eb70-bb16-4c63-a1fe-522ec3c468c7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:23.164365 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:23.193096 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b1a3eb70-bb16-4c63-a1fe-522ec3c468c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0398a0ec144dfcbcc4c92fc54d4dee'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:23.193814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b1a3eb70-bb16-4c63-a1fe-522ec3c468c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0398a0ec144dfcbcc4c92fc54d4dee'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:23.194529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b1a3eb70-bb16-4c63-a1fe-522ec3c468c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0398a0ec144dfcbcc4c92fc54d4dee'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:23.202439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b1a3eb70-bb16-4c63-a1fe-522ec3c468c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0398a0ec144dfcbcc4c92fc54d4dee'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:23.215341 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-b1a3eb70-bb16-4c63-a1fe-522ec3c468c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0398a0ec144dfcbcc4c92fc54d4dee'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:23.230021 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1175/2401] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:17:23 2022] DELETE /identity/v3/users/9a0398a0ec144dfcbcc4c92fc54d4dee => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:23.405761 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cacb8-ea91-4524-bd82-60c9780895ba service placement] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:23.420501 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cacb8-ea91-4524-bd82-60c9780895ba service placement] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:23.476603 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:23.477483 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:23.477765 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:23.478081 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2 admin admin] PATH_INFO: `/v3/projects/083e6e1f36c3453da2befa06a4875014` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:23.479282 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=083e6e1f36c3453da2befa06a4875014)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:23.481238 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:23.530562 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '083e6e1f36c3453da2befa06a4875014', 'request_id': 'req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:23.536785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '083e6e1f36c3453da2befa06a4875014', 'request_id': 'req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:23.542280 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '083e6e1f36c3453da2befa06a4875014', 'request_id': 'req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:23.556011 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2 admin admin] The token cache is being invalidate because project 083e6e1f36c3453da2befa06a4875014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:17:23.556304 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:23.557085 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:23.558483 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1227/2402] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:17:23 2022] DELETE /identity/v3/projects/083e6e1f36c3453da2befa06a4875014 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:23.562891 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3eb70-bb16-4c63-a1fe-522ec3c468c7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:23.564412 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b1a3eb70-bb16-4c63-a1fe-522ec3c468c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:23.577963 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a3eb70-bb16-4c63-a1fe-522ec3c468c7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:23.636868 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a3cf8-d885-40b2-bc14-eac0496beaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:23.637750 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a3cf8-d885-40b2-bc14-eac0496beaad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:23.638033 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a3cf8-d885-40b2-bc14-eac0496beaad admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:23.638330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a3cf8-d885-40b2-bc14-eac0496beaad admin admin] PATH_INFO: `/v3/users/00a51f5f88c1449aa203f8f8c0a6e17b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:23.639573 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a3cf8-d885-40b2-bc14-eac0496beaad admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a51f5f88c1449aa203f8f8c0a6e17b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:23.641518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58a3cf8-d885-40b2-bc14-eac0496beaad admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:23.691009 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e58a3cf8-d885-40b2-bc14-eac0496beaad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a51f5f88c1449aa203f8f8c0a6e17b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:23.691778 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e58a3cf8-d885-40b2-bc14-eac0496beaad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a51f5f88c1449aa203f8f8c0a6e17b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:23.692488 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e58a3cf8-d885-40b2-bc14-eac0496beaad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a51f5f88c1449aa203f8f8c0a6e17b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:23.699998 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e58a3cf8-d885-40b2-bc14-eac0496beaad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a51f5f88c1449aa203f8f8c0a6e17b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:23.712767 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e58a3cf8-d885-40b2-bc14-eac0496beaad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a51f5f88c1449aa203f8f8c0a6e17b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:23.730425 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1176/2403] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:17:23 2022] DELETE /identity/v3/users/00a51f5f88c1449aa203f8f8c0a6e17b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:23.913668 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:23.915183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:23.929049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb7a73-3e88-45c4-96b4-a71528d7a3d2 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:23.948353 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:23.988243 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ba2ff0-5303-4c31-8d3a-c26b7cb1bf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:23.989111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba2ff0-5303-4c31-8d3a-c26b7cb1bf14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:23.989391 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba2ff0-5303-4c31-8d3a-c26b7cb1bf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:23.989691 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ba2ff0-5303-4c31-8d3a-c26b7cb1bf14 admin admin] PATH_INFO: `/v3/projects/1f8b56a808d54427b3c1923e541141c2` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:23.990908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba2ff0-5303-4c31-8d3a-c26b7cb1bf14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8b56a808d54427b3c1923e541141c2)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:23.993253 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ba2ff0-5303-4c31-8d3a-c26b7cb1bf14 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:24.042962 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-57ba2ff0-5303-4c31-8d3a-c26b7cb1bf14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8b56a808d54427b3c1923e541141c2', 'request_id': 'req-57ba2ff0-5303-4c31-8d3a-c26b7cb1bf14'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:24.049624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-57ba2ff0-5303-4c31-8d3a-c26b7cb1bf14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8b56a808d54427b3c1923e541141c2', 'request_id': 'req-57ba2ff0-5303-4c31-8d3a-c26b7cb1bf14'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:24.055377 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-57ba2ff0-5303-4c31-8d3a-c26b7cb1bf14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8b56a808d54427b3c1923e541141c2', 'request_id': 'req-57ba2ff0-5303-4c31-8d3a-c26b7cb1bf14'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:24.069799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-57ba2ff0-5303-4c31-8d3a-c26b7cb1bf14 admin admin] The token cache is being invalidate because project 1f8b56a808d54427b3c1923e541141c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:17:24.070093 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-57ba2ff0-5303-4c31-8d3a-c26b7cb1bf14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:24.070762 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-57ba2ff0-5303-4c31-8d3a-c26b7cb1bf14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:17:24.072404 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1228/2404] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:17:23 2022] DELETE /identity/v3/projects/1f8b56a808d54427b3c1923e541141c2 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:24.077699 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b3475-6ca1-479c-80b6-93b5113247aa None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:24.078157 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b3475-6ca1-479c-80b6-93b5113247aa None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:24.078538 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575b3475-6ca1-479c-80b6-93b5113247aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:24.099590 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-575b3475-6ca1-479c-80b6-93b5113247aa None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:24.100805 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-575b3475-6ca1-479c-80b6-93b5113247aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:24.114619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:24.169542 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1177/2405] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:24.181951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f38890-2429-48e4-be9e-17b2bd7f6023 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:24.182297 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f38890-2429-48e4-be9e-17b2bd7f6023 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:24.182691 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f38890-2429-48e4-be9e-17b2bd7f6023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:24.207747 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c8f38890-2429-48e4-be9e-17b2bd7f6023 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:24.208872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c8f38890-2429-48e4-be9e-17b2bd7f6023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:24.218352 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1229/2406] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:24.223233 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b3475-6ca1-479c-80b6-93b5113247aa None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:24.236470 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575b3475-6ca1-479c-80b6-93b5113247aa None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:24.242433 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e648c-a498-43d8-a6e5-281bd4ab9113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:24.243097 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e648c-a498-43d8-a6e5-281bd4ab9113 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:24.243403 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e648c-a498-43d8-a6e5-281bd4ab9113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:24.243679 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e648c-a498-43d8-a6e5-281bd4ab9113 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:24.244412 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e648c-a498-43d8-a6e5-281bd4ab9113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:17:24.244720 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e648c-a498-43d8-a6e5-281bd4ab9113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:24.246353 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e648c-a498-43d8-a6e5-281bd4ab9113 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:24.258724 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1178/2407] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:17:24.263029 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f38890-2429-48e4-be9e-17b2bd7f6023 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:24.272566 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f38890-2429-48e4-be9e-17b2bd7f6023 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:24.278320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185edfa-bd50-4f3f-9d79-0b53aed70e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:24.279064 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185edfa-bd50-4f3f-9d79-0b53aed70e9b admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:24.279376 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185edfa-bd50-4f3f-9d79-0b53aed70e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:24.279649 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185edfa-bd50-4f3f-9d79-0b53aed70e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:24.280342 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185edfa-bd50-4f3f-9d79-0b53aed70e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:24.282246 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185edfa-bd50-4f3f-9d79-0b53aed70e9b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:24.314609 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1230/2408] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:17:24 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:24.319357 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e648c-a498-43d8-a6e5-281bd4ab9113 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:24.330028 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e648c-a498-43d8-a6e5-281bd4ab9113 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:24.388469 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b464c37-2bda-4d70-bfdc-b3e9453002c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:24.389132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b464c37-2bda-4d70-bfdc-b3e9453002c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:24.389419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b464c37-2bda-4d70-bfdc-b3e9453002c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:24.389686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b464c37-2bda-4d70-bfdc-b3e9453002c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:24.390370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b464c37-2bda-4d70-bfdc-b3e9453002c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:24.392358 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b464c37-2bda-4d70-bfdc-b3e9453002c8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:24.413552 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1179/2409] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:17:24 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:24.418196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185edfa-bd50-4f3f-9d79-0b53aed70e9b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:24.428626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185edfa-bd50-4f3f-9d79-0b53aed70e9b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:24.433259 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959efde-2bd6-4dd0-b00b-760d03501a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:24.433914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959efde-2bd6-4dd0-b00b-760d03501a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:24.434191 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959efde-2bd6-4dd0-b00b-760d03501a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:24.434461 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959efde-2bd6-4dd0-b00b-760d03501a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:24.435314 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959efde-2bd6-4dd0-b00b-760d03501a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:24.436965 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959efde-2bd6-4dd0-b00b-760d03501a75 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:24.451777 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1231/2410] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:24.458121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b464c37-2bda-4d70-bfdc-b3e9453002c8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:24.471824 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b464c37-2bda-4d70-bfdc-b3e9453002c8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:24.477417 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5583d8e-e913-4a5b-9466-854341572ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:24.478110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5583d8e-e913-4a5b-9466-854341572ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:24.478392 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5583d8e-e913-4a5b-9466-854341572ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:24.478672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5583d8e-e913-4a5b-9466-854341572ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:24.479454 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5583d8e-e913-4a5b-9466-854341572ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:24.481104 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5583d8e-e913-4a5b-9466-854341572ad4 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:24.492362 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1180/2411] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:24.496804 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959efde-2bd6-4dd0-b00b-760d03501a75 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:24.507775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959efde-2bd6-4dd0-b00b-760d03501a75 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:24.514384 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794b55d-05b9-4569-8b88-56eddd2e30db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:24.515275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794b55d-05b9-4569-8b88-56eddd2e30db admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:24.515586 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794b55d-05b9-4569-8b88-56eddd2e30db admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:24.515859 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794b55d-05b9-4569-8b88-56eddd2e30db admin admin] PATH_INFO: `/v3/projects/935463280c7a4d6eaab209974e8b1bf8/users/2f6dd6349c9a467ca7cd5aaf1b9c6a07/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:24.531330 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794b55d-05b9-4569-8b88-56eddd2e30db admin admin] RBAC: Authorizing `identity:create_grant(project_id=935463280c7a4d6eaab209974e8b1bf8, user_id=2f6dd6349c9a467ca7cd5aaf1b9c6a07, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:24.534030 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794b55d-05b9-4569-8b88-56eddd2e30db admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:24.550101 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1232/2412] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:17:24 2022] PUT /identity/v3/projects/935463280c7a4d6eaab209974e8b1bf8/users/2f6dd6349c9a467ca7cd5aaf1b9c6a07/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:24.555263 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f3b20-b549-47c0-ae3c-91a999788e69 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:24.555588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f3b20-b549-47c0-ae3c-91a999788e69 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:24.555868 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4f3b20-b549-47c0-ae3c-91a999788e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:24.573914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-7e4f3b20-b549-47c0-ae3c-91a999788e69 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:24.575113 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7e4f3b20-b549-47c0-ae3c-91a999788e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:24.632916 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1181/2413] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:17:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:17:24.642837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794b55d-05b9-4569-8b88-56eddd2e30db admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:24.644651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-0794b55d-05b9-4569-8b88-56eddd2e30db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:24.700731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:24.704932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794b55d-05b9-4569-8b88-56eddd2e30db admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:24.709833 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06954cee-7de1-4473-8f7f-24e6d665fbc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:24.710429 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06954cee-7de1-4473-8f7f-24e6d665fbc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:24.710753 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06954cee-7de1-4473-8f7f-24e6d665fbc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:24.711039 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06954cee-7de1-4473-8f7f-24e6d665fbc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:24.727491 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06954cee-7de1-4473-8f7f-24e6d665fbc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:24.728993 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06954cee-7de1-4473-8f7f-24e6d665fbc9 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:24.739239 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1233/2414] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:28.631478 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099298c-f03b-436e-b730-0728a897f909 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:28.632026 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099298c-f03b-436e-b730-0728a897f909 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:28.632128 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099298c-f03b-436e-b730-0728a897f909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:28.666289 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b099298c-f03b-436e-b730-0728a897f909 None None] MFA Rules not processed for user `2f6dd6349c9a467ca7cd5aaf1b9c6a07`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:28.667674 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b099298c-f03b-436e-b730-0728a897f909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:28.680942 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:28.739239 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1182/2415] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:17:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:28.743930 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06954cee-7de1-4473-8f7f-24e6d665fbc9 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:28.754213 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06954cee-7de1-4473-8f7f-24e6d665fbc9 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:28.758885 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0e6b8-49da-4335-af65-2a3bb0225027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:28.759599 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0e6b8-49da-4335-af65-2a3bb0225027 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:28.760001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0e6b8-49da-4335-af65-2a3bb0225027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:28.760289 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0e6b8-49da-4335-af65-2a3bb0225027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:28.761014 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0e6b8-49da-4335-af65-2a3bb0225027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:28.762989 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a0e6b8-49da-4335-af65-2a3bb0225027 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:28.790044 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1234/2416] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:17:28 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:17:28.794235 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099298c-f03b-436e-b730-0728a897f909 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:28.808393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099298c-f03b-436e-b730-0728a897f909 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:28.867907 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a1b55-9416-4962-b748-dc987b273aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:28.868608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1b55-9416-4962-b748-dc987b273aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:28.868916 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1b55-9416-4962-b748-dc987b273aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:28.869202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a1b55-9416-4962-b748-dc987b273aa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:28.869912 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a1b55-9416-4962-b748-dc987b273aa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:28.871919 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a1b55-9416-4962-b748-dc987b273aa7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:28.895314 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1183/2417] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:17:28 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:17:28.899331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0e6b8-49da-4335-af65-2a3bb0225027 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:28.911567 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0e6b8-49da-4335-af65-2a3bb0225027 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:28.917628 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2d435-c827-41df-a6cc-de91ebff6a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:28.918442 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2d435-c827-41df-a6cc-de91ebff6a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:28.918810 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2d435-c827-41df-a6cc-de91ebff6a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:28.919170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2d435-c827-41df-a6cc-de91ebff6a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:28.919962 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2d435-c827-41df-a6cc-de91ebff6a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:28.921593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2d435-c827-41df-a6cc-de91ebff6a87 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:28.934905 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1235/2418] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:17:28.942396 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a1b55-9416-4962-b748-dc987b273aa7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:28.963722 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a1b55-9416-4962-b748-dc987b273aa7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:28.970557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a62a6-cdde-451d-b57d-0ec186e12c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:28.971532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a62a6-cdde-451d-b57d-0ec186e12c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:28.971839 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a62a6-cdde-451d-b57d-0ec186e12c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:28.972114 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a62a6-cdde-451d-b57d-0ec186e12c51 admin admin] PATH_INFO: `/v3/projects/cc04cdecfa6d4242a959c4d8a42f5af5/users/f2775d3a80ac4db482f202dba2219811/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:28.988518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a62a6-cdde-451d-b57d-0ec186e12c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc04cdecfa6d4242a959c4d8a42f5af5, user_id=f2775d3a80ac4db482f202dba2219811, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:28.991204 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a62a6-cdde-451d-b57d-0ec186e12c51 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:29.007162 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1184/2419] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:17:28 2022] PUT /identity/v3/projects/cc04cdecfa6d4242a959c4d8a42f5af5/users/f2775d3a80ac4db482f202dba2219811/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:29.011207 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2d435-c827-41df-a6cc-de91ebff6a87 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:29.022638 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2d435-c827-41df-a6cc-de91ebff6a87 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:29.088477 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b2f2b-4912-4602-86e2-709f4fcfd559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:29.089174 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b2f2b-4912-4602-86e2-709f4fcfd559 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:29.089459 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b2f2b-4912-4602-86e2-709f4fcfd559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:29.089736 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b2f2b-4912-4602-86e2-709f4fcfd559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:29.090506 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b2f2b-4912-4602-86e2-709f4fcfd559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:29.092370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b2f2b-4912-4602-86e2-709f4fcfd559 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:29.103258 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1236/2420] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:17:29.107750 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a62a6-cdde-451d-b57d-0ec186e12c51 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:29.118388 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a62a6-cdde-451d-b57d-0ec186e12c51 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:29.123132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c754d3-6b72-40b5-b5fa-9d1905a0ea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:29.124062 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c754d3-6b72-40b5-b5fa-9d1905a0ea10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:29.124338 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c754d3-6b72-40b5-b5fa-9d1905a0ea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:29.124638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c754d3-6b72-40b5-b5fa-9d1905a0ea10 admin admin] PATH_INFO: `/v3/projects/cc04cdecfa6d4242a959c4d8a42f5af5/users/f2775d3a80ac4db482f202dba2219811/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:29.126582 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c754d3-6b72-40b5-b5fa-9d1905a0ea10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc04cdecfa6d4242a959c4d8a42f5af5, user_id=f2775d3a80ac4db482f202dba2219811, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:29.129270 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c754d3-6b72-40b5-b5fa-9d1905a0ea10 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:29.140302 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1185/2421] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:17:29 2022] PUT /identity/v3/projects/cc04cdecfa6d4242a959c4d8a42f5af5/users/f2775d3a80ac4db482f202dba2219811/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:17:33.894698 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8ca19-c26f-46be-974d-7650250b9684 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:33.895205 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8ca19-c26f-46be-974d-7650250b9684 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:33.895344 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f8ca19-c26f-46be-974d-7650250b9684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:33.922453 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f4f8ca19-c26f-46be-974d-7650250b9684 None None] MFA Rules not processed for user `f2775d3a80ac4db482f202dba2219811`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:33.924055 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f4f8ca19-c26f-46be-974d-7650250b9684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:33.999016 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1237/2422] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:17:33 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:34.015919 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c754d3-6b72-40b5-b5fa-9d1905a0ea10 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:34.017820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-83c754d3-6b72-40b5-b5fa-9d1905a0ea10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:34.092464 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:34.097546 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c754d3-6b72-40b5-b5fa-9d1905a0ea10 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:34.104051 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86f727-ad4a-47bf-a4ce-30392f7e8a81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:34.104685 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86f727-ad4a-47bf-a4ce-30392f7e8a81 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:34.105003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86f727-ad4a-47bf-a4ce-30392f7e8a81 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:34.105262 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86f727-ad4a-47bf-a4ce-30392f7e8a81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:34.162968 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86f727-ad4a-47bf-a4ce-30392f7e8a81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:34.165407 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86f727-ad4a-47bf-a4ce-30392f7e8a81 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:34.180260 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1186/2423] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:35.201113 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761606c-f6e6-49b1-9e98-6b9fa3395a62 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:35.201646 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761606c-f6e6-49b1-9e98-6b9fa3395a62 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:35.201776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7761606c-f6e6-49b1-9e98-6b9fa3395a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:35.219851 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7761606c-f6e6-49b1-9e98-6b9fa3395a62 None None] MFA Rules not processed for user `2f6dd6349c9a467ca7cd5aaf1b9c6a07`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:35.221101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7761606c-f6e6-49b1-9e98-6b9fa3395a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:35.228267 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1238/2424] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:17:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:44.173432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=26 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:45.214472 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=84,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:17:46.102621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86f727-ad4a-47bf-a4ce-30392f7e8a81 service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:46.104750 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3f86f727-ad4a-47bf-a4ce-30392f7e8a81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:46.164740 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86f727-ad4a-47bf-a4ce-30392f7e8a81 service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:46.168550 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca56091-66c3-42a7-9373-94aaec40be26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:46.169195 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca56091-66c3-42a7-9373-94aaec40be26 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:46.169475 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca56091-66c3-42a7-9373-94aaec40be26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:46.169746 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca56091-66c3-42a7-9373-94aaec40be26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:46.171611 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7ca56091-66c3-42a7-9373-94aaec40be26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:46.237146 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca56091-66c3-42a7-9373-94aaec40be26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:46.238598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca56091-66c3-42a7-9373-94aaec40be26 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:46.247904 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1187/2425] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:49.405195 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761606c-f6e6-49b1-9e98-6b9fa3395a62 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:49.418505 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7761606c-f6e6-49b1-9e98-6b9fa3395a62 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:49.425293 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18967a29-99d6-465d-941f-8fe3c40012ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:49.425964 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18967a29-99d6-465d-941f-8fe3c40012ee service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:49.426248 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18967a29-99d6-465d-941f-8fe3c40012ee service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:49.426524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18967a29-99d6-465d-941f-8fe3c40012ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:49.428445 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-18967a29-99d6-465d-941f-8fe3c40012ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:49.444293 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18967a29-99d6-465d-941f-8fe3c40012ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:49.446291 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18967a29-99d6-465d-941f-8fe3c40012ee service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:49.459212 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1239/2426] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:17:52.180069 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f3418-624f-46f3-9bda-9214f85dc3b7 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:52.180553 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f3418-624f-46f3-9bda-9214f85dc3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:52.180676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26f3418-624f-46f3-9bda-9214f85dc3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:52.198329 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b26f3418-624f-46f3-9bda-9214f85dc3b7 None None] MFA Rules not processed for user `601f4db65bf74587ab9b0080a44b4f79`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:17:52.199580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b26f3418-624f-46f3-9bda-9214f85dc3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:52.207844 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1188/2427] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:17:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:17:52.543443 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18967a29-99d6-465d-941f-8fe3c40012ee service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:17:52.602058 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18967a29-99d6-465d-941f-8fe3c40012ee service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:17:52.607004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44b90d-c4a4-4be7-b3ee-bc6e23371ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:17:52.607688 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44b90d-c4a4-4be7-b3ee-bc6e23371ccc service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:17:52.608000 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44b90d-c4a4-4be7-b3ee-bc6e23371ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:17:52.608276 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a44b90d-c4a4-4be7-b3ee-bc6e23371ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:17:52.610454 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4a44b90d-c4a4-4be7-b3ee-bc6e23371ccc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:17:52.621521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44b90d-c4a4-4be7-b3ee-bc6e23371ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:17:52.622972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a44b90d-c4a4-4be7-b3ee-bc6e23371ccc service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:17:52.632110 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1240/2428] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:17:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:02.193088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=51 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:02.424846 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f3418-624f-46f3-9bda-9214f85dc3b7 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:02.426272 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b26f3418-624f-46f3-9bda-9214f85dc3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:02.442453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26f3418-624f-46f3-9bda-9214f85dc3b7 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:02.447934 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee6826-40da-41ca-93bb-49fab4da3860 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:02.448556 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee6826-40da-41ca-93bb-49fab4da3860 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:02.448840 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee6826-40da-41ca-93bb-49fab4da3860 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:02.449121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee6826-40da-41ca-93bb-49fab4da3860 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:02.450872 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c5ee6826-40da-41ca-93bb-49fab4da3860 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:02.464159 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee6826-40da-41ca-93bb-49fab4da3860 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:02.465767 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee6826-40da-41ca-93bb-49fab4da3860 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:02.477476 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1189/2429] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:18:02.627890 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=32 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:10.575975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44b90d-c4a4-4be7-b3ee-bc6e23371ccc service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:10.591814 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a44b90d-c4a4-4be7-b3ee-bc6e23371ccc service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:10.598107 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de62b13-275d-41d0-82c7-c7b885523fd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:10.598775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de62b13-275d-41d0-82c7-c7b885523fd3 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:10.599066 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de62b13-275d-41d0-82c7-c7b885523fd3 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:10.599376 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de62b13-275d-41d0-82c7-c7b885523fd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:10.601318 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7de62b13-275d-41d0-82c7-c7b885523fd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:10.614773 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de62b13-275d-41d0-82c7-c7b885523fd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:10.617206 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de62b13-275d-41d0-82c7-c7b885523fd3 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:10.636485 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1241/2430] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:12.472181 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=6 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:12.867069 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee6826-40da-41ca-93bb-49fab4da3860 service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:12.877283 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee6826-40da-41ca-93bb-49fab4da3860 service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:12.881220 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c5723-0532-4524-b724-d779d00136ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:12.881944 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c5723-0532-4524-b724-d779d00136ab service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:12.882297 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c5723-0532-4524-b724-d779d00136ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:12.882663 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c5723-0532-4524-b724-d779d00136ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:12.892286 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c5723-0532-4524-b724-d779d00136ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:12.893743 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834c5723-0532-4524-b724-d779d00136ab service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:12.903371 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1190/2431] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:12 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:20.623393 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=6 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:22.899149 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=6 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:24.146093 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de62b13-275d-41d0-82c7-c7b885523fd3 service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:24.156710 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de62b13-275d-41d0-82c7-c7b885523fd3 service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:24.161522 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f180ec-9458-4cc2-a572-b9a9fc4277a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:24.162162 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f180ec-9458-4cc2-a572-b9a9fc4277a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:24.162445 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f180ec-9458-4cc2-a572-b9a9fc4277a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:24.162716 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f180ec-9458-4cc2-a572-b9a9fc4277a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:24.164837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-93f180ec-9458-4cc2-a572-b9a9fc4277a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:24.234187 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f180ec-9458-4cc2-a572-b9a9fc4277a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:24.235667 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f180ec-9458-4cc2-a572-b9a9fc4277a7 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:24.245532 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1242/2432] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:27.308798 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c5723-0532-4524-b724-d779d00136ab service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:27.310281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-834c5723-0532-4524-b724-d779d00136ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:27.374053 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f180ec-9458-4cc2-a572-b9a9fc4277a7 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:27.375798 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-93f180ec-9458-4cc2-a572-b9a9fc4277a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:27.387566 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834c5723-0532-4524-b724-d779d00136ab service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:27.389179 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f180ec-9458-4cc2-a572-b9a9fc4277a7 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:27.392569 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2afb4e-2ed4-4e38-b34f-1d0acd733bc9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333db0711d0f41fe8066ba5b9d91dacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:27.393225 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2afb4e-2ed4-4e38-b34f-1d0acd733bc9 service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:27.393508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2afb4e-2ed4-4e38-b34f-1d0acd733bc9 service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:27.393795 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2afb4e-2ed4-4e38-b34f-1d0acd733bc9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:27.394013 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814002c9-3aaf-42ca-b68d-7f6e761dc684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:27.394892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814002c9-3aaf-42ca-b68d-7f6e761dc684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:27.395170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814002c9-3aaf-42ca-b68d-7f6e761dc684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:27.395471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814002c9-3aaf-42ca-b68d-7f6e761dc684 admin admin] PATH_INFO: `/v3/users/1b8154ce6b6b40b4959bf354ccb5c59d` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:27.395608 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dd2afb4e-2ed4-4e38-b34f-1d0acd733bc9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:27.396662 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814002c9-3aaf-42ca-b68d-7f6e761dc684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b8154ce6b6b40b4959bf354ccb5c59d)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:27.398720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814002c9-3aaf-42ca-b68d-7f6e761dc684 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:27.409368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2afb4e-2ed4-4e38-b34f-1d0acd733bc9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:27.411179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2afb4e-2ed4-4e38-b34f-1d0acd733bc9 service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:27.422111 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1191/2433] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:27.449898 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-814002c9-3aaf-42ca-b68d-7f6e761dc684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b8154ce6b6b40b4959bf354ccb5c59d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:27.450571 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-814002c9-3aaf-42ca-b68d-7f6e761dc684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b8154ce6b6b40b4959bf354ccb5c59d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:27.461375 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-814002c9-3aaf-42ca-b68d-7f6e761dc684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b8154ce6b6b40b4959bf354ccb5c59d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:27.461931 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-814002c9-3aaf-42ca-b68d-7f6e761dc684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b8154ce6b6b40b4959bf354ccb5c59d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:27.468755 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-814002c9-3aaf-42ca-b68d-7f6e761dc684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b8154ce6b6b40b4959bf354ccb5c59d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:27.485760 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1243/2434] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:18:27 2022] DELETE /identity/v3/users/1b8154ce6b6b40b4959bf354ccb5c59d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:18:27.664720 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2afb4e-2ed4-4e38-b34f-1d0acd733bc9 service placement] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:27.676209 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2afb4e-2ed4-4e38-b34f-1d0acd733bc9 service placement] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:27.734086 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe167ce0-103d-44ce-9ab3-1303806151bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:27.734954 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe167ce0-103d-44ce-9ab3-1303806151bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:27.735236 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe167ce0-103d-44ce-9ab3-1303806151bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:27.735542 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe167ce0-103d-44ce-9ab3-1303806151bf admin admin] PATH_INFO: `/v3/projects/55d33269082642989cbc18c052f07b94` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:27.736773 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe167ce0-103d-44ce-9ab3-1303806151bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d33269082642989cbc18c052f07b94)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:27.738695 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe167ce0-103d-44ce-9ab3-1303806151bf admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:27.787350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fe167ce0-103d-44ce-9ab3-1303806151bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d33269082642989cbc18c052f07b94', 'request_id': 'req-fe167ce0-103d-44ce-9ab3-1303806151bf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:27.800064 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fe167ce0-103d-44ce-9ab3-1303806151bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d33269082642989cbc18c052f07b94', 'request_id': 'req-fe167ce0-103d-44ce-9ab3-1303806151bf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:27.806588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fe167ce0-103d-44ce-9ab3-1303806151bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d33269082642989cbc18c052f07b94', 'request_id': 'req-fe167ce0-103d-44ce-9ab3-1303806151bf'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:27.819058 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fe167ce0-103d-44ce-9ab3-1303806151bf admin admin] The token cache is being invalidate because project 55d33269082642989cbc18c052f07b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:18:27.819405 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fe167ce0-103d-44ce-9ab3-1303806151bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:27.820081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-fe167ce0-103d-44ce-9ab3-1303806151bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:18:27.821753 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1192/2435] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:18:27 2022] DELETE /identity/v3/projects/55d33269082642989cbc18c052f07b94 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:27.826856 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ee7e-54a2-4979-a95f-57e806ddd872 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:27.827151 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ee7e-54a2-4979-a95f-57e806ddd872 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:27.827459 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497ee7e-54a2-4979-a95f-57e806ddd872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:27.847430 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2497ee7e-54a2-4979-a95f-57e806ddd872 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:27.848776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2497ee7e-54a2-4979-a95f-57e806ddd872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:27.909127 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1244/2436] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:27.917123 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bbafc-f35a-4e30-98ee-41767821e5ac None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:27.917416 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bbafc-f35a-4e30-98ee-41767821e5ac None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:27.917699 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bbafc-f35a-4e30-98ee-41767821e5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:27.937274 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b36bbafc-f35a-4e30-98ee-41767821e5ac None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:27.938508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b36bbafc-f35a-4e30-98ee-41767821e5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:27.947056 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1193/2437] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:27.951475 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497ee7e-54a2-4979-a95f-57e806ddd872 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:27.961222 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2497ee7e-54a2-4979-a95f-57e806ddd872 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:27.966004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9bcf9-d5dc-4b72-abaf-cde93474982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:27.966666 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9bcf9-d5dc-4b72-abaf-cde93474982d admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:27.966954 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9bcf9-d5dc-4b72-abaf-cde93474982d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:27.967233 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e9bcf9-d5dc-4b72-abaf-cde93474982d admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:27.967997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9bcf9-d5dc-4b72-abaf-cde93474982d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:18:27.968311 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9bcf9-d5dc-4b72-abaf-cde93474982d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:27.969929 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e9bcf9-d5dc-4b72-abaf-cde93474982d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:27.971527 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:27.983415 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1245/2438] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:18:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:18:27.988479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bbafc-f35a-4e30-98ee-41767821e5ac None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:27.997824 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bbafc-f35a-4e30-98ee-41767821e5ac None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:28.002576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858853d-434f-4600-9cb3-abe8d6842400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:28.003232 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858853d-434f-4600-9cb3-abe8d6842400 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:28.003554 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858853d-434f-4600-9cb3-abe8d6842400 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:28.003837 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0858853d-434f-4600-9cb3-abe8d6842400 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:28.004548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858853d-434f-4600-9cb3-abe8d6842400 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:28.006487 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0858853d-434f-4600-9cb3-abe8d6842400 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:28.016635 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:28.035697 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1194/2439] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:18:27 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:18:28.039884 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9bcf9-d5dc-4b72-abaf-cde93474982d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:28.050466 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e9bcf9-d5dc-4b72-abaf-cde93474982d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:28.109529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92468cdc-78d9-4c49-9388-e903f78d1c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:28.110249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92468cdc-78d9-4c49-9388-e903f78d1c58 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:28.110577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92468cdc-78d9-4c49-9388-e903f78d1c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:28.110841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92468cdc-78d9-4c49-9388-e903f78d1c58 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:28.111583 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92468cdc-78d9-4c49-9388-e903f78d1c58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:28.113581 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92468cdc-78d9-4c49-9388-e903f78d1c58 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:28.134691 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1246/2440] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:18:28 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:18:28.144352 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858853d-434f-4600-9cb3-abe8d6842400 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:28.156110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0858853d-434f-4600-9cb3-abe8d6842400 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:28.161433 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a5540-4da4-412c-9d92-a4b4704c37dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:28.162139 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a5540-4da4-412c-9d92-a4b4704c37dd admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:28.162410 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a5540-4da4-412c-9d92-a4b4704c37dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:28.162679 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a5540-4da4-412c-9d92-a4b4704c37dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:28.163438 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a5540-4da4-412c-9d92-a4b4704c37dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:28.165055 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a5540-4da4-412c-9d92-a4b4704c37dd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:28.176212 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1195/2441] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:18:28.180676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92468cdc-78d9-4c49-9388-e903f78d1c58 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:28.191151 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92468cdc-78d9-4c49-9388-e903f78d1c58 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:28.197083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c10afe-76f3-4690-a4c7-cdbc13f766e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:28.197751 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c10afe-76f3-4690-a4c7-cdbc13f766e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:28.198038 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c10afe-76f3-4690-a4c7-cdbc13f766e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:28.198317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c10afe-76f3-4690-a4c7-cdbc13f766e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:28.199085 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c10afe-76f3-4690-a4c7-cdbc13f766e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:28.200756 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c10afe-76f3-4690-a4c7-cdbc13f766e4 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:28.211571 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1247/2442] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:18:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:18:28.217507 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a5540-4da4-412c-9d92-a4b4704c37dd admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:28.227960 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a5540-4da4-412c-9d92-a4b4704c37dd admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:28.233426 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127045c-97f9-4b32-8351-13538f4f6983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:28.234394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127045c-97f9-4b32-8351-13538f4f6983 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:28.234737 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127045c-97f9-4b32-8351-13538f4f6983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:28.235103 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127045c-97f9-4b32-8351-13538f4f6983 admin admin] PATH_INFO: `/v3/projects/013fccf2797345bf95efcafd089dfcf1/users/fe042f088ffb4b7db88cafe05b11808c/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:28.250704 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127045c-97f9-4b32-8351-13538f4f6983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=013fccf2797345bf95efcafd089dfcf1, user_id=fe042f088ffb4b7db88cafe05b11808c, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:28.253413 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127045c-97f9-4b32-8351-13538f4f6983 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:28.268929 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1196/2443] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:18:28 2022] PUT /identity/v3/projects/013fccf2797345bf95efcafd089dfcf1/users/fe042f088ffb4b7db88cafe05b11808c/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:18:28.274274 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4476e-d098-4685-ae10-1cfc3dea1216 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:28.274581 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4476e-d098-4685-ae10-1cfc3dea1216 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:28.274859 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4476e-d098-4685-ae10-1cfc3dea1216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:28.292309 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-fbe4476e-d098-4685-ae10-1cfc3dea1216 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:28.293455 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-fbe4476e-d098-4685-ae10-1cfc3dea1216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:28.362669 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1248/2444] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:18:28.372687 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127045c-97f9-4b32-8351-13538f4f6983 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:28.374756 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3127045c-97f9-4b32-8351-13538f4f6983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:28.435766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127045c-97f9-4b32-8351-13538f4f6983 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:28.439990 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c83a8-75f0-4689-836b-f44e4542ea24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:28.440633 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c83a8-75f0-4689-836b-f44e4542ea24 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:28.440921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c83a8-75f0-4689-836b-f44e4542ea24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:28.441200 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1c83a8-75f0-4689-836b-f44e4542ea24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:28.451329 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c83a8-75f0-4689-836b-f44e4542ea24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:28.452821 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1c83a8-75f0-4689-836b-f44e4542ea24 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:28.462943 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1197/2445] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:32.357635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53416c-bc73-4740-b8e2-fd75c6847799 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:32.358112 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53416c-bc73-4740-b8e2-fd75c6847799 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:32.358221 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53416c-bc73-4740-b8e2-fd75c6847799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:32.385791 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-8d53416c-bc73-4740-b8e2-fd75c6847799 None None] MFA Rules not processed for user `fe042f088ffb4b7db88cafe05b11808c`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:32.387256 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8d53416c-bc73-4740-b8e2-fd75c6847799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:32.454143 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1249/2446] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:18:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:32.468461 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c83a8-75f0-4689-836b-f44e4542ea24 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:18:32.469894 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8d1c83a8-75f0-4689-836b-f44e4542ea24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:32.575493 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1c83a8-75f0-4689-836b-f44e4542ea24 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:18:32.580943 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92baf8-0d0e-4ea9-94ab-5faac45496c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:18:32.581605 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92baf8-0d0e-4ea9-94ab-5faac45496c4 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:32.581889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92baf8-0d0e-4ea9-94ab-5faac45496c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:32.582161 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92baf8-0d0e-4ea9-94ab-5faac45496c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:32.591167 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92baf8-0d0e-4ea9-94ab-5faac45496c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:18:32.592892 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92baf8-0d0e-4ea9-94ab-5faac45496c4 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:18:32.603924 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1198/2447] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:18:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:18:33.894817 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4b9cf-8af6-4b32-b2b8-dc1143884e21 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:33.895894 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4b9cf-8af6-4b32-b2b8-dc1143884e21 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:33.896423 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4b9cf-8af6-4b32-b2b8-dc1143884e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:33.905623 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:33.921103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3ea4b9cf-8af6-4b32-b2b8-dc1143884e21 None None] MFA Rules not processed for user `fe042f088ffb4b7db88cafe05b11808c`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:33.922337 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3ea4b9cf-8af6-4b32-b2b8-dc1143884e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:33.936996 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1250/2448] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:18:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:18:42.598815 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=78,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:43.918446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:18:51.958275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b66348-d0b1-4a0f-ba5d-0db1e880c7ca None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:18:51.958814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b66348-d0b1-4a0f-ba5d-0db1e880c7ca None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:18:51.958814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b66348-d0b1-4a0f-ba5d-0db1e880c7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:18:51.976752 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e6b66348-d0b1-4a0f-ba5d-0db1e880c7ca None None] MFA Rules not processed for user `1e7d0f401530454ba0cae0f5e9d6e0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:18:51.978076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e6b66348-d0b1-4a0f-ba5d-0db1e880c7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:18:52.042983 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1199/2449] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:18:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:02.034142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=25 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:42.409961 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4b9cf-8af6-4b32-b2b8-dc1143884e21 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:42.411438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3ea4b9cf-8af6-4b32-b2b8-dc1143884e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:42.569644 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4b9cf-8af6-4b32-b2b8-dc1143884e21 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:42.575123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f80df-6091-4882-8270-a1c1f867112a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333db0711d0f41fe8066ba5b9d91dacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:42.575809 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f80df-6091-4882-8270-a1c1f867112a service placement] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:42.576088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f80df-6091-4882-8270-a1c1f867112a service placement] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:42.576347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f80df-6091-4882-8270-a1c1f867112a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:42.578110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cb2f80df-6091-4882-8270-a1c1f867112a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:42.591029 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f80df-6091-4882-8270-a1c1f867112a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:42.592827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f80df-6091-4882-8270-a1c1f867112a service placement] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:42.603369 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1251/2450] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:19:47.750268 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b66348-d0b1-4a0f-ba5d-0db1e880c7ca None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:47.764269 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b66348-d0b1-4a0f-ba5d-0db1e880c7ca None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:47.768998 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192cb96-7a6d-42a1-a6fa-da76f4d71334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:47.769636 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192cb96-7a6d-42a1-a6fa-da76f4d71334 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:47.769923 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192cb96-7a6d-42a1-a6fa-da76f4d71334 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:47.770203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8192cb96-7a6d-42a1-a6fa-da76f4d71334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:47.772130 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8192cb96-7a6d-42a1-a6fa-da76f4d71334 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:47.808649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192cb96-7a6d-42a1-a6fa-da76f4d71334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:47.810113 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8192cb96-7a6d-42a1-a6fa-da76f4d71334 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:47.829731 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1200/2451] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:50.967222 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f80df-6091-4882-8270-a1c1f867112a service placement] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:50.969040 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cb2f80df-6091-4882-8270-a1c1f867112a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:50.984584 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f80df-6091-4882-8270-a1c1f867112a service placement] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:50.990031 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97b8ea-7bad-4612-9fd7-34503c2bba89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:50.990907 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97b8ea-7bad-4612-9fd7-34503c2bba89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:50.991180 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97b8ea-7bad-4612-9fd7-34503c2bba89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:50.991467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97b8ea-7bad-4612-9fd7-34503c2bba89 admin admin] PATH_INFO: `/v3/users/601f4db65bf74587ab9b0080a44b4f79` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:50.992669 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97b8ea-7bad-4612-9fd7-34503c2bba89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=601f4db65bf74587ab9b0080a44b4f79)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:50.994624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97b8ea-7bad-4612-9fd7-34503c2bba89 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:51.040819 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5e97b8ea-7bad-4612-9fd7-34503c2bba89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '601f4db65bf74587ab9b0080a44b4f79'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:51.041491 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5e97b8ea-7bad-4612-9fd7-34503c2bba89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '601f4db65bf74587ab9b0080a44b4f79'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:51.050217 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5e97b8ea-7bad-4612-9fd7-34503c2bba89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '601f4db65bf74587ab9b0080a44b4f79'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:51.050896 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5e97b8ea-7bad-4612-9fd7-34503c2bba89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '601f4db65bf74587ab9b0080a44b4f79'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:51.059821 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5e97b8ea-7bad-4612-9fd7-34503c2bba89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '601f4db65bf74587ab9b0080a44b4f79'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:51.071334 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:51.081374 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1252/2452] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:50 2022] DELETE /identity/v3/users/601f4db65bf74587ab9b0080a44b4f79 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:51.262212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192cb96-7a6d-42a1-a6fa-da76f4d71334 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:51.274110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8192cb96-7a6d-42a1-a6fa-da76f4d71334 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:51.333579 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0973d-8273-4146-9296-c827a2a35325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:51.334489 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0973d-8273-4146-9296-c827a2a35325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:51.334772 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0973d-8273-4146-9296-c827a2a35325 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:51.335050 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0973d-8273-4146-9296-c827a2a35325 admin admin] PATH_INFO: `/v3/projects/cc1d39abfaef4e9c80564f545f431bbe` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:51.336355 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0973d-8273-4146-9296-c827a2a35325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1d39abfaef4e9c80564f545f431bbe)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:51.338337 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0973d-8273-4146-9296-c827a2a35325 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:51.385226 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cab0973d-8273-4146-9296-c827a2a35325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1d39abfaef4e9c80564f545f431bbe', 'request_id': 'req-cab0973d-8273-4146-9296-c827a2a35325'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:51.392325 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cab0973d-8273-4146-9296-c827a2a35325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1d39abfaef4e9c80564f545f431bbe', 'request_id': 'req-cab0973d-8273-4146-9296-c827a2a35325'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:51.398127 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cab0973d-8273-4146-9296-c827a2a35325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1d39abfaef4e9c80564f545f431bbe', 'request_id': 'req-cab0973d-8273-4146-9296-c827a2a35325'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:51.410077 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cab0973d-8273-4146-9296-c827a2a35325 admin admin] The token cache is being invalidate because project cc1d39abfaef4e9c80564f545f431bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:51.410370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cab0973d-8273-4146-9296-c827a2a35325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:51.411103 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cab0973d-8273-4146-9296-c827a2a35325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:51.413145 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1201/2453] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:51 2022] DELETE /identity/v3/projects/cc1d39abfaef4e9c80564f545f431bbe => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:51.418346 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226bdea-d15d-47a1-a11c-19afc945253b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:51.418684 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226bdea-d15d-47a1-a11c-19afc945253b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:51.418964 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226bdea-d15d-47a1-a11c-19afc945253b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:51.483874 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3226bdea-d15d-47a1-a11c-19afc945253b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:51.485617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3226bdea-d15d-47a1-a11c-19afc945253b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:51.548172 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1253/2454] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:19:51.556806 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e198d-aa7f-46e0-a8a7-8f6b1d6850ae None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:51.557098 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e198d-aa7f-46e0-a8a7-8f6b1d6850ae None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:51.557374 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311e198d-aa7f-46e0-a8a7-8f6b1d6850ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:51.577053 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-311e198d-aa7f-46e0-a8a7-8f6b1d6850ae None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:51.578232 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-311e198d-aa7f-46e0-a8a7-8f6b1d6850ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:51.586954 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1202/2455] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:51.591124 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226bdea-d15d-47a1-a11c-19afc945253b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:51.601435 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226bdea-d15d-47a1-a11c-19afc945253b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:51.607329 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7882fe0-a816-4f58-aed6-6e335d9412ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:51.607998 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7882fe0-a816-4f58-aed6-6e335d9412ed admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:51.608279 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7882fe0-a816-4f58-aed6-6e335d9412ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:51.608547 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7882fe0-a816-4f58-aed6-6e335d9412ed admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:51.609271 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7882fe0-a816-4f58-aed6-6e335d9412ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:19:51.609575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7882fe0-a816-4f58-aed6-6e335d9412ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:51.611253 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7882fe0-a816-4f58-aed6-6e335d9412ed admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:51.623331 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1254/2456] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:51.629579 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e198d-aa7f-46e0-a8a7-8f6b1d6850ae None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:51.643896 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311e198d-aa7f-46e0-a8a7-8f6b1d6850ae None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:51.651908 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786a688-32c4-41f4-9b7b-fef747d1f872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:51.652866 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786a688-32c4-41f4-9b7b-fef747d1f872 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:51.653161 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786a688-32c4-41f4-9b7b-fef747d1f872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:51.653457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0786a688-32c4-41f4-9b7b-fef747d1f872 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:51.654469 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786a688-32c4-41f4-9b7b-fef747d1f872 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:51.657460 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0786a688-32c4-41f4-9b7b-fef747d1f872 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:51.687270 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1203/2457] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:19:51 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:51.691594 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7882fe0-a816-4f58-aed6-6e335d9412ed admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:51.701934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7882fe0-a816-4f58-aed6-6e335d9412ed admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:51.760419 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fb725-231e-4bbb-88a1-e79746b74631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:51.761390 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fb725-231e-4bbb-88a1-e79746b74631 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:51.761730 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fb725-231e-4bbb-88a1-e79746b74631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:51.762098 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fb725-231e-4bbb-88a1-e79746b74631 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:51.763143 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fb725-231e-4bbb-88a1-e79746b74631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:51.766124 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156fb725-231e-4bbb-88a1-e79746b74631 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:51.792301 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1255/2458] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:51 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:51.797036 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786a688-32c4-41f4-9b7b-fef747d1f872 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:51.812417 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0786a688-32c4-41f4-9b7b-fef747d1f872 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:51.815779 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651ad1c-0782-46e2-9179-f3b1a55f1a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:51.816337 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651ad1c-0782-46e2-9179-f3b1a55f1a8b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:51.816623 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651ad1c-0782-46e2-9179-f3b1a55f1a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:51.816887 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a651ad1c-0782-46e2-9179-f3b1a55f1a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:51.817689 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651ad1c-0782-46e2-9179-f3b1a55f1a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:51.819241 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a651ad1c-0782-46e2-9179-f3b1a55f1a8b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:51.831177 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1204/2459] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:19:51.835506 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fb725-231e-4bbb-88a1-e79746b74631 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:51.846700 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fb725-231e-4bbb-88a1-e79746b74631 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:51.852096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efe71b-7422-4f14-bfe1-8f7f0491d145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:51.852768 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efe71b-7422-4f14-bfe1-8f7f0491d145 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:51.853061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efe71b-7422-4f14-bfe1-8f7f0491d145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:51.853339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efe71b-7422-4f14-bfe1-8f7f0491d145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:51.854076 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4efe71b-7422-4f14-bfe1-8f7f0491d145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:51.855842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4efe71b-7422-4f14-bfe1-8f7f0491d145 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:51.867733 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1256/2460] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:51.872307 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651ad1c-0782-46e2-9179-f3b1a55f1a8b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:51.878938 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:51.882872 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a651ad1c-0782-46e2-9179-f3b1a55f1a8b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:51.889019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da81ebd-8f57-4a1f-9691-8f3c37d9b38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:51.890484 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da81ebd-8f57-4a1f-9691-8f3c37d9b38c admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:51.890484 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da81ebd-8f57-4a1f-9691-8f3c37d9b38c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:51.891022 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da81ebd-8f57-4a1f-9691-8f3c37d9b38c admin admin] PATH_INFO: `/v3/projects/5c37396c2ac646b6ab5ba445b7ff760f/users/1e932b1f246c473d822d40019a303052/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:51.906342 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da81ebd-8f57-4a1f-9691-8f3c37d9b38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c37396c2ac646b6ab5ba445b7ff760f, user_id=1e932b1f246c473d822d40019a303052, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:51.909152 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da81ebd-8f57-4a1f-9691-8f3c37d9b38c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:51.924367 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1205/2461] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:51 2022] PUT /identity/v3/projects/5c37396c2ac646b6ab5ba445b7ff760f/users/1e932b1f246c473d822d40019a303052/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:19:51.929684 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781e5ee-3887-4747-883b-39eb3d4aa289 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:51.930024 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781e5ee-3887-4747-883b-39eb3d4aa289 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:51.930247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781e5ee-3887-4747-883b-39eb3d4aa289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:51.948944 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4781e5ee-3887-4747-883b-39eb3d4aa289 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:51.950170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4781e5ee-3887-4747-883b-39eb3d4aa289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:51.973852 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:52.010118 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1257/2462] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:52.020316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da81ebd-8f57-4a1f-9691-8f3c37d9b38c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:52.022140 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6da81ebd-8f57-4a1f-9691-8f3c37d9b38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:52.110564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da81ebd-8f57-4a1f-9691-8f3c37d9b38c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:52.114978 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a9853-ed22-4039-aacd-2c44d614c37f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:52.115655 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a9853-ed22-4039-aacd-2c44d614c37f service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:52.115936 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a9853-ed22-4039-aacd-2c44d614c37f service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:52.116207 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a9853-ed22-4039-aacd-2c44d614c37f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:52.131053 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a9853-ed22-4039-aacd-2c44d614c37f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:52.133334 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a9853-ed22-4039-aacd-2c44d614c37f service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:52.146794 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1206/2463] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:19:52.777406 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b8c5-dd9e-4a4c-a23c-9f61788cc443 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:52.777694 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b8c5-dd9e-4a4c-a23c-9f61788cc443 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:52.778001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b8c5-dd9e-4a4c-a23c-9f61788cc443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:52.807871 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a072b8c5-dd9e-4a4c-a23c-9f61788cc443 None None] MFA Rules not processed for user `1e932b1f246c473d822d40019a303052`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:52.809237 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a072b8c5-dd9e-4a4c-a23c-9f61788cc443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:52.878972 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1258/2464] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:19:52 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:52.883551 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a9853-ed22-4039-aacd-2c44d614c37f service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:52.893326 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a9853-ed22-4039-aacd-2c44d614c37f service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:52.897858 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b5045-44ad-4364-a5c5-6a7417376d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:52.898515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b5045-44ad-4364-a5c5-6a7417376d1c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:52.898800 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b5045-44ad-4364-a5c5-6a7417376d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:52.899080 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416b5045-44ad-4364-a5c5-6a7417376d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:52.899796 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b5045-44ad-4364-a5c5-6a7417376d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:52.901747 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416b5045-44ad-4364-a5c5-6a7417376d1c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:52.929764 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1207/2465] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:19:52 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:52.933724 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072b8c5-dd9e-4a4c-a23c-9f61788cc443 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:52.944867 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072b8c5-dd9e-4a4c-a23c-9f61788cc443 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:53.001767 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53584a8c-e2ad-4efd-a6ec-5403f6cef230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:53.002429 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53584a8c-e2ad-4efd-a6ec-5403f6cef230 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:53.002703 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53584a8c-e2ad-4efd-a6ec-5403f6cef230 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:53.002979 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53584a8c-e2ad-4efd-a6ec-5403f6cef230 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:53.003700 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53584a8c-e2ad-4efd-a6ec-5403f6cef230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:53.005652 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53584a8c-e2ad-4efd-a6ec-5403f6cef230 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:53.026430 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1259/2466] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:52 2022] POST /identity/v3/users => generated 308 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:19:53.030624 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b5045-44ad-4364-a5c5-6a7417376d1c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:53.041484 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416b5045-44ad-4364-a5c5-6a7417376d1c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:53.047373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658336e2-d286-46c1-8239-2aba0783f1cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:53.048037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658336e2-d286-46c1-8239-2aba0783f1cd admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:53.048369 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658336e2-d286-46c1-8239-2aba0783f1cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:53.048649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658336e2-d286-46c1-8239-2aba0783f1cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:53.049381 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658336e2-d286-46c1-8239-2aba0783f1cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:53.051003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658336e2-d286-46c1-8239-2aba0783f1cd admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:53.061257 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1208/2467] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:53.065476 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53584a8c-e2ad-4efd-a6ec-5403f6cef230 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:53.075972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53584a8c-e2ad-4efd-a6ec-5403f6cef230 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:53.081832 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bc1d5-370a-463b-83ff-6e09f405ba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:53.082729 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bc1d5-370a-463b-83ff-6e09f405ba73 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:53.083015 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bc1d5-370a-463b-83ff-6e09f405ba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:53.083326 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bc1d5-370a-463b-83ff-6e09f405ba73 admin admin] PATH_INFO: `/v3/projects/7cb9538fcca1485492a26379a050dc7e/users/52ef3b9e52d54867be2e3eeaf2993e4e/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:53.098875 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bc1d5-370a-463b-83ff-6e09f405ba73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb9538fcca1485492a26379a050dc7e, user_id=52ef3b9e52d54867be2e3eeaf2993e4e, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:53.101617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bc1d5-370a-463b-83ff-6e09f405ba73 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:53.116951 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1260/2468] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:53 2022] PUT /identity/v3/projects/7cb9538fcca1485492a26379a050dc7e/users/52ef3b9e52d54867be2e3eeaf2993e4e/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:53.120983 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658336e2-d286-46c1-8239-2aba0783f1cd admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:53.131552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658336e2-d286-46c1-8239-2aba0783f1cd admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:53.197974 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3e924e-92e6-4f52-985e-a5fa2a61cff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:53.198635 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e924e-92e6-4f52-985e-a5fa2a61cff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:53.198914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e924e-92e6-4f52-985e-a5fa2a61cff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:53.199192 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3e924e-92e6-4f52-985e-a5fa2a61cff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:53.199940 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e924e-92e6-4f52-985e-a5fa2a61cff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:53.201558 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3e924e-92e6-4f52-985e-a5fa2a61cff1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:53.211461 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1209/2469] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:53 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:53.215856 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bc1d5-370a-463b-83ff-6e09f405ba73 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:53.226895 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bc1d5-370a-463b-83ff-6e09f405ba73 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:53.232632 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e430090-c870-469b-bb5c-b1990b6ba9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:53.233538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e430090-c870-469b-bb5c-b1990b6ba9e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:53.233853 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e430090-c870-469b-bb5c-b1990b6ba9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:53.234131 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e430090-c870-469b-bb5c-b1990b6ba9e8 admin admin] PATH_INFO: `/v3/projects/7cb9538fcca1485492a26379a050dc7e/users/52ef3b9e52d54867be2e3eeaf2993e4e/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:53.236502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e430090-c870-469b-bb5c-b1990b6ba9e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cb9538fcca1485492a26379a050dc7e, user_id=52ef3b9e52d54867be2e3eeaf2993e4e, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:53.239194 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e430090-c870-469b-bb5c-b1990b6ba9e8 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:53.250392 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1261/2470] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:53 2022] PUT /identity/v3/projects/7cb9538fcca1485492a26379a050dc7e/users/52ef3b9e52d54867be2e3eeaf2993e4e/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:53.898543 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3efb6-3da3-42d9-b9f9-efa638b95f08 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:53.899044 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3efb6-3da3-42d9-b9f9-efa638b95f08 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:53.899243 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a3efb6-3da3-42d9-b9f9-efa638b95f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:53.928390 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e6a3efb6-3da3-42d9-b9f9-efa638b95f08 None None] MFA Rules not processed for user `52ef3b9e52d54867be2e3eeaf2993e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:53.929623 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e6a3efb6-3da3-42d9-b9f9-efa638b95f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:53.946643 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:54.006759 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1210/2471] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:19:53 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:55.047969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e430090-c870-469b-bb5c-b1990b6ba9e8 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:55.062520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:55.117714 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e430090-c870-469b-bb5c-b1990b6ba9e8 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:55.122234 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e07ba-abb7-4c93-bcf3-2548c8c55a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:55.123133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e07ba-abb7-4c93-bcf3-2548c8c55a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:55.123450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e07ba-abb7-4c93-bcf3-2548c8c55a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:55.123728 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9e07ba-abb7-4c93-bcf3-2548c8c55a8b admin admin] PATH_INFO: `/v3/users/1e932b1f246c473d822d40019a303052` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:55.124927 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e07ba-abb7-4c93-bcf3-2548c8c55a8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e932b1f246c473d822d40019a303052)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:55.126911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9e07ba-abb7-4c93-bcf3-2548c8c55a8b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:55.174058 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff9e07ba-abb7-4c93-bcf3-2548c8c55a8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e932b1f246c473d822d40019a303052'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:55.174706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff9e07ba-abb7-4c93-bcf3-2548c8c55a8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e932b1f246c473d822d40019a303052'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:55.182880 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff9e07ba-abb7-4c93-bcf3-2548c8c55a8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e932b1f246c473d822d40019a303052'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:55.183586 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff9e07ba-abb7-4c93-bcf3-2548c8c55a8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e932b1f246c473d822d40019a303052'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:55.190511 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ff9e07ba-abb7-4c93-bcf3-2548c8c55a8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e932b1f246c473d822d40019a303052'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:55.208265 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1262/2472] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:55 2022] DELETE /identity/v3/users/1e932b1f246c473d822d40019a303052 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:55.389328 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3efb6-3da3-42d9-b9f9-efa638b95f08 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:55.400223 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a3efb6-3da3-42d9-b9f9-efa638b95f08 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:55.458467 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba2e0e-36eb-4108-b751-3cb7f1e24931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:55.459376 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba2e0e-36eb-4108-b751-3cb7f1e24931 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:55.459659 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba2e0e-36eb-4108-b751-3cb7f1e24931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:55.459931 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba2e0e-36eb-4108-b751-3cb7f1e24931 admin admin] PATH_INFO: `/v3/projects/5c37396c2ac646b6ab5ba445b7ff760f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:55.461179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba2e0e-36eb-4108-b751-3cb7f1e24931 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c37396c2ac646b6ab5ba445b7ff760f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:55.463088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ba2e0e-36eb-4108-b751-3cb7f1e24931 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:55.512909 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-11ba2e0e-36eb-4108-b751-3cb7f1e24931 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c37396c2ac646b6ab5ba445b7ff760f', 'request_id': 'req-11ba2e0e-36eb-4108-b751-3cb7f1e24931'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:55.522453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-11ba2e0e-36eb-4108-b751-3cb7f1e24931 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c37396c2ac646b6ab5ba445b7ff760f', 'request_id': 'req-11ba2e0e-36eb-4108-b751-3cb7f1e24931'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:55.531692 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-11ba2e0e-36eb-4108-b751-3cb7f1e24931 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c37396c2ac646b6ab5ba445b7ff760f', 'request_id': 'req-11ba2e0e-36eb-4108-b751-3cb7f1e24931'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:55.543668 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-11ba2e0e-36eb-4108-b751-3cb7f1e24931 admin admin] The token cache is being invalidate because project 5c37396c2ac646b6ab5ba445b7ff760f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:55.543955 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-11ba2e0e-36eb-4108-b751-3cb7f1e24931 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:55.544652 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-11ba2e0e-36eb-4108-b751-3cb7f1e24931 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:55.546223 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1211/2473] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:55 2022] DELETE /identity/v3/projects/5c37396c2ac646b6ab5ba445b7ff760f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:55.550739 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e07ba-abb7-4c93-bcf3-2548c8c55a8b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:55.552251 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ff9e07ba-abb7-4c93-bcf3-2548c8c55a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:55.565468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9e07ba-abb7-4c93-bcf3-2548c8c55a8b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:55.633495 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0e6c33-92e4-4d1f-bc08-8f207d7bfaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:55.634320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e6c33-92e4-4d1f-bc08-8f207d7bfaad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:55.634602 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e6c33-92e4-4d1f-bc08-8f207d7bfaad admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:55.634876 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0e6c33-92e4-4d1f-bc08-8f207d7bfaad admin admin] PATH_INFO: `/v3/users/52ef3b9e52d54867be2e3eeaf2993e4e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:55.636147 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e6c33-92e4-4d1f-bc08-8f207d7bfaad admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ef3b9e52d54867be2e3eeaf2993e4e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:55.638115 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0e6c33-92e4-4d1f-bc08-8f207d7bfaad admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:55.674143 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:55.689317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3a0e6c33-92e4-4d1f-bc08-8f207d7bfaad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ef3b9e52d54867be2e3eeaf2993e4e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:55.689952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3a0e6c33-92e4-4d1f-bc08-8f207d7bfaad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ef3b9e52d54867be2e3eeaf2993e4e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:55.698241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3a0e6c33-92e4-4d1f-bc08-8f207d7bfaad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ef3b9e52d54867be2e3eeaf2993e4e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:55.698838 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3a0e6c33-92e4-4d1f-bc08-8f207d7bfaad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ef3b9e52d54867be2e3eeaf2993e4e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:55.705675 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3a0e6c33-92e4-4d1f-bc08-8f207d7bfaad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ef3b9e52d54867be2e3eeaf2993e4e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:55.722524 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1263/2474] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:19:55 2022] DELETE /identity/v3/users/52ef3b9e52d54867be2e3eeaf2993e4e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:19:55.896012 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba2e0e-36eb-4108-b751-3cb7f1e24931 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:55.897527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-11ba2e0e-36eb-4108-b751-3cb7f1e24931 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:55.912509 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba2e0e-36eb-4108-b751-3cb7f1e24931 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:55.957515 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:55.977921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800d194-0265-49d3-ae63-258e8884b03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:55.978843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800d194-0265-49d3-ae63-258e8884b03a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:55.979126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800d194-0265-49d3-ae63-258e8884b03a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:55.979433 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800d194-0265-49d3-ae63-258e8884b03a admin admin] PATH_INFO: `/v3/projects/7cb9538fcca1485492a26379a050dc7e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:55.980639 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800d194-0265-49d3-ae63-258e8884b03a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cb9538fcca1485492a26379a050dc7e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:55.982576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800d194-0265-49d3-ae63-258e8884b03a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:56.029932 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1800d194-0265-49d3-ae63-258e8884b03a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cb9538fcca1485492a26379a050dc7e', 'request_id': 'req-1800d194-0265-49d3-ae63-258e8884b03a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:56.038617 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1800d194-0265-49d3-ae63-258e8884b03a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cb9538fcca1485492a26379a050dc7e', 'request_id': 'req-1800d194-0265-49d3-ae63-258e8884b03a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:56.044062 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1800d194-0265-49d3-ae63-258e8884b03a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cb9538fcca1485492a26379a050dc7e', 'request_id': 'req-1800d194-0265-49d3-ae63-258e8884b03a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:56.056070 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1800d194-0265-49d3-ae63-258e8884b03a admin admin] The token cache is being invalidate because project 7cb9538fcca1485492a26379a050dc7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:19:56.056359 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1800d194-0265-49d3-ae63-258e8884b03a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:56.057116 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1800d194-0265-49d3-ae63-258e8884b03a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:19:56.058796 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1212/2475] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:19:55 2022] DELETE /identity/v3/projects/7cb9538fcca1485492a26379a050dc7e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:56.064376 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ada354-7926-4132-83ce-d6fb1a5eeb8b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:56.064892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ada354-7926-4132-83ce-d6fb1a5eeb8b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:56.064892 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ada354-7926-4132-83ce-d6fb1a5eeb8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:56.084420 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-06ada354-7926-4132-83ce-d6fb1a5eeb8b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:56.085659 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-06ada354-7926-4132-83ce-d6fb1a5eeb8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:56.145917 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1264/2476] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:56.155212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91c494-bce1-4e68-873e-14960ed9e463 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:56.155533 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91c494-bce1-4e68-873e-14960ed9e463 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:56.155844 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d91c494-bce1-4e68-873e-14960ed9e463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:56.175776 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-9d91c494-bce1-4e68-873e-14960ed9e463 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:56.176971 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9d91c494-bce1-4e68-873e-14960ed9e463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:56.185611 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1213/2477] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:56.189945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ada354-7926-4132-83ce-d6fb1a5eeb8b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:56.199724 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ada354-7926-4132-83ce-d6fb1a5eeb8b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:56.204869 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2479ea4-8abb-4f19-a998-a453238b138d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:56.205520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2479ea4-8abb-4f19-a998-a453238b138d admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:56.205801 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2479ea4-8abb-4f19-a998-a453238b138d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:56.206078 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2479ea4-8abb-4f19-a998-a453238b138d admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:56.206802 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2479ea4-8abb-4f19-a998-a453238b138d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:19:56.207109 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2479ea4-8abb-4f19-a998-a453238b138d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:56.208762 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2479ea4-8abb-4f19-a998-a453238b138d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:56.220084 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1265/2478] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:19:56.224344 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91c494-bce1-4e68-873e-14960ed9e463 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:56.234564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d91c494-bce1-4e68-873e-14960ed9e463 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:56.241076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25b366-9b3a-482d-a4bf-e007a5e251d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:56.241723 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25b366-9b3a-482d-a4bf-e007a5e251d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:56.241993 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25b366-9b3a-482d-a4bf-e007a5e251d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:56.242284 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25b366-9b3a-482d-a4bf-e007a5e251d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:56.242971 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25b366-9b3a-482d-a4bf-e007a5e251d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:56.244925 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25b366-9b3a-482d-a4bf-e007a5e251d9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:56.274881 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1214/2479] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:19:56 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:56.279183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2479ea4-8abb-4f19-a998-a453238b138d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:56.289331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2479ea4-8abb-4f19-a998-a453238b138d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:56.348814 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2705f-8311-4b95-a2fb-8bac3140d9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:56.349478 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2705f-8311-4b95-a2fb-8bac3140d9ac admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:56.349776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2705f-8311-4b95-a2fb-8bac3140d9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:56.350049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2705f-8311-4b95-a2fb-8bac3140d9ac admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:56.350731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2705f-8311-4b95-a2fb-8bac3140d9ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:56.352685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2705f-8311-4b95-a2fb-8bac3140d9ac admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:56.379440 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25b366-9b3a-482d-a4bf-e007a5e251d9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:56.380829 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1266/2480] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:56 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:19:56.392286 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25b366-9b3a-482d-a4bf-e007a5e251d9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:56.397875 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba5ec1-e9dd-42f5-82a7-2931591288a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:56.398525 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba5ec1-e9dd-42f5-82a7-2931591288a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:56.398781 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba5ec1-e9dd-42f5-82a7-2931591288a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:56.399051 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ba5ec1-e9dd-42f5-82a7-2931591288a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:56.399820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba5ec1-e9dd-42f5-82a7-2931591288a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:56.401985 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ba5ec1-e9dd-42f5-82a7-2931591288a7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:56.412957 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1215/2481] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:19:56.417245 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2705f-8311-4b95-a2fb-8bac3140d9ac admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:56.427888 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2705f-8311-4b95-a2fb-8bac3140d9ac admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:56.433954 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9490e-7372-4209-9d49-f9280de0cabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:56.434853 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9490e-7372-4209-9d49-f9280de0cabb admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:56.435243 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9490e-7372-4209-9d49-f9280de0cabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:56.435678 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9490e-7372-4209-9d49-f9280de0cabb admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:56.436872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9490e-7372-4209-9d49-f9280de0cabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:56.439482 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9490e-7372-4209-9d49-f9280de0cabb admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:56.449609 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1267/2482] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:56.453718 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba5ec1-e9dd-42f5-82a7-2931591288a7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:56.463825 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ba5ec1-e9dd-42f5-82a7-2931591288a7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:56.468545 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6a939-4ea2-45b7-927f-4985c5a023dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:56.469425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6a939-4ea2-45b7-927f-4985c5a023dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:56.469704 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6a939-4ea2-45b7-927f-4985c5a023dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:56.469980 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6a939-4ea2-45b7-927f-4985c5a023dc admin admin] PATH_INFO: `/v3/projects/ed82acdc43154100903698868c7a948f/users/316ba3a31048450d9eb158e5cfd60388/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:56.484811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6a939-4ea2-45b7-927f-4985c5a023dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed82acdc43154100903698868c7a948f, user_id=316ba3a31048450d9eb158e5cfd60388, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:56.487694 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae6a939-4ea2-45b7-927f-4985c5a023dc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:56.503887 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1216/2483] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:56 2022] PUT /identity/v3/projects/ed82acdc43154100903698868c7a948f/users/316ba3a31048450d9eb158e5cfd60388/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:56.514882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21d92-38e9-44ba-ae76-51c62a555dc4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:56.515185 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21d92-38e9-44ba-ae76-51c62a555dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:56.515505 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af21d92-38e9-44ba-ae76-51c62a555dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:56.545848 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9af21d92-38e9-44ba-ae76-51c62a555dc4 None None] MFA Rules not processed for user `316ba3a31048450d9eb158e5cfd60388`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:56.547479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9af21d92-38e9-44ba-ae76-51c62a555dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:56.551932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:56.614312 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1268/2484] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:19:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:56.618836 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6a939-4ea2-45b7-927f-4985c5a023dc admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:56.681357 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae6a939-4ea2-45b7-927f-4985c5a023dc admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:56.686132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae183c2-7202-4437-b359-91d5d5330f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:56.686812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae183c2-7202-4437-b359-91d5d5330f7b admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:56.687104 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae183c2-7202-4437-b359-91d5d5330f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:56.687535 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae183c2-7202-4437-b359-91d5d5330f7b admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:56.688265 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae183c2-7202-4437-b359-91d5d5330f7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:56.690258 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae183c2-7202-4437-b359-91d5d5330f7b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:56.705392 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:56.721974 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1217/2485] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:19:56 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:19:56.727796 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af21d92-38e9-44ba-ae76-51c62a555dc4 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:56.740654 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af21d92-38e9-44ba-ae76-51c62a555dc4 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:56.806579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1cea9-7047-4826-a6d6-815be298e111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:56.807261 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1cea9-7047-4826-a6d6-815be298e111 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:56.807578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1cea9-7047-4826-a6d6-815be298e111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:56.808009 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1cea9-7047-4826-a6d6-815be298e111 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:56.808560 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1cea9-7047-4826-a6d6-815be298e111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:56.810669 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1cea9-7047-4826-a6d6-815be298e111 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:56.832167 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1269/2486] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:19:56 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:19:56.836303 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae183c2-7202-4437-b359-91d5d5330f7b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:56.846969 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae183c2-7202-4437-b359-91d5d5330f7b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:56.852350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3c137-4e40-49f1-87ea-9085e0ab8745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:56.853054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3c137-4e40-49f1-87ea-9085e0ab8745 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:56.853340 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3c137-4e40-49f1-87ea-9085e0ab8745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:56.853617 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f3c137-4e40-49f1-87ea-9085e0ab8745 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:56.854382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3c137-4e40-49f1-87ea-9085e0ab8745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:56.856068 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f3c137-4e40-49f1-87ea-9085e0ab8745 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:56.867713 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1218/2487] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:56.871907 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1cea9-7047-4826-a6d6-815be298e111 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:56.882174 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1cea9-7047-4826-a6d6-815be298e111 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:56.886816 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad29ab-9907-4fdc-9cf2-f3676854e0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:56.887743 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad29ab-9907-4fdc-9cf2-f3676854e0ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:56.888032 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad29ab-9907-4fdc-9cf2-f3676854e0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:56.888315 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad29ab-9907-4fdc-9cf2-f3676854e0ca admin admin] PATH_INFO: `/v3/projects/3bf278f588b8416aa1a37ab724bef728/users/b2dc27c6ab2441fdab1158f42538b94e/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:56.904153 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad29ab-9907-4fdc-9cf2-f3676854e0ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf278f588b8416aa1a37ab724bef728, user_id=b2dc27c6ab2441fdab1158f42538b94e, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:56.906838 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad29ab-9907-4fdc-9cf2-f3676854e0ca admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:56.925054 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1270/2488] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:56 2022] PUT /identity/v3/projects/3bf278f588b8416aa1a37ab724bef728/users/b2dc27c6ab2441fdab1158f42538b94e/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:19:56.929839 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3c137-4e40-49f1-87ea-9085e0ab8745 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:56.941343 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f3c137-4e40-49f1-87ea-9085e0ab8745 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:57.002157 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a0393-3dca-4e55-9cc6-7bcc0f3af169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:57.002832 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a0393-3dca-4e55-9cc6-7bcc0f3af169 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:57.003117 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a0393-3dca-4e55-9cc6-7bcc0f3af169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:57.003435 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a0393-3dca-4e55-9cc6-7bcc0f3af169 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:57.004167 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a0393-3dca-4e55-9cc6-7bcc0f3af169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:57.005812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a0393-3dca-4e55-9cc6-7bcc0f3af169 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:57.016382 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1219/2489] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:19:57.020814 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad29ab-9907-4fdc-9cf2-f3676854e0ca admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:57.032042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad29ab-9907-4fdc-9cf2-f3676854e0ca admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:57.038281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d5a41-9432-4169-98f7-7eff8f58f96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:57.039182 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5a41-9432-4169-98f7-7eff8f58f96a admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:57.039503 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5a41-9432-4169-98f7-7eff8f58f96a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:57.039786 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d5a41-9432-4169-98f7-7eff8f58f96a admin admin] PATH_INFO: `/v3/projects/3bf278f588b8416aa1a37ab724bef728/users/b2dc27c6ab2441fdab1158f42538b94e/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:57.042083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d5a41-9432-4169-98f7-7eff8f58f96a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bf278f588b8416aa1a37ab724bef728, user_id=b2dc27c6ab2441fdab1158f42538b94e, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:57.045073 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d5a41-9432-4169-98f7-7eff8f58f96a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:57.059967 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1271/2490] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:19:57 2022] PUT /identity/v3/projects/3bf278f588b8416aa1a37ab724bef728/users/b2dc27c6ab2441fdab1158f42538b94e/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:19:57.071874 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79cf13-608d-449a-b998-106387474fa8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:57.072166 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79cf13-608d-449a-b998-106387474fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:57.072439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae79cf13-608d-449a-b998-106387474fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:57.101623 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ae79cf13-608d-449a-b998-106387474fa8 None None] MFA Rules not processed for user `b2dc27c6ab2441fdab1158f42538b94e`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:19:57.102840 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ae79cf13-608d-449a-b998-106387474fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:57.176494 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1220/2491] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:19:57 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:19:57.188227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d5a41-9432-4169-98f7-7eff8f58f96a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:57.190168 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-844d5a41-9432-4169-98f7-7eff8f58f96a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:19:57.259903 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:19:57.277007 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d5a41-9432-4169-98f7-7eff8f58f96a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:57.281085 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b63a72-e2a6-49af-869f-086608dc1f1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:57.281731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b63a72-e2a6-49af-869f-086608dc1f1c service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:57.282012 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b63a72-e2a6-49af-869f-086608dc1f1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:57.282290 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b63a72-e2a6-49af-869f-086608dc1f1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:57.292154 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b63a72-e2a6-49af-869f-086608dc1f1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:57.293603 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b63a72-e2a6-49af-869f-086608dc1f1c service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:57.303751 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1272/2492] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:57 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:19:57.383045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79cf13-608d-449a-b998-106387474fa8 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:19:57.395956 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae79cf13-608d-449a-b998-106387474fa8 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:19:57.399861 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902e1de-aed3-4d92-b001-ce3adf3587e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:19:57.400521 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902e1de-aed3-4d92-b001-ce3adf3587e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:19:57.400806 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902e1de-aed3-4d92-b001-ce3adf3587e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:19:57.401079 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902e1de-aed3-4d92-b001-ce3adf3587e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:19:57.461619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902e1de-aed3-4d92-b001-ce3adf3587e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:19:57.463077 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902e1de-aed3-4d92-b001-ce3adf3587e9 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:19:57.472289 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1221/2493] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:19:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:07.299695 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=9 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:07.468240 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:INSERT=1,keystone:SELECT=98 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:26.775893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b63a72-e2a6-49af-869f-086608dc1f1c service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:26.844905 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b63a72-e2a6-49af-869f-086608dc1f1c service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:26.849451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91f3ad-3a7b-4e4c-9753-f83a403706e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:26.850625 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91f3ad-3a7b-4e4c-9753-f83a403706e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:26.850914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91f3ad-3a7b-4e4c-9753-f83a403706e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:26.851196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad91f3ad-3a7b-4e4c-9753-f83a403706e7 admin admin] PATH_INFO: `/v3/users/316ba3a31048450d9eb158e5cfd60388` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:26.852432 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91f3ad-3a7b-4e4c-9753-f83a403706e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=316ba3a31048450d9eb158e5cfd60388)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:26.854385 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad91f3ad-3a7b-4e4c-9753-f83a403706e7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:26.901701 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ad91f3ad-3a7b-4e4c-9753-f83a403706e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '316ba3a31048450d9eb158e5cfd60388'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:26.902717 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ad91f3ad-3a7b-4e4c-9753-f83a403706e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '316ba3a31048450d9eb158e5cfd60388'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:26.915195 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ad91f3ad-3a7b-4e4c-9753-f83a403706e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '316ba3a31048450d9eb158e5cfd60388'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:26.915828 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ad91f3ad-3a7b-4e4c-9753-f83a403706e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '316ba3a31048450d9eb158e5cfd60388'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:26.923909 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ad91f3ad-3a7b-4e4c-9753-f83a403706e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '316ba3a31048450d9eb158e5cfd60388'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:26.940918 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1273/2494] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:26 2022] DELETE /identity/v3/users/316ba3a31048450d9eb158e5cfd60388 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:26.945712 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bb72e-05dc-4926-bf23-2abff2621084 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:26.946213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bb72e-05dc-4926-bf23-2abff2621084 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:26.946321 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649bb72e-05dc-4926-bf23-2abff2621084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:26.963708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-649bb72e-05dc-4926-bf23-2abff2621084 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:26.964887 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-649bb72e-05dc-4926-bf23-2abff2621084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:27.023131 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1222/2495] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:27.032921 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91f3ad-3a7b-4e4c-9753-f83a403706e7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.034584 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ad91f3ad-3a7b-4e4c-9753-f83a403706e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:27.095555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad91f3ad-3a7b-4e4c-9753-f83a403706e7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:27.099575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f783d-cf93-42e5-ab18-37efc82f6bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:27.100272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f783d-cf93-42e5-ab18-37efc82f6bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.100563 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f783d-cf93-42e5-ab18-37efc82f6bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.100835 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f783d-cf93-42e5-ab18-37efc82f6bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.110951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f783d-cf93-42e5-ab18-37efc82f6bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:27.112432 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f783d-cf93-42e5-ab18-37efc82f6bc9 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:27.122345 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1274/2496] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:27.427313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bb72e-05dc-4926-bf23-2abff2621084 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.429361 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-649bb72e-05dc-4926-bf23-2abff2621084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:27.442405 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649bb72e-05dc-4926-bf23-2abff2621084 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:27.449403 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:27.450541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.450982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.451260 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a admin admin] PATH_INFO: `/v3/projects/ed82acdc43154100903698868c7a948f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.452619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed82acdc43154100903698868c7a948f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:27.455256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:27.505289 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed82acdc43154100903698868c7a948f', 'request_id': 'req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:27.514254 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed82acdc43154100903698868c7a948f', 'request_id': 'req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:27.520145 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed82acdc43154100903698868c7a948f', 'request_id': 'req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:27.531540 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a admin admin] The token cache is being invalidate because project ed82acdc43154100903698868c7a948f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:27.531833 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:27.532535 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:27.534115 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1223/2497] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:27 2022] DELETE /identity/v3/projects/ed82acdc43154100903698868c7a948f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:27.538332 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f783d-cf93-42e5-ab18-37efc82f6bc9 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.548570 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f783d-cf93-42e5-ab18-37efc82f6bc9 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:27.566872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:27.608211 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a5a2c-b462-4e64-a367-1cb968330684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:27.609101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a5a2c-b462-4e64-a367-1cb968330684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:27.609385 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a5a2c-b462-4e64-a367-1cb968330684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:27.609660 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a5a2c-b462-4e64-a367-1cb968330684 admin admin] PATH_INFO: `/v3/users/b2dc27c6ab2441fdab1158f42538b94e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:27.610994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a5a2c-b462-4e64-a367-1cb968330684 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2dc27c6ab2441fdab1158f42538b94e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:27.612997 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a5a2c-b462-4e64-a367-1cb968330684 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:27.662671 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-071a5a2c-b462-4e64-a367-1cb968330684 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2dc27c6ab2441fdab1158f42538b94e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:27.663320 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-071a5a2c-b462-4e64-a367-1cb968330684 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2dc27c6ab2441fdab1158f42538b94e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:27.673160 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-071a5a2c-b462-4e64-a367-1cb968330684 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2dc27c6ab2441fdab1158f42538b94e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:27.673972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-071a5a2c-b462-4e64-a367-1cb968330684 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2dc27c6ab2441fdab1158f42538b94e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:27.682640 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-071a5a2c-b462-4e64-a367-1cb968330684 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2dc27c6ab2441fdab1158f42538b94e'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:27.699924 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1275/2498] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:27 2022] DELETE /identity/v3/users/b2dc27c6ab2441fdab1158f42538b94e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:27.971163 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:27.973278 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:27.986754 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4683c-c81f-4cb4-9f55-35cef856cb9a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:28.055557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7af761-c22d-4e05-ad4f-5c35eedf5f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:28.056507 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7af761-c22d-4e05-ad4f-5c35eedf5f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.056742 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7af761-c22d-4e05-ad4f-5c35eedf5f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.057006 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7af761-c22d-4e05-ad4f-5c35eedf5f45 admin admin] PATH_INFO: `/v3/projects/3bf278f588b8416aa1a37ab724bef728` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.058505 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7af761-c22d-4e05-ad4f-5c35eedf5f45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bf278f588b8416aa1a37ab724bef728)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:28.060483 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7af761-c22d-4e05-ad4f-5c35eedf5f45 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:28.095386 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:28.113539 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ad7af761-c22d-4e05-ad4f-5c35eedf5f45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bf278f588b8416aa1a37ab724bef728', 'request_id': 'req-ad7af761-c22d-4e05-ad4f-5c35eedf5f45'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:28.121419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ad7af761-c22d-4e05-ad4f-5c35eedf5f45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bf278f588b8416aa1a37ab724bef728', 'request_id': 'req-ad7af761-c22d-4e05-ad4f-5c35eedf5f45'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:28.127060 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ad7af761-c22d-4e05-ad4f-5c35eedf5f45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bf278f588b8416aa1a37ab724bef728', 'request_id': 'req-ad7af761-c22d-4e05-ad4f-5c35eedf5f45'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:28.138234 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ad7af761-c22d-4e05-ad4f-5c35eedf5f45 admin admin] The token cache is being invalidate because project 3bf278f588b8416aa1a37ab724bef728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:28.138549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ad7af761-c22d-4e05-ad4f-5c35eedf5f45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:28.139181 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ad7af761-c22d-4e05-ad4f-5c35eedf5f45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:28.140776 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1224/2499] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:27 2022] DELETE /identity/v3/projects/3bf278f588b8416aa1a37ab724bef728 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:28.145839 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad678cca-8ba4-42e4-92ef-076b7cce2bee None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.146368 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad678cca-8ba4-42e4-92ef-076b7cce2bee None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.146551 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad678cca-8ba4-42e4-92ef-076b7cce2bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.168567 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ad678cca-8ba4-42e4-92ef-076b7cce2bee None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:28.169834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ad678cca-8ba4-42e4-92ef-076b7cce2bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:28.231188 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1276/2500] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:28.239124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3471fdb-b7cb-449f-a508-09f72fcac0ee None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.239511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3471fdb-b7cb-449f-a508-09f72fcac0ee None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.239862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3471fdb-b7cb-449f-a508-09f72fcac0ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.266194 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d3471fdb-b7cb-449f-a508-09f72fcac0ee None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:28.267497 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d3471fdb-b7cb-449f-a508-09f72fcac0ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:28.275654 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1225/2501] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:28.280112 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad678cca-8ba4-42e4-92ef-076b7cce2bee None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:28.289723 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad678cca-8ba4-42e4-92ef-076b7cce2bee None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:28.294464 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c505d93-2026-447e-85da-545c9774ca84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:28.295096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c505d93-2026-447e-85da-545c9774ca84 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.295456 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c505d93-2026-447e-85da-545c9774ca84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.295738 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c505d93-2026-447e-85da-545c9774ca84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.296954 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c505d93-2026-447e-85da-545c9774ca84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:28.297236 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c505d93-2026-447e-85da-545c9774ca84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:28.298919 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c505d93-2026-447e-85da-545c9774ca84 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:28.310429 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1277/2502] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:20:28.314864 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3471fdb-b7cb-449f-a508-09f72fcac0ee None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:28.325230 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3471fdb-b7cb-449f-a508-09f72fcac0ee None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:28.330296 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf63e0-d48d-4533-8b9b-ea9c3bb457a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:28.330990 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf63e0-d48d-4533-8b9b-ea9c3bb457a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.331277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf63e0-d48d-4533-8b9b-ea9c3bb457a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.331586 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdf63e0-d48d-4533-8b9b-ea9c3bb457a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.332266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf63e0-d48d-4533-8b9b-ea9c3bb457a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:28.334241 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdf63e0-d48d-4533-8b9b-ea9c3bb457a7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:28.360260 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1226/2503] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:28 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:28.364753 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c505d93-2026-447e-85da-545c9774ca84 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:28.375019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c505d93-2026-447e-85da-545c9774ca84 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:28.401213 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:28.435805 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94844634-f695-4216-9179-c989a394b9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:28.436549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94844634-f695-4216-9179-c989a394b9ad admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.436841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94844634-f695-4216-9179-c989a394b9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.437119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94844634-f695-4216-9179-c989a394b9ad admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.437834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94844634-f695-4216-9179-c989a394b9ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:28.439813 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94844634-f695-4216-9179-c989a394b9ad admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:28.461482 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1278/2504] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:28 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:20:28.465810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf63e0-d48d-4533-8b9b-ea9c3bb457a7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:28.476523 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdf63e0-d48d-4533-8b9b-ea9c3bb457a7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:28.481327 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b0bac-8335-427e-89a8-e81eed6cde1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:28.482002 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b0bac-8335-427e-89a8-e81eed6cde1c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.482286 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b0bac-8335-427e-89a8-e81eed6cde1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.482562 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b0bac-8335-427e-89a8-e81eed6cde1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.483288 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b0bac-8335-427e-89a8-e81eed6cde1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:28.485060 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b0bac-8335-427e-89a8-e81eed6cde1c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:28.499245 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1227/2505] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:28.500567 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94844634-f695-4216-9179-c989a394b9ad admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:28.511125 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94844634-f695-4216-9179-c989a394b9ad admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:28.516522 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6856746-9ab6-4535-b95b-84cb47889946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:28.517194 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6856746-9ab6-4535-b95b-84cb47889946 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.517475 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6856746-9ab6-4535-b95b-84cb47889946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.517747 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6856746-9ab6-4535-b95b-84cb47889946 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.518480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6856746-9ab6-4535-b95b-84cb47889946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:28.520232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6856746-9ab6-4535-b95b-84cb47889946 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:28.531638 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1279/2506] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:28.535598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b0bac-8335-427e-89a8-e81eed6cde1c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:28.549064 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b0bac-8335-427e-89a8-e81eed6cde1c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:28.555550 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596e8a9-5dbb-41c2-b6cb-f6983a4543db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:28.556787 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596e8a9-5dbb-41c2-b6cb-f6983a4543db admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.557337 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596e8a9-5dbb-41c2-b6cb-f6983a4543db admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.557636 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596e8a9-5dbb-41c2-b6cb-f6983a4543db admin admin] PATH_INFO: `/v3/projects/1809544f04c04100a88854c22c1303fc/users/b37822482c02499b961b1772992dcd7c/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.575625 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596e8a9-5dbb-41c2-b6cb-f6983a4543db admin admin] RBAC: Authorizing `identity:create_grant(project_id=1809544f04c04100a88854c22c1303fc, user_id=b37822482c02499b961b1772992dcd7c, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:28.578344 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596e8a9-5dbb-41c2-b6cb-f6983a4543db admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:28.591762 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1228/2507] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:28 2022] PUT /identity/v3/projects/1809544f04c04100a88854c22c1303fc/users/b37822482c02499b961b1772992dcd7c/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:28.602967 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fc37b-fbf4-47ac-a42b-499ee2b6a2d3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.603266 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fc37b-fbf4-47ac-a42b-499ee2b6a2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.603583 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11fc37b-fbf4-47ac-a42b-499ee2b6a2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.630795 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f11fc37b-fbf4-47ac-a42b-499ee2b6a2d3 None None] MFA Rules not processed for user `b37822482c02499b961b1772992dcd7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:28.632120 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f11fc37b-fbf4-47ac-a42b-499ee2b6a2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:28.700341 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1280/2508] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:28.704966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596e8a9-5dbb-41c2-b6cb-f6983a4543db admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:28.795159 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596e8a9-5dbb-41c2-b6cb-f6983a4543db admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:28.808154 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b1ecf-b473-48ad-ba07-10aa18a51309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:28.808956 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b1ecf-b473-48ad-ba07-10aa18a51309 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.809137 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b1ecf-b473-48ad-ba07-10aa18a51309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.810016 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892b1ecf-b473-48ad-ba07-10aa18a51309 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.810234 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b1ecf-b473-48ad-ba07-10aa18a51309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:28.812550 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892b1ecf-b473-48ad-ba07-10aa18a51309 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:28.840769 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1229/2509] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:28 2022] POST /identity/v3/projects => generated 381 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:28.844591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fc37b-fbf4-47ac-a42b-499ee2b6a2d3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:28.855717 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11fc37b-fbf4-47ac-a42b-499ee2b6a2d3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:28.913589 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2150741-a7b0-4038-81de-fb51da298514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:28.913880 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2150741-a7b0-4038-81de-fb51da298514 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.914163 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2150741-a7b0-4038-81de-fb51da298514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.914440 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2150741-a7b0-4038-81de-fb51da298514 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.915136 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2150741-a7b0-4038-81de-fb51da298514 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:28.917102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2150741-a7b0-4038-81de-fb51da298514 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:28.938314 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1281/2510] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:28 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:28.942501 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b1ecf-b473-48ad-ba07-10aa18a51309 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:28.954837 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892b1ecf-b473-48ad-ba07-10aa18a51309 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:28.960953 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c616f4d-9366-4c7a-9fcf-2a18d670ac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:28.961745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c616f4d-9366-4c7a-9fcf-2a18d670ac22 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.962043 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c616f4d-9366-4c7a-9fcf-2a18d670ac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.962312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c616f4d-9366-4c7a-9fcf-2a18d670ac22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:28.963054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c616f4d-9366-4c7a-9fcf-2a18d670ac22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:28.964719 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c616f4d-9366-4c7a-9fcf-2a18d670ac22 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:28.976049 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1230/2511] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:28.980535 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2150741-a7b0-4038-81de-fb51da298514 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:28.990513 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2150741-a7b0-4038-81de-fb51da298514 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:28.995959 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636db500-6f32-4ddc-b0ff-2b34b97726ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:28.996841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636db500-6f32-4ddc-b0ff-2b34b97726ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:28.997098 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636db500-6f32-4ddc-b0ff-2b34b97726ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:28.997379 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636db500-6f32-4ddc-b0ff-2b34b97726ee admin admin] PATH_INFO: `/v3/projects/f1122f2dafdd440c9cc9bcf752b16f22/users/30d33265842d4a65897e5fa966dfcf5f/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:29.013150 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636db500-6f32-4ddc-b0ff-2b34b97726ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1122f2dafdd440c9cc9bcf752b16f22, user_id=30d33265842d4a65897e5fa966dfcf5f, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:29.015886 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636db500-6f32-4ddc-b0ff-2b34b97726ee admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:29.035998 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1282/2512] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:28 2022] PUT /identity/v3/projects/f1122f2dafdd440c9cc9bcf752b16f22/users/30d33265842d4a65897e5fa966dfcf5f/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:29.040345 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c616f4d-9366-4c7a-9fcf-2a18d670ac22 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:29.051856 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c616f4d-9366-4c7a-9fcf-2a18d670ac22 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:29.085629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:29.165378 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e1968-3838-44aa-aa32-33b066554de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:29.166539 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1968-3838-44aa-aa32-33b066554de2 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:29.167037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1968-3838-44aa-aa32-33b066554de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:29.167686 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e1968-3838-44aa-aa32-33b066554de2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:29.168587 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e1968-3838-44aa-aa32-33b066554de2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:29.170349 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e1968-3838-44aa-aa32-33b066554de2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:29.187516 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1231/2513] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:29.188181 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636db500-6f32-4ddc-b0ff-2b34b97726ee admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:29.201666 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:29.211760 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636db500-6f32-4ddc-b0ff-2b34b97726ee admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:29.221995 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184fd3f-60fe-4c86-8424-f790e7b620e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:29.223057 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184fd3f-60fe-4c86-8424-f790e7b620e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:29.223767 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184fd3f-60fe-4c86-8424-f790e7b620e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:29.223767 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4184fd3f-60fe-4c86-8424-f790e7b620e2 admin admin] PATH_INFO: `/v3/projects/f1122f2dafdd440c9cc9bcf752b16f22/users/30d33265842d4a65897e5fa966dfcf5f/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:29.227642 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184fd3f-60fe-4c86-8424-f790e7b620e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1122f2dafdd440c9cc9bcf752b16f22, user_id=30d33265842d4a65897e5fa966dfcf5f, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:29.230805 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4184fd3f-60fe-4c86-8424-f790e7b620e2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:29.251422 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1283/2514] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:29 2022] PUT /identity/v3/projects/f1122f2dafdd440c9cc9bcf752b16f22/users/30d33265842d4a65897e5fa966dfcf5f/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:29.255439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a228e-43ab-4141-83cb-ce0225ee65e5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:29.256350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a228e-43ab-4141-83cb-ce0225ee65e5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:29.256731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a228e-43ab-4141-83cb-ce0225ee65e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:29.300524 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-b82a228e-43ab-4141-83cb-ce0225ee65e5 None None] MFA Rules not processed for user `30d33265842d4a65897e5fa966dfcf5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:29.301883 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b82a228e-43ab-4141-83cb-ce0225ee65e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:29.388391 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1232/2515] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:29.400070 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184fd3f-60fe-4c86-8424-f790e7b620e2 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:29.401879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4184fd3f-60fe-4c86-8424-f790e7b620e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:29.460240 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4184fd3f-60fe-4c86-8424-f790e7b620e2 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:29.464190 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd950f-82dc-4d24-83cd-6dd6ae4a423a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:29.464845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd950f-82dc-4d24-83cd-6dd6ae4a423a service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:29.465114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd950f-82dc-4d24-83cd-6dd6ae4a423a service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:29.465413 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd950f-82dc-4d24-83cd-6dd6ae4a423a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:29.474873 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd950f-82dc-4d24-83cd-6dd6ae4a423a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:29.476379 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd950f-82dc-4d24-83cd-6dd6ae4a423a service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:29.486635 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1284/2516] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:29.561431 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a228e-43ab-4141-83cb-ce0225ee65e5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:29.571753 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a228e-43ab-4141-83cb-ce0225ee65e5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:29.575374 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eed7fa-5e3e-4a02-9ed4-da96240cda0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:29.576187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eed7fa-5e3e-4a02-9ed4-da96240cda0e service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:29.576472 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eed7fa-5e3e-4a02-9ed4-da96240cda0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:29.576754 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eed7fa-5e3e-4a02-9ed4-da96240cda0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:29.637283 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eed7fa-5e3e-4a02-9ed4-da96240cda0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:29.638770 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eed7fa-5e3e-4a02-9ed4-da96240cda0e service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:29.648623 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1233/2517] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:20:34.151471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd950f-82dc-4d24-83cd-6dd6ae4a423a service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:34.153152 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f1dd950f-82dc-4d24-83cd-6dd6ae4a423a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:34.214010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd950f-82dc-4d24-83cd-6dd6ae4a423a service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:34.218262 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5b4a5-084a-4230-a02e-ca49853f50b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:34.218913 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5b4a5-084a-4230-a02e-ca49853f50b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:34.219199 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5b4a5-084a-4230-a02e-ca49853f50b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:34.219506 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5b4a5-084a-4230-a02e-ca49853f50b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:34.221410 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-13a5b4a5-084a-4230-a02e-ca49853f50b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:34.288830 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5b4a5-084a-4230-a02e-ca49853f50b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:34.290304 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5b4a5-084a-4230-a02e-ca49853f50b5 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:34.301055 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1285/2518] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:35.086697 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b2019-7638-45df-b894-035779774c80 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:35.088026 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b2019-7638-45df-b894-035779774c80 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:35.088619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b2019-7638-45df-b894-035779774c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:35.125326 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-744b2019-7638-45df-b894-035779774c80 None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:35.127277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-744b2019-7638-45df-b894-035779774c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:35.169187 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:35.214393 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1234/2519] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:20:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:35.282103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5b4a5-084a-4230-a02e-ca49853f50b5 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:35.283867 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-13a5b4a5-084a-4230-a02e-ca49853f50b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:35.340096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:35.368419 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5b4a5-084a-4230-a02e-ca49853f50b5 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:35.378497 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065a4f91-76b0-45a3-824c-d7b477358fdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:35.379382 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a4f91-76b0-45a3-824c-d7b477358fdf service swift] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:35.380824 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a4f91-76b0-45a3-824c-d7b477358fdf service swift] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:35.381194 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a4f91-76b0-45a3-824c-d7b477358fdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:35.392385 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a4f91-76b0-45a3-824c-d7b477358fdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:35.393976 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065a4f91-76b0-45a3-824c-d7b477358fdf service swift] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:35.410116 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1286/2520] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:20:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:37.873658 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b2019-7638-45df-b894-035779774c80 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:37.914557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b2019-7638-45df-b894-035779774c80 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:37.921250 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30379114-d3cd-4592-9d49-f0167c556168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:37.922777 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30379114-d3cd-4592-9d49-f0167c556168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:37.925566 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30379114-d3cd-4592-9d49-f0167c556168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:37.926036 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30379114-d3cd-4592-9d49-f0167c556168 admin admin] PATH_INFO: `/v3/users/b37822482c02499b961b1772992dcd7c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:37.928868 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30379114-d3cd-4592-9d49-f0167c556168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b37822482c02499b961b1772992dcd7c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:37.945021 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30379114-d3cd-4592-9d49-f0167c556168 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:38.073026 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-30379114-d3cd-4592-9d49-f0167c556168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b37822482c02499b961b1772992dcd7c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:38.074105 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-30379114-d3cd-4592-9d49-f0167c556168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b37822482c02499b961b1772992dcd7c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:38.075735 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-30379114-d3cd-4592-9d49-f0167c556168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b37822482c02499b961b1772992dcd7c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:38.087422 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-30379114-d3cd-4592-9d49-f0167c556168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b37822482c02499b961b1772992dcd7c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:38.108808 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-30379114-d3cd-4592-9d49-f0167c556168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b37822482c02499b961b1772992dcd7c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:38.135112 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1235/2521] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:37 2022] DELETE /identity/v3/users/b37822482c02499b961b1772992dcd7c => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:38.140719 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706adb4-d2b8-4943-b37b-01402ec603a7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:38.141235 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706adb4-d2b8-4943-b37b-01402ec603a7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:38.141809 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2706adb4-d2b8-4943-b37b-01402ec603a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:38.182859 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-2706adb4-d2b8-4943-b37b-01402ec603a7 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:38.185073 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2706adb4-d2b8-4943-b37b-01402ec603a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:38.315373 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1287/2522] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:38.324615 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30379114-d3cd-4592-9d49-f0167c556168 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:38.326203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-30379114-d3cd-4592-9d49-f0167c556168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:38.429214 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30379114-d3cd-4592-9d49-f0167c556168 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:38.435964 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c7408-3eef-4ef7-9e5d-897e477f80d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:38.436836 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c7408-3eef-4ef7-9e5d-897e477f80d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:38.438126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c7408-3eef-4ef7-9e5d-897e477f80d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:38.438548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c7408-3eef-4ef7-9e5d-897e477f80d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:38.453748 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c7408-3eef-4ef7-9e5d-897e477f80d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:38.460328 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c7408-3eef-4ef7-9e5d-897e477f80d4 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:38.488704 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1236/2523] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:38.538604 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706adb4-d2b8-4943-b37b-01402ec603a7 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:38.540415 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2706adb4-d2b8-4943-b37b-01402ec603a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:38.566143 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2706adb4-d2b8-4943-b37b-01402ec603a7 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:38.578665 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd813a7b-3684-4d23-b9e2-0dd0d68ebf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:38.579538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd813a7b-3684-4d23-b9e2-0dd0d68ebf77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:38.579828 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd813a7b-3684-4d23-b9e2-0dd0d68ebf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:38.580108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd813a7b-3684-4d23-b9e2-0dd0d68ebf77 admin admin] PATH_INFO: `/v3/users/1e7d0f401530454ba0cae0f5e9d6e0ce` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:38.583323 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd813a7b-3684-4d23-b9e2-0dd0d68ebf77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e7d0f401530454ba0cae0f5e9d6e0ce)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:38.585472 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd813a7b-3684-4d23-b9e2-0dd0d68ebf77 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:38.662822 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-dd813a7b-3684-4d23-b9e2-0dd0d68ebf77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e7d0f401530454ba0cae0f5e9d6e0ce'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:38.664392 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-dd813a7b-3684-4d23-b9e2-0dd0d68ebf77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e7d0f401530454ba0cae0f5e9d6e0ce'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:38.675955 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-dd813a7b-3684-4d23-b9e2-0dd0d68ebf77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e7d0f401530454ba0cae0f5e9d6e0ce'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:38.676813 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-dd813a7b-3684-4d23-b9e2-0dd0d68ebf77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e7d0f401530454ba0cae0f5e9d6e0ce'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:38.692976 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-dd813a7b-3684-4d23-b9e2-0dd0d68ebf77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e7d0f401530454ba0cae0f5e9d6e0ce'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:38.722195 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1288/2524] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:38 2022] DELETE /identity/v3/users/1e7d0f401530454ba0cae0f5e9d6e0ce => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:38.885389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c7408-3eef-4ef7-9e5d-897e477f80d4 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:38.889886 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d05c7408-3eef-4ef7-9e5d-897e477f80d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:38.916960 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c7408-3eef-4ef7-9e5d-897e477f80d4 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:38.970578 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd813a7b-3684-4d23-b9e2-0dd0d68ebf77 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:38.972197 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-dd813a7b-3684-4d23-b9e2-0dd0d68ebf77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:39.027695 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:39.049170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:39.057715 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2842eb-fcd6-434c-8775-e43adb515bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:39.059088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2842eb-fcd6-434c-8775-e43adb515bae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:39.059722 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2842eb-fcd6-434c-8775-e43adb515bae admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:39.060768 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2842eb-fcd6-434c-8775-e43adb515bae admin admin] PATH_INFO: `/v3/projects/1809544f04c04100a88854c22c1303fc` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:39.083585 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd813a7b-3684-4d23-b9e2-0dd0d68ebf77 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:39.084745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2842eb-fcd6-434c-8775-e43adb515bae admin admin] RBAC: Authorizing `identity:delete_project(project_id=1809544f04c04100a88854c22c1303fc)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:39.087445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2842eb-fcd6-434c-8775-e43adb515bae admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:39.088660 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548db9b7-5a6e-4c9b-886c-72902b123b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:39.089538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548db9b7-5a6e-4c9b-886c-72902b123b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:39.089834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548db9b7-5a6e-4c9b-886c-72902b123b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:39.090359 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548db9b7-5a6e-4c9b-886c-72902b123b03 admin admin] PATH_INFO: `/v3/projects/b6578102e5a746a584bcc9e4b2f64d46` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:39.091355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548db9b7-5a6e-4c9b-886c-72902b123b03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6578102e5a746a584bcc9e4b2f64d46)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:39.093433 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548db9b7-5a6e-4c9b-886c-72902b123b03 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:39.145403 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5a2842eb-fcd6-434c-8775-e43adb515bae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1809544f04c04100a88854c22c1303fc', 'request_id': 'req-5a2842eb-fcd6-434c-8775-e43adb515bae'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:39.155854 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5a2842eb-fcd6-434c-8775-e43adb515bae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1809544f04c04100a88854c22c1303fc', 'request_id': 'req-5a2842eb-fcd6-434c-8775-e43adb515bae'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:39.161847 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-548db9b7-5a6e-4c9b-886c-72902b123b03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6578102e5a746a584bcc9e4b2f64d46', 'request_id': 'req-548db9b7-5a6e-4c9b-886c-72902b123b03'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:39.174059 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5a2842eb-fcd6-434c-8775-e43adb515bae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1809544f04c04100a88854c22c1303fc', 'request_id': 'req-5a2842eb-fcd6-434c-8775-e43adb515bae'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:39.177911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-548db9b7-5a6e-4c9b-886c-72902b123b03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6578102e5a746a584bcc9e4b2f64d46', 'request_id': 'req-548db9b7-5a6e-4c9b-886c-72902b123b03'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:39.184509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-548db9b7-5a6e-4c9b-886c-72902b123b03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6578102e5a746a584bcc9e4b2f64d46', 'request_id': 'req-548db9b7-5a6e-4c9b-886c-72902b123b03'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:39.191277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5a2842eb-fcd6-434c-8775-e43adb515bae admin admin] The token cache is being invalidate because project 1809544f04c04100a88854c22c1303fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:39.191277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5a2842eb-fcd6-434c-8775-e43adb515bae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:39.191277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5a2842eb-fcd6-434c-8775-e43adb515bae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:39.193070 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1237/2525] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:38 2022] DELETE /identity/v3/projects/1809544f04c04100a88854c22c1303fc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:39.197653 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2842eb-fcd6-434c-8775-e43adb515bae admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:39.199109 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5a2842eb-fcd6-434c-8775-e43adb515bae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:39.211141 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-548db9b7-5a6e-4c9b-886c-72902b123b03 admin admin] The token cache is being invalidate because project b6578102e5a746a584bcc9e4b2f64d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:39.211512 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-548db9b7-5a6e-4c9b-886c-72902b123b03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:39.212538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-548db9b7-5a6e-4c9b-886c-72902b123b03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:39.215013 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1289/2526] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:38 2022] DELETE /identity/v3/projects/b6578102e5a746a584bcc9e4b2f64d46 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:39.221342 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613da7d6-5e8a-4da9-87db-9196c0cc3f99 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:39.221342 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613da7d6-5e8a-4da9-87db-9196c0cc3f99 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:39.221342 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613da7d6-5e8a-4da9-87db-9196c0cc3f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:39.261474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-613da7d6-5e8a-4da9-87db-9196c0cc3f99 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:39.263063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-613da7d6-5e8a-4da9-87db-9196c0cc3f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:39.306484 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2842eb-fcd6-434c-8775-e43adb515bae admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:39.395332 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1290/2527] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:39.404139 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f976c-b45e-4ad1-8a2c-ee90122223b3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:39.404575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f976c-b45e-4ad1-8a2c-ee90122223b3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:39.404955 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f976c-b45e-4ad1-8a2c-ee90122223b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:39.428140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5b2f976c-b45e-4ad1-8a2c-ee90122223b3 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:39.430617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5b2f976c-b45e-4ad1-8a2c-ee90122223b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:39.432799 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de265d2-7634-47b9-81d1-667ddd1758d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:39.434797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de265d2-7634-47b9-81d1-667ddd1758d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:39.435400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de265d2-7634-47b9-81d1-667ddd1758d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:39.435960 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de265d2-7634-47b9-81d1-667ddd1758d0 admin admin] PATH_INFO: `/v3/users/30d33265842d4a65897e5fa966dfcf5f` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:39.437953 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de265d2-7634-47b9-81d1-667ddd1758d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30d33265842d4a65897e5fa966dfcf5f)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:39.440119 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de265d2-7634-47b9-81d1-667ddd1758d0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:39.440555 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1291/2528] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:39.444643 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f976c-b45e-4ad1-8a2c-ee90122223b3 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:39.460826 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f976c-b45e-4ad1-8a2c-ee90122223b3 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:39.476884 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800bf72-a1b1-4eff-8c04-b80e79c66adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:39.478706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800bf72-a1b1-4eff-8c04-b80e79c66adf admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:39.479953 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800bf72-a1b1-4eff-8c04-b80e79c66adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:39.481530 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6800bf72-a1b1-4eff-8c04-b80e79c66adf admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:39.482507 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800bf72-a1b1-4eff-8c04-b80e79c66adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:39.482971 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800bf72-a1b1-4eff-8c04-b80e79c66adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:39.484965 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6800bf72-a1b1-4eff-8c04-b80e79c66adf admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:39.491329 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:39.501046 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1292/2529] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:20:39.505519 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800bf72-a1b1-4eff-8c04-b80e79c66adf admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:39.518253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8de265d2-7634-47b9-81d1-667ddd1758d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30d33265842d4a65897e5fa966dfcf5f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:39.518484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6800bf72-a1b1-4eff-8c04-b80e79c66adf admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:39.518934 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8de265d2-7634-47b9-81d1-667ddd1758d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30d33265842d4a65897e5fa966dfcf5f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:39.519970 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8de265d2-7634-47b9-81d1-667ddd1758d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30d33265842d4a65897e5fa966dfcf5f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:39.524074 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c36be-8c27-443f-9f5c-0b8816ffdd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:39.524798 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c36be-8c27-443f-9f5c-0b8816ffdd90 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:39.525088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c36be-8c27-443f-9f5c-0b8816ffdd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:39.525369 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43c36be-8c27-443f-9f5c-0b8816ffdd90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:39.526309 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c36be-8c27-443f-9f5c-0b8816ffdd90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:39.528495 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43c36be-8c27-443f-9f5c-0b8816ffdd90 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:39.529018 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8de265d2-7634-47b9-81d1-667ddd1758d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30d33265842d4a65897e5fa966dfcf5f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:39.545163 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8de265d2-7634-47b9-81d1-667ddd1758d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30d33265842d4a65897e5fa966dfcf5f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:39.567602 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1238/2530] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:39 2022] DELETE /identity/v3/users/30d33265842d4a65897e5fa966dfcf5f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:39.572555 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1293/2531] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:39 2022] POST /identity/v3/projects => generated 375 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:39.573569 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de265d2-7634-47b9-81d1-667ddd1758d0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:39.575062 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8de265d2-7634-47b9-81d1-667ddd1758d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:39.667621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de265d2-7634-47b9-81d1-667ddd1758d0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:39.745763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb618b-36f7-49e2-9cbb-032bd3fe4183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:39.747164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb618b-36f7-49e2-9cbb-032bd3fe4183 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:39.747619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb618b-36f7-49e2-9cbb-032bd3fe4183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:39.748037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bb618b-36f7-49e2-9cbb-032bd3fe4183 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:39.749081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb618b-36f7-49e2-9cbb-032bd3fe4183 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:39.751188 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bb618b-36f7-49e2-9cbb-032bd3fe4183 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:39.776866 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1239/2532] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:39 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:20:39.780999 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c36be-8c27-443f-9f5c-0b8816ffdd90 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:39.792833 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43c36be-8c27-443f-9f5c-0b8816ffdd90 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:39.810597 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab681c-9ec5-4e19-9e7b-fec7e58f758a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:39.812507 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab681c-9ec5-4e19-9e7b-fec7e58f758a admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:39.813254 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab681c-9ec5-4e19-9e7b-fec7e58f758a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:39.813254 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab681c-9ec5-4e19-9e7b-fec7e58f758a admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:39.813885 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab681c-9ec5-4e19-9e7b-fec7e58f758a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:39.819657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab681c-9ec5-4e19-9e7b-fec7e58f758a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:39.832408 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1294/2533] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:39.836223 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb618b-36f7-49e2-9cbb-032bd3fe4183 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:39.848803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bb618b-36f7-49e2-9cbb-032bd3fe4183 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:39.853132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8b7de-2a68-4836-b7c5-b59a8c14eaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:39.854110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8b7de-2a68-4836-b7c5-b59a8c14eaee admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:39.854500 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8b7de-2a68-4836-b7c5-b59a8c14eaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:39.855171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8b7de-2a68-4836-b7c5-b59a8c14eaee admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:39.855900 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8b7de-2a68-4836-b7c5-b59a8c14eaee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:39.857818 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8b7de-2a68-4836-b7c5-b59a8c14eaee admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:39.870118 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1240/2534] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:20:39.876127 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab681c-9ec5-4e19-9e7b-fec7e58f758a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:39.891637 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab681c-9ec5-4e19-9e7b-fec7e58f758a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:39.897795 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66509438-b10b-41f3-8924-d7f0ae878121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:39.898948 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66509438-b10b-41f3-8924-d7f0ae878121 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:39.899621 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66509438-b10b-41f3-8924-d7f0ae878121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:39.900165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66509438-b10b-41f3-8924-d7f0ae878121 admin admin] PATH_INFO: `/v3/projects/675986aab65c4b25bd26b08635fdb742/users/33aaba928ec14925af5edcb79b615832/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:39.925466 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66509438-b10b-41f3-8924-d7f0ae878121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=675986aab65c4b25bd26b08635fdb742, user_id=33aaba928ec14925af5edcb79b615832, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:39.931203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8b7de-2a68-4836-b7c5-b59a8c14eaee admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:39.933019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-eea8b7de-2a68-4836-b7c5-b59a8c14eaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:39.935100 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66509438-b10b-41f3-8924-d7f0ae878121 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:39.953965 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:39.969503 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8b7de-2a68-4836-b7c5-b59a8c14eaee admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:39.971712 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1295/2535] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:39 2022] PUT /identity/v3/projects/675986aab65c4b25bd26b08635fdb742/users/33aaba928ec14925af5edcb79b615832/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:39.977547 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dc00d-3683-42f7-be47-36d8539a5503 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:39.977873 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dc00d-3683-42f7-be47-36d8539a5503 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:39.978247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59dc00d-3683-42f7-be47-36d8539a5503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.015347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e59dc00d-3683-42f7-be47-36d8539a5503 None None] MFA Rules not processed for user `33aaba928ec14925af5edcb79b615832`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:40.016794 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:40.017639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e59dc00d-3683-42f7-be47-36d8539a5503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:40.058621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564df3bc-a34c-46af-a2d2-f19ee63ca5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:40.060692 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564df3bc-a34c-46af-a2d2-f19ee63ca5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.061045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564df3bc-a34c-46af-a2d2-f19ee63ca5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.061390 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564df3bc-a34c-46af-a2d2-f19ee63ca5b6 admin admin] PATH_INFO: `/v3/projects/f1122f2dafdd440c9cc9bcf752b16f22` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.062960 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564df3bc-a34c-46af-a2d2-f19ee63ca5b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1122f2dafdd440c9cc9bcf752b16f22)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:40.066208 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564df3bc-a34c-46af-a2d2-f19ee63ca5b6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:40.112659 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1296/2536] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:40.113874 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dc00d-3683-42f7-be47-36d8539a5503 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:40.115361 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e59dc00d-3683-42f7-be47-36d8539a5503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:40.125896 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-564df3bc-a34c-46af-a2d2-f19ee63ca5b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1122f2dafdd440c9cc9bcf752b16f22', 'request_id': 'req-564df3bc-a34c-46af-a2d2-f19ee63ca5b6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:40.136365 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-564df3bc-a34c-46af-a2d2-f19ee63ca5b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1122f2dafdd440c9cc9bcf752b16f22', 'request_id': 'req-564df3bc-a34c-46af-a2d2-f19ee63ca5b6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:40.144565 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-564df3bc-a34c-46af-a2d2-f19ee63ca5b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1122f2dafdd440c9cc9bcf752b16f22', 'request_id': 'req-564df3bc-a34c-46af-a2d2-f19ee63ca5b6'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:40.169214 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-564df3bc-a34c-46af-a2d2-f19ee63ca5b6 admin admin] The token cache is being invalidate because project f1122f2dafdd440c9cc9bcf752b16f22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:40.169823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-564df3bc-a34c-46af-a2d2-f19ee63ca5b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:40.170792 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-564df3bc-a34c-46af-a2d2-f19ee63ca5b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:40.174267 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1241/2537] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:39 2022] DELETE /identity/v3/projects/f1122f2dafdd440c9cc9bcf752b16f22 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:40.183641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf4a63-32b4-43fe-b431-01f627561de2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.184268 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf4a63-32b4-43fe-b431-01f627561de2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.184972 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf4a63-32b4-43fe-b431-01f627561de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.212466 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d2cf4a63-32b4-43fe-b431-01f627561de2 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:40.213928 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d2cf4a63-32b4-43fe-b431-01f627561de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:40.230538 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59dc00d-3683-42f7-be47-36d8539a5503 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:40.308673 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:40.315034 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1242/2538] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:40.319983 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82972ba6-cccc-4df6-bd58-0aa18f437631 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:40.320656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82972ba6-cccc-4df6-bd58-0aa18f437631 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.320943 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82972ba6-cccc-4df6-bd58-0aa18f437631 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.321221 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82972ba6-cccc-4df6-bd58-0aa18f437631 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.324072 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-82972ba6-cccc-4df6-bd58-0aa18f437631 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:40.324508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41c880-bd8c-4ec6-acbd-04977641fdde None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.324799 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41c880-bd8c-4ec6-acbd-04977641fdde None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.325079 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e41c880-bd8c-4ec6-acbd-04977641fdde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.344621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-1e41c880-bd8c-4ec6-acbd-04977641fdde None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:40.345859 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-1e41c880-bd8c-4ec6-acbd-04977641fdde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:40.354738 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1243/2539] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:20:40.358897 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41c880-bd8c-4ec6-acbd-04977641fdde None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:40.368808 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e41c880-bd8c-4ec6-acbd-04977641fdde None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:40.373716 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0dc93-272a-4867-a522-b2c96bc4c86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:40.374389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0dc93-272a-4867-a522-b2c96bc4c86f admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.374674 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0dc93-272a-4867-a522-b2c96bc4c86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.375238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0dc93-272a-4867-a522-b2c96bc4c86f admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.376148 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0dc93-272a-4867-a522-b2c96bc4c86f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:40.376463 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0dc93-272a-4867-a522-b2c96bc4c86f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:40.378196 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0dc93-272a-4867-a522-b2c96bc4c86f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:40.392857 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1244/2540] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:20:40.397539 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0dc93-272a-4867-a522-b2c96bc4c86f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:40.409800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82972ba6-cccc-4df6-bd58-0aa18f437631 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:40.411464 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82972ba6-cccc-4df6-bd58-0aa18f437631 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:40.416852 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0dc93-272a-4867-a522-b2c96bc4c86f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:40.423766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca151c68-0d53-4e13-80df-47198c137a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:40.424573 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca151c68-0d53-4e13-80df-47198c137a9e admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.424855 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca151c68-0d53-4e13-80df-47198c137a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.425996 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca151c68-0d53-4e13-80df-47198c137a9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.426761 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca151c68-0d53-4e13-80df-47198c137a9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:40.429499 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca151c68-0d53-4e13-80df-47198c137a9e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:40.432657 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1297/2541] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:40.481575 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1245/2542] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:40 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:40.482524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82972ba6-cccc-4df6-bd58-0aa18f437631 service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:40.506782 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82972ba6-cccc-4df6-bd58-0aa18f437631 service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:40.645920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571507a2-041a-4f5c-be12-99572e6276a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:40.648119 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571507a2-041a-4f5c-be12-99572e6276a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.648555 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571507a2-041a-4f5c-be12-99572e6276a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.649683 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571507a2-041a-4f5c-be12-99572e6276a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.652435 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571507a2-041a-4f5c-be12-99572e6276a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:40.658564 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571507a2-041a-4f5c-be12-99572e6276a0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:40.695641 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1298/2543] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:40 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:40.700054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca151c68-0d53-4e13-80df-47198c137a9e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:40.715338 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca151c68-0d53-4e13-80df-47198c137a9e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:40.737140 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bcbd8-b99f-4d8d-97f0-3f1f9cb1dfa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:40.737849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bcbd8-b99f-4d8d-97f0-3f1f9cb1dfa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.738137 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bcbd8-b99f-4d8d-97f0-3f1f9cb1dfa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.738419 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bcbd8-b99f-4d8d-97f0-3f1f9cb1dfa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.739165 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bcbd8-b99f-4d8d-97f0-3f1f9cb1dfa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:40.740823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1bcbd8-b99f-4d8d-97f0-3f1f9cb1dfa1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:40.762030 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1246/2544] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:40.771684 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571507a2-041a-4f5c-be12-99572e6276a0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:40.772336 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bcbd8-b99f-4d8d-97f0-3f1f9cb1dfa1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:40.774844 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dd1bcbd8-b99f-4d8d-97f0-3f1f9cb1dfa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:40.783748 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571507a2-041a-4f5c-be12-99572e6276a0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:40.788693 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984120c7-4004-43d1-8c2d-07afec0716bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:40.789416 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984120c7-4004-43d1-8c2d-07afec0716bc admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.789700 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984120c7-4004-43d1-8c2d-07afec0716bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.789976 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984120c7-4004-43d1-8c2d-07afec0716bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.790133 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1bcbd8-b99f-4d8d-97f0-3f1f9cb1dfa1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:40.790743 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984120c7-4004-43d1-8c2d-07afec0716bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:40.792432 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984120c7-4004-43d1-8c2d-07afec0716bc admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:40.800730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada992f1-1176-4ce5-9e4d-9baf1f879096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:40.801810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada992f1-1176-4ce5-9e4d-9baf1f879096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.802087 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada992f1-1176-4ce5-9e4d-9baf1f879096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.802308 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada992f1-1176-4ce5-9e4d-9baf1f879096 admin admin] PATH_INFO: `/v3/users/33aaba928ec14925af5edcb79b615832` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.803626 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada992f1-1176-4ce5-9e4d-9baf1f879096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33aaba928ec14925af5edcb79b615832)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:40.805433 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1299/2545] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:40.805733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada992f1-1176-4ce5-9e4d-9baf1f879096 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:40.809127 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:40.817321 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984120c7-4004-43d1-8c2d-07afec0716bc admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:40.831375 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984120c7-4004-43d1-8c2d-07afec0716bc admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:40.836846 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259f59a5-c3c4-4a20-8d71-a0fa351e8783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:40.837968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f59a5-c3c4-4a20-8d71-a0fa351e8783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.838277 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f59a5-c3c4-4a20-8d71-a0fa351e8783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.838536 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259f59a5-c3c4-4a20-8d71-a0fa351e8783 admin admin] PATH_INFO: `/v3/projects/6319be45a08e40e4af76b9ae84f6330b/users/aa2dddcc63ec48a8b37001c566159ac6/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.862059 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f59a5-c3c4-4a20-8d71-a0fa351e8783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6319be45a08e40e4af76b9ae84f6330b, user_id=aa2dddcc63ec48a8b37001c566159ac6, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:40.864876 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259f59a5-c3c4-4a20-8d71-a0fa351e8783 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:40.877327 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ada992f1-1176-4ce5-9e4d-9baf1f879096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33aaba928ec14925af5edcb79b615832'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:40.878283 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ada992f1-1176-4ce5-9e4d-9baf1f879096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33aaba928ec14925af5edcb79b615832'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:40.879123 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ada992f1-1176-4ce5-9e4d-9baf1f879096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33aaba928ec14925af5edcb79b615832'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:40.884527 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1300/2546] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:40 2022] PUT /identity/v3/projects/6319be45a08e40e4af76b9ae84f6330b/users/aa2dddcc63ec48a8b37001c566159ac6/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:40.890455 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ada992f1-1176-4ce5-9e4d-9baf1f879096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33aaba928ec14925af5edcb79b615832'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:40.897806 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93b467-9ccc-4fe4-951a-8f3634ed5519 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.898314 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93b467-9ccc-4fe4-951a-8f3634ed5519 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.898985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a93b467-9ccc-4fe4-951a-8f3634ed5519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.906312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ada992f1-1176-4ce5-9e4d-9baf1f879096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33aaba928ec14925af5edcb79b615832'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:40.923865 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1247/2547] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:40 2022] DELETE /identity/v3/users/33aaba928ec14925af5edcb79b615832 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:40.928733 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d52f46-e145-47cf-ac71-e1527f1254bd None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:40.929012 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d52f46-e145-47cf-ac71-e1527f1254bd None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:40.929366 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d52f46-e145-47cf-ac71-e1527f1254bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:40.933328 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9a93b467-9ccc-4fe4-951a-8f3634ed5519 None None] MFA Rules not processed for user `aa2dddcc63ec48a8b37001c566159ac6`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:40.934612 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9a93b467-9ccc-4fe4-951a-8f3634ed5519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:40.949172 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d9d52f46-e145-47cf-ac71-e1527f1254bd None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:40.950555 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d9d52f46-e145-47cf-ac71-e1527f1254bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:40.989894 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:41.016773 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1301/2548] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:40 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:20:41.021367 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93b467-9ccc-4fe4-951a-8f3634ed5519 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:41.023324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9a93b467-9ccc-4fe4-951a-8f3634ed5519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:41.040627 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1248/2549] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:41.053612 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d52f46-e145-47cf-ac71-e1527f1254bd None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:41.056481 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d9d52f46-e145-47cf-ac71-e1527f1254bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:41.127908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a93b467-9ccc-4fe4-951a-8f3634ed5519 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:41.138096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0f10c-8f78-46a1-bfa2-03b3635b6343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:41.138791 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0f10c-8f78-46a1-bfa2-03b3635b6343 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:41.139078 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0f10c-8f78-46a1-bfa2-03b3635b6343 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:41.139395 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f0f10c-8f78-46a1-bfa2-03b3635b6343 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:41.140200 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0f10c-8f78-46a1-bfa2-03b3635b6343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:41.142983 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f0f10c-8f78-46a1-bfa2-03b3635b6343 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:41.148997 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d52f46-e145-47cf-ac71-e1527f1254bd None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:41.154169 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806502f9-bdab-4519-bd56-d175936cdd98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:41.155086 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806502f9-bdab-4519-bd56-d175936cdd98 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:41.155487 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806502f9-bdab-4519-bd56-d175936cdd98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:41.156315 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806502f9-bdab-4519-bd56-d175936cdd98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:41.170682 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806502f9-bdab-4519-bd56-d175936cdd98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:41.173458 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806502f9-bdab-4519-bd56-d175936cdd98 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:41.188132 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1249/2550] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:41.194614 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1302/2551] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:41 2022] POST /identity/v3/projects => generated 365 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:41.196973 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0f10c-8f78-46a1-bfa2-03b3635b6343 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:41.287945 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f0f10c-8f78-46a1-bfa2-03b3635b6343 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:41.294394 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bbd8e-96ee-4d72-91b7-97f9faf67d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:41.295264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bbd8e-96ee-4d72-91b7-97f9faf67d6a admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:41.295733 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bbd8e-96ee-4d72-91b7-97f9faf67d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:41.296362 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bbd8e-96ee-4d72-91b7-97f9faf67d6a admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:41.297755 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bbd8e-96ee-4d72-91b7-97f9faf67d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:41.299099 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bbd8e-96ee-4d72-91b7-97f9faf67d6a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:41.325447 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1303/2552] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:41 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:41.329807 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806502f9-bdab-4519-bd56-d175936cdd98 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:41.345822 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806502f9-bdab-4519-bd56-d175936cdd98 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:41.360584 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5a2f5-4b4e-4e06-b6fb-e08368d48d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:41.361412 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5a2f5-4b4e-4e06-b6fb-e08368d48d59 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:41.361702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5a2f5-4b4e-4e06-b6fb-e08368d48d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:41.361978 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5a2f5-4b4e-4e06-b6fb-e08368d48d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:41.362763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5a2f5-4b4e-4e06-b6fb-e08368d48d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:41.364470 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5a2f5-4b4e-4e06-b6fb-e08368d48d59 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:41.398758 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1250/2553] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:41.402591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bbd8e-96ee-4d72-91b7-97f9faf67d6a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:41.416500 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bbd8e-96ee-4d72-91b7-97f9faf67d6a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:41.422055 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba28568-3693-4ed7-8ecb-d8b1b2759413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:41.423689 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba28568-3693-4ed7-8ecb-d8b1b2759413 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:41.423689 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba28568-3693-4ed7-8ecb-d8b1b2759413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:41.423689 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba28568-3693-4ed7-8ecb-d8b1b2759413 admin admin] PATH_INFO: `/v3/projects/b3f515dbcf3640019a0650c78bc224c4/users/a77e5c56b5b5479191423de454d31f8b/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:41.444099 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba28568-3693-4ed7-8ecb-d8b1b2759413 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f515dbcf3640019a0650c78bc224c4, user_id=a77e5c56b5b5479191423de454d31f8b, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:41.447071 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba28568-3693-4ed7-8ecb-d8b1b2759413 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:41.462761 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1304/2554] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:41 2022] PUT /identity/v3/projects/b3f515dbcf3640019a0650c78bc224c4/users/a77e5c56b5b5479191423de454d31f8b/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:41.466803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5a2f5-4b4e-4e06-b6fb-e08368d48d59 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:41.479033 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5a2f5-4b4e-4e06-b6fb-e08368d48d59 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:41.489716 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:41.554118 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba28568-3693-4ed7-8ecb-d8b1b2759413 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:41.556006 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cba28568-3693-4ed7-8ecb-d8b1b2759413 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:41.582055 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9757e5-8bd3-4f13-981c-cf7e4974134a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:41.583255 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9757e5-8bd3-4f13-981c-cf7e4974134a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:41.583799 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9757e5-8bd3-4f13-981c-cf7e4974134a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:41.584404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9757e5-8bd3-4f13-981c-cf7e4974134a admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:41.585229 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9757e5-8bd3-4f13-981c-cf7e4974134a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:41.587842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9757e5-8bd3-4f13-981c-cf7e4974134a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:41.602680 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1251/2555] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:41 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:41.603969 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9757e5-8bd3-4f13-981c-cf7e4974134a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:41.615329 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9757e5-8bd3-4f13-981c-cf7e4974134a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:41.621788 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fe4bc7-5204-404b-b2f7-8ad7dee09b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:41.622912 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe4bc7-5204-404b-b2f7-8ad7dee09b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:41.622912 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe4bc7-5204-404b-b2f7-8ad7dee09b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:41.623170 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fe4bc7-5204-404b-b2f7-8ad7dee09b45 admin admin] PATH_INFO: `/v3/projects/b3f515dbcf3640019a0650c78bc224c4/users/a77e5c56b5b5479191423de454d31f8b/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:41.625559 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe4bc7-5204-404b-b2f7-8ad7dee09b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3f515dbcf3640019a0650c78bc224c4, user_id=a77e5c56b5b5479191423de454d31f8b, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:41.626631 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:41.630009 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fe4bc7-5204-404b-b2f7-8ad7dee09b45 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:41.648335 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1252/2556] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:41 2022] PUT /identity/v3/projects/b3f515dbcf3640019a0650c78bc224c4/users/a77e5c56b5b5479191423de454d31f8b/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:41.658517 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd98abd-8773-4cb9-a610-c8ed75a918b0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:41.658802 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd98abd-8773-4cb9-a610-c8ed75a918b0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:41.659081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd98abd-8773-4cb9-a610-c8ed75a918b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:41.665224 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba28568-3693-4ed7-8ecb-d8b1b2759413 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:41.703859 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2dd98abd-8773-4cb9-a610-c8ed75a918b0 None None] MFA Rules not processed for user `a77e5c56b5b5479191423de454d31f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:41.704776 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2dd98abd-8773-4cb9-a610-c8ed75a918b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:41.760115 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd8c30c-036f-4423-8b6b-d438e3bba270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:41.761072 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8c30c-036f-4423-8b6b-d438e3bba270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:41.761651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8c30c-036f-4423-8b6b-d438e3bba270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:41.761651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd8c30c-036f-4423-8b6b-d438e3bba270 admin admin] PATH_INFO: `/v3/projects/675986aab65c4b25bd26b08635fdb742` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:41.763179 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8c30c-036f-4423-8b6b-d438e3bba270 admin admin] RBAC: Authorizing `identity:delete_project(project_id=675986aab65c4b25bd26b08635fdb742)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:41.765391 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd8c30c-036f-4423-8b6b-d438e3bba270 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:41.860579 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9fd8c30c-036f-4423-8b6b-d438e3bba270 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '675986aab65c4b25bd26b08635fdb742', 'request_id': 'req-9fd8c30c-036f-4423-8b6b-d438e3bba270'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:41.866412 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1253/2557] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:20:41.873834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd98abd-8773-4cb9-a610-c8ed75a918b0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:41.875858 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2dd98abd-8773-4cb9-a610-c8ed75a918b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:41.876723 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9fd8c30c-036f-4423-8b6b-d438e3bba270 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '675986aab65c4b25bd26b08635fdb742', 'request_id': 'req-9fd8c30c-036f-4423-8b6b-d438e3bba270'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:41.884573 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9fd8c30c-036f-4423-8b6b-d438e3bba270 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '675986aab65c4b25bd26b08635fdb742', 'request_id': 'req-9fd8c30c-036f-4423-8b6b-d438e3bba270'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:41.907076 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9fd8c30c-036f-4423-8b6b-d438e3bba270 admin admin] The token cache is being invalidate because project 675986aab65c4b25bd26b08635fdb742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:41.907453 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9fd8c30c-036f-4423-8b6b-d438e3bba270 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:41.908222 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-9fd8c30c-036f-4423-8b6b-d438e3bba270 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:41.910666 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1305/2558] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:41 2022] DELETE /identity/v3/projects/675986aab65c4b25bd26b08635fdb742 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:41.915858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0258753-dd74-472a-bed2-d66a7235fc01 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:41.916374 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0258753-dd74-472a-bed2-d66a7235fc01 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:41.919586 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0258753-dd74-472a-bed2-d66a7235fc01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:41.943755 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e0258753-dd74-472a-bed2-d66a7235fc01 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:41.945114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e0258753-dd74-472a-bed2-d66a7235fc01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:41.995088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd98abd-8773-4cb9-a610-c8ed75a918b0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:42.037551 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1306/2559] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:42.040600 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2222f0-ecee-4c75-aa53-8ad3feb3580c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:42.041423 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2222f0-ecee-4c75-aa53-8ad3feb3580c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:42.041423 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2222f0-ecee-4c75-aa53-8ad3feb3580c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:42.052430 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:42.073876 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ad2222f0-ecee-4c75-aa53-8ad3feb3580c None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:42.075201 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ad2222f0-ecee-4c75-aa53-8ad3feb3580c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:42.081815 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3c6f3-9264-41d8-a2b0-f1212da49517 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:42.082541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3c6f3-9264-41d8-a2b0-f1212da49517 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:42.082902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3c6f3-9264-41d8-a2b0-f1212da49517 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:42.083252 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3c6f3-9264-41d8-a2b0-f1212da49517 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:42.084031 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1307/2560] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:42.087322 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a5c3c6f3-9264-41d8-a2b0-f1212da49517 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:42.089274 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2222f0-ecee-4c75-aa53-8ad3feb3580c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:42.100547 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2222f0-ecee-4c75-aa53-8ad3feb3580c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:42.105932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095e345-90cf-47e8-9235-a2b2267145af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:42.106737 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095e345-90cf-47e8-9235-a2b2267145af admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:42.107792 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095e345-90cf-47e8-9235-a2b2267145af admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:42.108183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c095e345-90cf-47e8-9235-a2b2267145af admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:42.109029 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095e345-90cf-47e8-9235-a2b2267145af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:42.109470 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095e345-90cf-47e8-9235-a2b2267145af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:42.111409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c095e345-90cf-47e8-9235-a2b2267145af admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:42.114993 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:42.132070 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1308/2561] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:20:42.133111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095e345-90cf-47e8-9235-a2b2267145af admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:42.144323 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c095e345-90cf-47e8-9235-a2b2267145af admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:42.150715 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06078dd6-0790-410c-a4ba-54685ef15944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:42.151466 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06078dd6-0790-410c-a4ba-54685ef15944 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:42.151714 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06078dd6-0790-410c-a4ba-54685ef15944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:42.151991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06078dd6-0790-410c-a4ba-54685ef15944 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:42.152691 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06078dd6-0790-410c-a4ba-54685ef15944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:42.154632 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06078dd6-0790-410c-a4ba-54685ef15944 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:42.175126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3c6f3-9264-41d8-a2b0-f1212da49517 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:42.176918 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c3c6f3-9264-41d8-a2b0-f1212da49517 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:42.190693 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1254/2562] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:20:42.192856 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1309/2563] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:42 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:42.197502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06078dd6-0790-410c-a4ba-54685ef15944 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:42.290821 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06078dd6-0790-410c-a4ba-54685ef15944 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:42.301801 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66cdb5-b373-4c7e-9016-715b69bd4cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:42.302776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66cdb5-b373-4c7e-9016-715b69bd4cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:42.303131 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66cdb5-b373-4c7e-9016-715b69bd4cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:42.303525 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66cdb5-b373-4c7e-9016-715b69bd4cf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:42.304356 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66cdb5-b373-4c7e-9016-715b69bd4cf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:42.306884 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66cdb5-b373-4c7e-9016-715b69bd4cf1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:42.339356 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1310/2564] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:42 2022] POST /identity/v3/users => generated 285 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:42.341628 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3c6f3-9264-41d8-a2b0-f1212da49517 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:42.357812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3c6f3-9264-41d8-a2b0-f1212da49517 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:42.370147 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4c9cc-2e43-4a96-a322-38b41cd07203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:42.370951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4c9cc-2e43-4a96-a322-38b41cd07203 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:42.371335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4c9cc-2e43-4a96-a322-38b41cd07203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:42.371806 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4c9cc-2e43-4a96-a322-38b41cd07203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:42.372638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4c9cc-2e43-4a96-a322-38b41cd07203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:42.374583 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4c9cc-2e43-4a96-a322-38b41cd07203 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:42.397219 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1255/2565] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:42.401351 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66cdb5-b373-4c7e-9016-715b69bd4cf1 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:42.426507 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66cdb5-b373-4c7e-9016-715b69bd4cf1 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:42.432033 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddbb39-90e5-4a8d-bd7e-0c57518b0cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:42.432747 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddbb39-90e5-4a8d-bd7e-0c57518b0cbd admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:42.433090 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddbb39-90e5-4a8d-bd7e-0c57518b0cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:42.433387 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddbb39-90e5-4a8d-bd7e-0c57518b0cbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:42.434187 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddbb39-90e5-4a8d-bd7e-0c57518b0cbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:42.436078 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ddbb39-90e5-4a8d-bd7e-0c57518b0cbd admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:42.452568 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1311/2566] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:42 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:20:42.466799 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4c9cc-2e43-4a96-a322-38b41cd07203 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:42.478114 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4c9cc-2e43-4a96-a322-38b41cd07203 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:42.484415 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead23cf-a400-4701-a93b-b7789bd8e4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:42.485505 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead23cf-a400-4701-a93b-b7789bd8e4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:42.485921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead23cf-a400-4701-a93b-b7789bd8e4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:42.486299 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead23cf-a400-4701-a93b-b7789bd8e4e2 admin admin] PATH_INFO: `/v3/projects/4d917620328943e9884dec156ce70b11/users/6f345443c0184b93970574768c26066c/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:42.511541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead23cf-a400-4701-a93b-b7789bd8e4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d917620328943e9884dec156ce70b11, user_id=6f345443c0184b93970574768c26066c, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:42.514504 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead23cf-a400-4701-a93b-b7789bd8e4e2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:42.529233 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1256/2567] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:42 2022] PUT /identity/v3/projects/4d917620328943e9884dec156ce70b11/users/6f345443c0184b93970574768c26066c/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:42.545478 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402c1fc-b6a1-436c-b8bc-9f1204cd71f0 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:42.547618 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402c1fc-b6a1-436c-b8bc-9f1204cd71f0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:42.547848 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402c1fc-b6a1-436c-b8bc-9f1204cd71f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:42.581111 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1402c1fc-b6a1-436c-b8bc-9f1204cd71f0 None None] MFA Rules not processed for user `6f345443c0184b93970574768c26066c`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:42.582471 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1402c1fc-b6a1-436c-b8bc-9f1204cd71f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:42.678053 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1312/2568] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:42.682811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead23cf-a400-4701-a93b-b7789bd8e4e2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:42.760451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402c1fc-b6a1-436c-b8bc-9f1204cd71f0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:42.762025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1402c1fc-b6a1-436c-b8bc-9f1204cd71f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:42.780384 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead23cf-a400-4701-a93b-b7789bd8e4e2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:42.786071 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65399f4-b2a5-4597-9238-44d67e8d929c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:42.786750 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65399f4-b2a5-4597-9238-44d67e8d929c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:42.787030 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65399f4-b2a5-4597-9238-44d67e8d929c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:42.787324 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65399f4-b2a5-4597-9238-44d67e8d929c admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:42.788028 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65399f4-b2a5-4597-9238-44d67e8d929c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:42.790775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65399f4-b2a5-4597-9238-44d67e8d929c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:42.817113 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:42.844576 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402c1fc-b6a1-436c-b8bc-9f1204cd71f0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:42.849290 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1257/2569] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:42 2022] POST /identity/v3/projects => generated 369 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:42.850935 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65399f4-b2a5-4597-9238-44d67e8d929c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:42.919842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:42.924626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa185a-2bc3-453a-b98e-980ab31dcb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:42.925550 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa185a-2bc3-453a-b98e-980ab31dcb5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:42.925911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa185a-2bc3-453a-b98e-980ab31dcb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:42.926216 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa185a-2bc3-453a-b98e-980ab31dcb5e admin admin] PATH_INFO: `/v3/users/aa2dddcc63ec48a8b37001c566159ac6` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:42.927761 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa185a-2bc3-453a-b98e-980ab31dcb5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2dddcc63ec48a8b37001c566159ac6)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:42.929826 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa185a-2bc3-453a-b98e-980ab31dcb5e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:42.963791 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65399f4-b2a5-4597-9238-44d67e8d929c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:42.974645 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa0909-5e41-44b1-a74e-c644a3a22bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:42.976516 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa0909-5e41-44b1-a74e-c644a3a22bbb admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:42.976836 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa0909-5e41-44b1-a74e-c644a3a22bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:42.977102 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aa0909-5e41-44b1-a74e-c644a3a22bbb admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:42.978102 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa0909-5e41-44b1-a74e-c644a3a22bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:42.981527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aa0909-5e41-44b1-a74e-c644a3a22bbb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:42.989819 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-64aa185a-2bc3-453a-b98e-980ab31dcb5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2dddcc63ec48a8b37001c566159ac6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:42.990842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-64aa185a-2bc3-453a-b98e-980ab31dcb5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2dddcc63ec48a8b37001c566159ac6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:43.002482 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-64aa185a-2bc3-453a-b98e-980ab31dcb5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2dddcc63ec48a8b37001c566159ac6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:43.003260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-64aa185a-2bc3-453a-b98e-980ab31dcb5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2dddcc63ec48a8b37001c566159ac6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:43.008454 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1258/2570] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:42 2022] POST /identity/v3/users => generated 291 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:43.012423 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa0909-5e41-44b1-a74e-c644a3a22bbb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:43.014571 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-64aa185a-2bc3-453a-b98e-980ab31dcb5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2dddcc63ec48a8b37001c566159ac6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:43.014880 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-32aa0909-5e41-44b1-a74e-c644a3a22bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:43.030513 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aa0909-5e41-44b1-a74e-c644a3a22bbb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:43.038394 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1313/2571] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:42 2022] DELETE /identity/v3/users/aa2dddcc63ec48a8b37001c566159ac6 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:43.038617 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6452f-bc08-4848-a3c6-0f9bdb7e564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:43.039407 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6452f-bc08-4848-a3c6-0f9bdb7e564c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:43.039760 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6452f-bc08-4848-a3c6-0f9bdb7e564c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:43.040148 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6452f-bc08-4848-a3c6-0f9bdb7e564c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:43.040371 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2067b4-ba0b-4b80-924e-8d2960e0a5ae None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:43.040728 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2067b4-ba0b-4b80-924e-8d2960e0a5ae None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:43.041090 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6452f-bc08-4848-a3c6-0f9bdb7e564c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:43.041204 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2067b4-ba0b-4b80-924e-8d2960e0a5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:43.043277 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba6452f-bc08-4848-a3c6-0f9bdb7e564c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:43.061186 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1259/2572] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:20:43.061614 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-ad2067b4-ba0b-4b80-924e-8d2960e0a5ae None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:43.062958 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ad2067b4-ba0b-4b80-924e-8d2960e0a5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:43.063212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6452f-bc08-4848-a3c6-0f9bdb7e564c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:43.077961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6452f-bc08-4848-a3c6-0f9bdb7e564c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:43.173616 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1314/2573] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:43.177252 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14284c-2bff-4ee1-9b08-b770bb01dccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:43.178381 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14284c-2bff-4ee1-9b08-b770bb01dccb admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:43.178767 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14284c-2bff-4ee1-9b08-b770bb01dccb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:43.179172 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f14284c-2bff-4ee1-9b08-b770bb01dccb admin admin] PATH_INFO: `/v3/projects/bc86b191fe1a4e12b27087d3d22a63cf/users/de322bca3a2a499cae11bd33857a65d9/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:43.186543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2067b4-ba0b-4b80-924e-8d2960e0a5ae None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:43.188011 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ad2067b4-ba0b-4b80-924e-8d2960e0a5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:43.198682 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14284c-2bff-4ee1-9b08-b770bb01dccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc86b191fe1a4e12b27087d3d22a63cf, user_id=de322bca3a2a499cae11bd33857a65d9, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:43.204751 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f14284c-2bff-4ee1-9b08-b770bb01dccb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:43.212686 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:43.233302 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1260/2574] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:43 2022] PUT /identity/v3/projects/bc86b191fe1a4e12b27087d3d22a63cf/users/de322bca3a2a499cae11bd33857a65d9/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:43.240627 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14284c-2bff-4ee1-9b08-b770bb01dccb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:43.296350 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2067b4-ba0b-4b80-924e-8d2960e0a5ae None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:43.357615 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f14284c-2bff-4ee1-9b08-b770bb01dccb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:43.363013 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56101f9b-b43f-4544-8656-562d8c3e244f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:43.364842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56101f9b-b43f-4544-8656-562d8c3e244f service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:43.365262 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56101f9b-b43f-4544-8656-562d8c3e244f service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:43.365536 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56101f9b-b43f-4544-8656-562d8c3e244f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:43.368898 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc392b-25ff-44a5-b94a-29bd6efa1e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:43.369669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc392b-25ff-44a5-b94a-29bd6efa1e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:43.370318 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc392b-25ff-44a5-b94a-29bd6efa1e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:43.370432 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc392b-25ff-44a5-b94a-29bd6efa1e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:43.371581 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc392b-25ff-44a5-b94a-29bd6efa1e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:43.374003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc392b-25ff-44a5-b94a-29bd6efa1e78 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:43.380367 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56101f9b-b43f-4544-8656-562d8c3e244f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:43.382259 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56101f9b-b43f-4544-8656-562d8c3e244f service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:43.389963 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1261/2575] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:43.394337 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc392b-25ff-44a5-b94a-29bd6efa1e78 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:43.396139 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1315/2576] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:43.412308 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc392b-25ff-44a5-b94a-29bd6efa1e78 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:43.418084 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1593c-fbe2-48f2-8916-ec38ef74e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:43.419530 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1593c-fbe2-48f2-8916-ec38ef74e13c admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:43.419938 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1593c-fbe2-48f2-8916-ec38ef74e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:43.420320 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1593c-fbe2-48f2-8916-ec38ef74e13c admin admin] PATH_INFO: `/v3/projects/bc86b191fe1a4e12b27087d3d22a63cf/users/de322bca3a2a499cae11bd33857a65d9/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:43.422925 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1593c-fbe2-48f2-8916-ec38ef74e13c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc86b191fe1a4e12b27087d3d22a63cf, user_id=de322bca3a2a499cae11bd33857a65d9, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:43.428308 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca1593c-fbe2-48f2-8916-ec38ef74e13c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:43.440379 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1262/2577] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:43 2022] PUT /identity/v3/projects/bc86b191fe1a4e12b27087d3d22a63cf/users/de322bca3a2a499cae11bd33857a65d9/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:43.452966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c5e04-4fdf-4a00-a2f8-437aec2c997a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:43.453757 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c5e04-4fdf-4a00-a2f8-437aec2c997a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:43.454184 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c5e04-4fdf-4a00-a2f8-437aec2c997a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:43.488793 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f93c5e04-4fdf-4a00-a2f8-437aec2c997a None None] MFA Rules not processed for user `de322bca3a2a499cae11bd33857a65d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:43.490847 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f93c5e04-4fdf-4a00-a2f8-437aec2c997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:43.573763 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1316/2578] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:43 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:43.585986 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1593c-fbe2-48f2-8916-ec38ef74e13c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:43.588018 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6ca1593c-fbe2-48f2-8916-ec38ef74e13c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:43.623715 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:43.694181 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca1593c-fbe2-48f2-8916-ec38ef74e13c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:43.698110 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895975f-ab0c-4bf0-abb2-438938eaf645 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:43.698849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895975f-ab0c-4bf0-abb2-438938eaf645 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:43.699195 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895975f-ab0c-4bf0-abb2-438938eaf645 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:43.699596 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895975f-ab0c-4bf0-abb2-438938eaf645 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:43.712894 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895975f-ab0c-4bf0-abb2-438938eaf645 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:43.713304 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895975f-ab0c-4bf0-abb2-438938eaf645 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:43.728533 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1263/2579] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:43 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:43.882656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c5e04-4fdf-4a00-a2f8-437aec2c997a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:43.884351 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f93c5e04-4fdf-4a00-a2f8-437aec2c997a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:43.989725 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:44.012340 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c5e04-4fdf-4a00-a2f8-437aec2c997a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:44.023266 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38866bb-bf18-43e5-91bd-07476aeea00b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:44.026811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38866bb-bf18-43e5-91bd-07476aeea00b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:44.027946 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38866bb-bf18-43e5-91bd-07476aeea00b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:44.028343 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38866bb-bf18-43e5-91bd-07476aeea00b admin admin] PATH_INFO: `/v3/projects/6319be45a08e40e4af76b9ae84f6330b` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:44.030264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38866bb-bf18-43e5-91bd-07476aeea00b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6319be45a08e40e4af76b9ae84f6330b)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:44.033619 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38866bb-bf18-43e5-91bd-07476aeea00b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:44.119733 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e38866bb-bf18-43e5-91bd-07476aeea00b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6319be45a08e40e4af76b9ae84f6330b', 'request_id': 'req-e38866bb-bf18-43e5-91bd-07476aeea00b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:44.128932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e38866bb-bf18-43e5-91bd-07476aeea00b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6319be45a08e40e4af76b9ae84f6330b', 'request_id': 'req-e38866bb-bf18-43e5-91bd-07476aeea00b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:44.135480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e38866bb-bf18-43e5-91bd-07476aeea00b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6319be45a08e40e4af76b9ae84f6330b', 'request_id': 'req-e38866bb-bf18-43e5-91bd-07476aeea00b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:44.159229 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e38866bb-bf18-43e5-91bd-07476aeea00b admin admin] The token cache is being invalidate because project 6319be45a08e40e4af76b9ae84f6330b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:44.159602 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e38866bb-bf18-43e5-91bd-07476aeea00b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:44.160515 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e38866bb-bf18-43e5-91bd-07476aeea00b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:44.162233 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1317/2580] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:43 2022] DELETE /identity/v3/projects/6319be45a08e40e4af76b9ae84f6330b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:44.166913 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895975f-ab0c-4bf0-abb2-438938eaf645 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:44.178034 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895975f-ab0c-4bf0-abb2-438938eaf645 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:44.265945 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8579b0-3875-4897-8cc7-be5747ec7e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:44.266934 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8579b0-3875-4897-8cc7-be5747ec7e97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:44.267285 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8579b0-3875-4897-8cc7-be5747ec7e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:44.267675 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8579b0-3875-4897-8cc7-be5747ec7e97 admin admin] PATH_INFO: `/v3/users/a77e5c56b5b5479191423de454d31f8b` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:44.268953 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8579b0-3875-4897-8cc7-be5747ec7e97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a77e5c56b5b5479191423de454d31f8b)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:44.270971 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8579b0-3875-4897-8cc7-be5747ec7e97 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:44.361527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9c8579b0-3875-4897-8cc7-be5747ec7e97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a77e5c56b5b5479191423de454d31f8b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:44.362331 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9c8579b0-3875-4897-8cc7-be5747ec7e97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a77e5c56b5b5479191423de454d31f8b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:44.363037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9c8579b0-3875-4897-8cc7-be5747ec7e97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a77e5c56b5b5479191423de454d31f8b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:44.388704 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9c8579b0-3875-4897-8cc7-be5747ec7e97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a77e5c56b5b5479191423de454d31f8b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:44.420134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9c8579b0-3875-4897-8cc7-be5747ec7e97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a77e5c56b5b5479191423de454d31f8b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:44.454790 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1264/2581] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:44 2022] DELETE /identity/v3/users/a77e5c56b5b5479191423de454d31f8b => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:44.969743 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38866bb-bf18-43e5-91bd-07476aeea00b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:44.971241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e38866bb-bf18-43e5-91bd-07476aeea00b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:45.000176 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38866bb-bf18-43e5-91bd-07476aeea00b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:45.127597 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e1a53-f3aa-4745-a5a4-a59b004699b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:45.128789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e1a53-f3aa-4745-a5a4-a59b004699b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:45.129076 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e1a53-f3aa-4745-a5a4-a59b004699b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:45.129407 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e1a53-f3aa-4745-a5a4-a59b004699b3 admin admin] PATH_INFO: `/v3/projects/b3f515dbcf3640019a0650c78bc224c4` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:45.135489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e1a53-f3aa-4745-a5a4-a59b004699b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3f515dbcf3640019a0650c78bc224c4)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:45.135489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e1a53-f3aa-4745-a5a4-a59b004699b3 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:45.199971 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e00e1a53-f3aa-4745-a5a4-a59b004699b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3f515dbcf3640019a0650c78bc224c4', 'request_id': 'req-e00e1a53-f3aa-4745-a5a4-a59b004699b3'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:45.210951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e00e1a53-f3aa-4745-a5a4-a59b004699b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3f515dbcf3640019a0650c78bc224c4', 'request_id': 'req-e00e1a53-f3aa-4745-a5a4-a59b004699b3'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:45.217291 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e00e1a53-f3aa-4745-a5a4-a59b004699b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3f515dbcf3640019a0650c78bc224c4', 'request_id': 'req-e00e1a53-f3aa-4745-a5a4-a59b004699b3'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:45.235417 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e00e1a53-f3aa-4745-a5a4-a59b004699b3 admin admin] The token cache is being invalidate because project b3f515dbcf3640019a0650c78bc224c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:45.235733 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e00e1a53-f3aa-4745-a5a4-a59b004699b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:45.236388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-e00e1a53-f3aa-4745-a5a4-a59b004699b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:45.239460 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1318/2582] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:44 2022] DELETE /identity/v3/projects/b3f515dbcf3640019a0650c78bc224c4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:45.244507 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8724288-0320-40f5-9948-cca6202cc113 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:45.245019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8724288-0320-40f5-9948-cca6202cc113 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:45.245019 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8724288-0320-40f5-9948-cca6202cc113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:45.264462 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d8724288-0320-40f5-9948-cca6202cc113 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:45.265684 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d8724288-0320-40f5-9948-cca6202cc113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:45.325028 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:45.355763 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1265/2583] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:45.362264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc2d19-54d8-47c1-a7a4-585242ed1e01 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:45.362701 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc2d19-54d8-47c1-a7a4-585242ed1e01 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:45.363047 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bc2d19-54d8-47c1-a7a4-585242ed1e01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:45.386414 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-02bc2d19-54d8-47c1-a7a4-585242ed1e01 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:45.388410 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-02bc2d19-54d8-47c1-a7a4-585242ed1e01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:45.397097 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1319/2584] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:20:45.401702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8724288-0320-40f5-9948-cca6202cc113 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:45.423836 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8724288-0320-40f5-9948-cca6202cc113 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:45.435422 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a84a5-7706-41f9-bec8-1071e4537c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:45.436194 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a84a5-7706-41f9-bec8-1071e4537c14 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:45.436553 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a84a5-7706-41f9-bec8-1071e4537c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:45.437203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a84a5-7706-41f9-bec8-1071e4537c14 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:45.437700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a84a5-7706-41f9-bec8-1071e4537c14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:45.438088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a84a5-7706-41f9-bec8-1071e4537c14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:45.439829 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a84a5-7706-41f9-bec8-1071e4537c14 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:45.453758 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1266/2585] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:20:45.458339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc2d19-54d8-47c1-a7a4-585242ed1e01 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:45.475815 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bc2d19-54d8-47c1-a7a4-585242ed1e01 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:45.481064 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5ca59-ce81-4f8c-90e9-38c6839e745d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:45.482704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5ca59-ce81-4f8c-90e9-38c6839e745d admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:45.482704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5ca59-ce81-4f8c-90e9-38c6839e745d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:45.482704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e5ca59-ce81-4f8c-90e9-38c6839e745d admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:45.483509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5ca59-ce81-4f8c-90e9-38c6839e745d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:45.486090 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e5ca59-ce81-4f8c-90e9-38c6839e745d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:45.490135 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:45.535354 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1320/2586] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:45 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:45.536795 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a84a5-7706-41f9-bec8-1071e4537c14 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:45.548486 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a84a5-7706-41f9-bec8-1071e4537c14 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:45.632472 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59213b76-9066-4474-95ec-fa034667295a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:45.633160 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59213b76-9066-4474-95ec-fa034667295a admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:45.633444 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59213b76-9066-4474-95ec-fa034667295a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:45.633725 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59213b76-9066-4474-95ec-fa034667295a admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:45.634574 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59213b76-9066-4474-95ec-fa034667295a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:45.637256 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59213b76-9066-4474-95ec-fa034667295a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:45.666950 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1267/2587] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:45 2022] POST /identity/v3/users => generated 293 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:45.671566 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5ca59-ce81-4f8c-90e9-38c6839e745d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:45.686602 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e5ca59-ce81-4f8c-90e9-38c6839e745d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:45.692584 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537e1e6-e8a0-4dcd-ba52-fd3bc7fb582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:45.694789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e1e6-e8a0-4dcd-ba52-fd3bc7fb582a admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:45.694789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e1e6-e8a0-4dcd-ba52-fd3bc7fb582a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:45.694789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b537e1e6-e8a0-4dcd-ba52-fd3bc7fb582a admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:45.700860 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59213b76-9066-4474-95ec-fa034667295a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:45.702616 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-59213b76-9066-4474-95ec-fa034667295a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:45.706693 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537e1e6-e8a0-4dcd-ba52-fd3bc7fb582a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:45.708901 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b537e1e6-e8a0-4dcd-ba52-fd3bc7fb582a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:45.716832 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59213b76-9066-4474-95ec-fa034667295a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:45.723812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98e809-b75d-4958-87f8-2cfd0501b661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:45.726247 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98e809-b75d-4958-87f8-2cfd0501b661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:45.727781 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98e809-b75d-4958-87f8-2cfd0501b661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:45.728138 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98e809-b75d-4958-87f8-2cfd0501b661 admin admin] PATH_INFO: `/v3/users/6f345443c0184b93970574768c26066c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:45.730994 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1321/2588] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:45.731989 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98e809-b75d-4958-87f8-2cfd0501b661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f345443c0184b93970574768c26066c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:45.735042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537e1e6-e8a0-4dcd-ba52-fd3bc7fb582a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:45.735713 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98e809-b75d-4958-87f8-2cfd0501b661 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:45.745718 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b537e1e6-e8a0-4dcd-ba52-fd3bc7fb582a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:45.750602 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65adee1-82ea-4110-aa15-619965a7abc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:45.751289 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65adee1-82ea-4110-aa15-619965a7abc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:45.751605 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65adee1-82ea-4110-aa15-619965a7abc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:45.751891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65adee1-82ea-4110-aa15-619965a7abc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:45.752807 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65adee1-82ea-4110-aa15-619965a7abc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:45.754446 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65adee1-82ea-4110-aa15-619965a7abc5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:45.770338 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1322/2589] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:20:45.784078 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65adee1-82ea-4110-aa15-619965a7abc5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:45.806668 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65adee1-82ea-4110-aa15-619965a7abc5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:45.820208 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebdc88a-d386-4fe4-963c-6af8b13e7d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:45.821105 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdc88a-d386-4fe4-963c-6af8b13e7d9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:45.821424 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdc88a-d386-4fe4-963c-6af8b13e7d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:45.821706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebdc88a-d386-4fe4-963c-6af8b13e7d9b admin admin] PATH_INFO: `/v3/projects/8f6d6d0a2e3949cb9fc7900ea6a756c6/users/48c39c7feed0400b9e47c5598e4e60dd/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:45.834031 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8b98e809-b75d-4958-87f8-2cfd0501b661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f345443c0184b93970574768c26066c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:45.834842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8b98e809-b75d-4958-87f8-2cfd0501b661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f345443c0184b93970574768c26066c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:45.835584 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8b98e809-b75d-4958-87f8-2cfd0501b661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f345443c0184b93970574768c26066c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:45.842933 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebdc88a-d386-4fe4-963c-6af8b13e7d9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f6d6d0a2e3949cb9fc7900ea6a756c6, user_id=48c39c7feed0400b9e47c5598e4e60dd, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:45.846663 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebdc88a-d386-4fe4-963c-6af8b13e7d9b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:45.849740 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8b98e809-b75d-4958-87f8-2cfd0501b661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f345443c0184b93970574768c26066c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:45.864552 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8b98e809-b75d-4958-87f8-2cfd0501b661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f345443c0184b93970574768c26066c'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:45.871348 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1323/2590] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:45 2022] PUT /identity/v3/projects/8f6d6d0a2e3949cb9fc7900ea6a756c6/users/48c39c7feed0400b9e47c5598e4e60dd/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:45.885122 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca2fe8-e694-433d-bb0e-2dd7764b0323 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:45.885743 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca2fe8-e694-433d-bb0e-2dd7764b0323 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:45.886370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca2fe8-e694-433d-bb0e-2dd7764b0323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:45.895805 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1268/2591] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:45 2022] DELETE /identity/v3/users/6f345443c0184b93970574768c26066c => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:45.903148 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7b532-a771-47fd-af8b-0d0ce84fc412 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:45.903587 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7b532-a771-47fd-af8b-0d0ce84fc412 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:45.903971 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7b532-a771-47fd-af8b-0d0ce84fc412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:45.924312 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-97ca2fe8-e694-433d-bb0e-2dd7764b0323 None None] MFA Rules not processed for user `48c39c7feed0400b9e47c5598e4e60dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:45.925715 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-97ca2fe8-e694-433d-bb0e-2dd7764b0323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:45.926133 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-74b7b532-a771-47fd-af8b-0d0ce84fc412 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:45.930945 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-74b7b532-a771-47fd-af8b-0d0ce84fc412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:45.975810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:46.019953 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1269/2592] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:46.032061 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1324/2593] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:46.038329 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7b532-a771-47fd-af8b-0d0ce84fc412 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:46.039837 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-74b7b532-a771-47fd-af8b-0d0ce84fc412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:46.044702 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca2fe8-e694-433d-bb0e-2dd7764b0323 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:46.046742 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-97ca2fe8-e694-433d-bb0e-2dd7764b0323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:46.053160 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7b532-a771-47fd-af8b-0d0ce84fc412 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:46.059369 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064fa15-71e0-461a-87ea-a5fedafddef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:46.060246 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064fa15-71e0-461a-87ea-a5fedafddef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:46.060537 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064fa15-71e0-461a-87ea-a5fedafddef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:46.060818 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b064fa15-71e0-461a-87ea-a5fedafddef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:46.061653 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064fa15-71e0-461a-87ea-a5fedafddef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:46.063931 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b064fa15-71e0-461a-87ea-a5fedafddef5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:46.100536 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1270/2594] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:46 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:46.101410 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064fa15-71e0-461a-87ea-a5fedafddef5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:46.134462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca2fe8-e694-433d-bb0e-2dd7764b0323 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:46.190060 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:46.193339 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b064fa15-71e0-461a-87ea-a5fedafddef5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:46.198780 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea70cb2-29a7-4e3e-a907-ed30aab50caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:46.199503 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea70cb2-29a7-4e3e-a907-ed30aab50caf admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:46.200317 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea70cb2-29a7-4e3e-a907-ed30aab50caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:46.200317 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea70cb2-29a7-4e3e-a907-ed30aab50caf admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:46.200862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea70cb2-29a7-4e3e-a907-ed30aab50caf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:46.203038 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea70cb2-29a7-4e3e-a907-ed30aab50caf admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:46.203795 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9fd5e-b7e1-4307-bc32-85f1f9a4a381 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:46.204271 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9fd5e-b7e1-4307-bc32-85f1f9a4a381 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:46.204557 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9fd5e-b7e1-4307-bc32-85f1f9a4a381 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:46.204836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a9fd5e-b7e1-4307-bc32-85f1f9a4a381 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:46.215631 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9fd5e-b7e1-4307-bc32-85f1f9a4a381 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:46.217189 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a9fd5e-b7e1-4307-bc32-85f1f9a4a381 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:46.233405 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1271/2595] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:46 2022] POST /identity/v3/users => generated 299 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:46.233617 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1325/2596] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:20:46.234627 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea70cb2-29a7-4e3e-a907-ed30aab50caf admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:46.244982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea70cb2-29a7-4e3e-a907-ed30aab50caf admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:46.252112 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3555a-91f0-4c0a-8ac5-f67835d41a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:46.253258 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3555a-91f0-4c0a-8ac5-f67835d41a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:46.253258 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3555a-91f0-4c0a-8ac5-f67835d41a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:46.253434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3555a-91f0-4c0a-8ac5-f67835d41a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:46.254129 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3555a-91f0-4c0a-8ac5-f67835d41a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:46.255819 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3555a-91f0-4c0a-8ac5-f67835d41a64 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:46.270495 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1272/2597] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:20:46.271718 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9fd5e-b7e1-4307-bc32-85f1f9a4a381 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:46.282114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a9fd5e-b7e1-4307-bc32-85f1f9a4a381 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:46.288438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558825e8-8a54-4770-b110-66debf35254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:46.289615 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558825e8-8a54-4770-b110-66debf35254a admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:46.289615 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558825e8-8a54-4770-b110-66debf35254a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:46.289900 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558825e8-8a54-4770-b110-66debf35254a admin admin] PATH_INFO: `/v3/projects/c2dbb365ac60421e83baccf67df934bf/users/0c4ad6a48d5345309f83f0a434465d03/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:46.314062 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558825e8-8a54-4770-b110-66debf35254a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dbb365ac60421e83baccf67df934bf, user_id=0c4ad6a48d5345309f83f0a434465d03, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:46.317257 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558825e8-8a54-4770-b110-66debf35254a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:46.335490 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1326/2598] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:46 2022] PUT /identity/v3/projects/c2dbb365ac60421e83baccf67df934bf/users/0c4ad6a48d5345309f83f0a434465d03/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:46.339549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3555a-91f0-4c0a-8ac5-f67835d41a64 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:46.353201 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3555a-91f0-4c0a-8ac5-f67835d41a64 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:46.429918 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eb41b-f822-4266-bdbc-bd6a816b2c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:46.431327 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb41b-f822-4266-bdbc-bd6a816b2c75 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:46.432212 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb41b-f822-4266-bdbc-bd6a816b2c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:46.432694 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eb41b-f822-4266-bdbc-bd6a816b2c75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:46.433783 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eb41b-f822-4266-bdbc-bd6a816b2c75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:46.444585 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eb41b-f822-4266-bdbc-bd6a816b2c75 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:46.465837 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1273/2599] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:46 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:46.467114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558825e8-8a54-4770-b110-66debf35254a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:46.481889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558825e8-8a54-4770-b110-66debf35254a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:46.493616 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2feeb54-ea9f-4d38-b35f-c5e4e97123e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:46.494645 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2feeb54-ea9f-4d38-b35f-c5e4e97123e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:46.495427 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2feeb54-ea9f-4d38-b35f-c5e4e97123e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:46.495722 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2feeb54-ea9f-4d38-b35f-c5e4e97123e7 admin admin] PATH_INFO: `/v3/projects/c2dbb365ac60421e83baccf67df934bf/users/0c4ad6a48d5345309f83f0a434465d03/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:46.498419 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2feeb54-ea9f-4d38-b35f-c5e4e97123e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2dbb365ac60421e83baccf67df934bf, user_id=0c4ad6a48d5345309f83f0a434465d03, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:46.501259 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2feeb54-ea9f-4d38-b35f-c5e4e97123e7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:46.518196 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1327/2600] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:46 2022] PUT /identity/v3/projects/c2dbb365ac60421e83baccf67df934bf/users/0c4ad6a48d5345309f83f0a434465d03/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:46.528763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88add262-d0be-4fa9-bb82-105fd1b0dc43 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:46.529063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88add262-d0be-4fa9-bb82-105fd1b0dc43 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:46.529349 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88add262-d0be-4fa9-bb82-105fd1b0dc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:46.571526 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-88add262-d0be-4fa9-bb82-105fd1b0dc43 None None] MFA Rules not processed for user `0c4ad6a48d5345309f83f0a434465d03`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:46.573073 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-88add262-d0be-4fa9-bb82-105fd1b0dc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:46.591698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:46.598599 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2feeb54-ea9f-4d38-b35f-c5e4e97123e7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:46.603828 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e2feeb54-ea9f-4d38-b35f-c5e4e97123e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:46.705944 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1274/2601] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:46.717612 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88add262-d0be-4fa9-bb82-105fd1b0dc43 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:46.719093 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-88add262-d0be-4fa9-bb82-105fd1b0dc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:46.723058 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2feeb54-ea9f-4d38-b35f-c5e4e97123e7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:46.728706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e118c3a-3e38-4cec-86d5-8881bd71bdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:46.729787 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e118c3a-3e38-4cec-86d5-8881bd71bdda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:46.730167 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e118c3a-3e38-4cec-86d5-8881bd71bdda admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:46.730521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e118c3a-3e38-4cec-86d5-8881bd71bdda admin admin] PATH_INFO: `/v3/projects/4d917620328943e9884dec156ce70b11` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:46.731846 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e118c3a-3e38-4cec-86d5-8881bd71bdda admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d917620328943e9884dec156ce70b11)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:46.736485 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e118c3a-3e38-4cec-86d5-8881bd71bdda admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:46.799304 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88add262-d0be-4fa9-bb82-105fd1b0dc43 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:46.805482 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5e118c3a-3e38-4cec-86d5-8881bd71bdda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d917620328943e9884dec156ce70b11', 'request_id': 'req-5e118c3a-3e38-4cec-86d5-8881bd71bdda'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:46.812996 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5e118c3a-3e38-4cec-86d5-8881bd71bdda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d917620328943e9884dec156ce70b11', 'request_id': 'req-5e118c3a-3e38-4cec-86d5-8881bd71bdda'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:46.820353 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5e118c3a-3e38-4cec-86d5-8881bd71bdda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d917620328943e9884dec156ce70b11', 'request_id': 'req-5e118c3a-3e38-4cec-86d5-8881bd71bdda'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:46.837296 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5e118c3a-3e38-4cec-86d5-8881bd71bdda admin admin] The token cache is being invalidate because project 4d917620328943e9884dec156ce70b11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:46.837649 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5e118c3a-3e38-4cec-86d5-8881bd71bdda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:46.838975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5e118c3a-3e38-4cec-86d5-8881bd71bdda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:46.840685 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1328/2602] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:46 2022] DELETE /identity/v3/projects/4d917620328943e9884dec156ce70b11 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:46.844694 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e118c3a-3e38-4cec-86d5-8881bd71bdda admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:46.846247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5e118c3a-3e38-4cec-86d5-8881bd71bdda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:46.863208 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd238f-4058-4e78-9d1b-2af836be235a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:46.864308 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd238f-4058-4e78-9d1b-2af836be235a service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:46.864664 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd238f-4058-4e78-9d1b-2af836be235a service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:46.865006 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd238f-4058-4e78-9d1b-2af836be235a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:46.867031 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2dbd238f-4058-4e78-9d1b-2af836be235a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:46.896448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:46.939557 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e118c3a-3e38-4cec-86d5-8881bd71bdda admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:46.949619 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a672afe6-ae9b-4ef5-a901-e439e624a2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:46.950546 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672afe6-ae9b-4ef5-a901-e439e624a2af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:46.951035 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672afe6-ae9b-4ef5-a901-e439e624a2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:46.951568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a672afe6-ae9b-4ef5-a901-e439e624a2af admin admin] PATH_INFO: `/v3/users/de322bca3a2a499cae11bd33857a65d9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:46.952595 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672afe6-ae9b-4ef5-a901-e439e624a2af admin admin] RBAC: Authorizing `identity:delete_user(user_id=de322bca3a2a499cae11bd33857a65d9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:46.954707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a672afe6-ae9b-4ef5-a901-e439e624a2af admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:46.956517 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd238f-4058-4e78-9d1b-2af836be235a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:46.958122 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd238f-4058-4e78-9d1b-2af836be235a service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:46.969518 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1275/2603] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:20:47.019694 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a672afe6-ae9b-4ef5-a901-e439e624a2af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de322bca3a2a499cae11bd33857a65d9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:47.020841 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a672afe6-ae9b-4ef5-a901-e439e624a2af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de322bca3a2a499cae11bd33857a65d9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:47.029769 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a672afe6-ae9b-4ef5-a901-e439e624a2af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de322bca3a2a499cae11bd33857a65d9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:47.030568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a672afe6-ae9b-4ef5-a901-e439e624a2af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de322bca3a2a499cae11bd33857a65d9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:47.039550 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a672afe6-ae9b-4ef5-a901-e439e624a2af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de322bca3a2a499cae11bd33857a65d9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:47.066964 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1329/2604] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:46 2022] DELETE /identity/v3/users/de322bca3a2a499cae11bd33857a65d9 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:47.371222 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd238f-4058-4e78-9d1b-2af836be235a service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:47.381934 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd238f-4058-4e78-9d1b-2af836be235a service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:47.400804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:47.451422 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b85c00-f9ca-48de-9eee-130fec0eb849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:47.452321 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b85c00-f9ca-48de-9eee-130fec0eb849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:47.452607 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b85c00-f9ca-48de-9eee-130fec0eb849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:47.452890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b85c00-f9ca-48de-9eee-130fec0eb849 admin admin] PATH_INFO: `/v3/projects/bc86b191fe1a4e12b27087d3d22a63cf` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:47.454103 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b85c00-f9ca-48de-9eee-130fec0eb849 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc86b191fe1a4e12b27087d3d22a63cf)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:47.456077 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b85c00-f9ca-48de-9eee-130fec0eb849 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:47.514498 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-03b85c00-f9ca-48de-9eee-130fec0eb849 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc86b191fe1a4e12b27087d3d22a63cf', 'request_id': 'req-03b85c00-f9ca-48de-9eee-130fec0eb849'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:47.522901 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-03b85c00-f9ca-48de-9eee-130fec0eb849 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc86b191fe1a4e12b27087d3d22a63cf', 'request_id': 'req-03b85c00-f9ca-48de-9eee-130fec0eb849'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:47.529495 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-03b85c00-f9ca-48de-9eee-130fec0eb849 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc86b191fe1a4e12b27087d3d22a63cf', 'request_id': 'req-03b85c00-f9ca-48de-9eee-130fec0eb849'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:47.542257 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-03b85c00-f9ca-48de-9eee-130fec0eb849 admin admin] The token cache is being invalidate because project bc86b191fe1a4e12b27087d3d22a63cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:47.542548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-03b85c00-f9ca-48de-9eee-130fec0eb849 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:47.543263 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-03b85c00-f9ca-48de-9eee-130fec0eb849 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:47.544917 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1276/2605] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:47 2022] DELETE /identity/v3/projects/bc86b191fe1a4e12b27087d3d22a63cf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:47.550229 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93022568-6c59-4340-9e1a-fb5f0fd951f9 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:47.550523 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93022568-6c59-4340-9e1a-fb5f0fd951f9 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:47.550801 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93022568-6c59-4340-9e1a-fb5f0fd951f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:47.569889 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-93022568-6c59-4340-9e1a-fb5f0fd951f9 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:47.571062 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-93022568-6c59-4340-9e1a-fb5f0fd951f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:47.611623 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b85c00-f9ca-48de-9eee-130fec0eb849 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:47.613010 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-03b85c00-f9ca-48de-9eee-130fec0eb849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:47.634166 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1330/2606] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:47.641865 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809f27f-af9b-4a29-ae36-51b8fe2da3fc None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:47.642151 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809f27f-af9b-4a29-ae36-51b8fe2da3fc None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:47.642426 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5809f27f-af9b-4a29-ae36-51b8fe2da3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:47.660495 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5809f27f-af9b-4a29-ae36-51b8fe2da3fc None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:47.661716 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5809f27f-af9b-4a29-ae36-51b8fe2da3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:47.670189 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1331/2607] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:20:47.674818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809f27f-af9b-4a29-ae36-51b8fe2da3fc None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:47.678647 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b85c00-f9ca-48de-9eee-130fec0eb849 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:47.683901 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7020544-35e7-473a-aeb8-133e815c5f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:47.684820 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7020544-35e7-473a-aeb8-133e815c5f9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:47.685134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7020544-35e7-473a-aeb8-133e815c5f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:47.685381 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7020544-35e7-473a-aeb8-133e815c5f9c admin admin] PATH_INFO: `/v3/users/48c39c7feed0400b9e47c5598e4e60dd` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:47.685493 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5809f27f-af9b-4a29-ae36-51b8fe2da3fc None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:47.686618 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7020544-35e7-473a-aeb8-133e815c5f9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=48c39c7feed0400b9e47c5598e4e60dd)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:47.688640 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7020544-35e7-473a-aeb8-133e815c5f9c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:47.690300 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67439c1-30e6-4657-90ba-9afb49d6ed9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:47.690948 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67439c1-30e6-4657-90ba-9afb49d6ed9a admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:47.691232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67439c1-30e6-4657-90ba-9afb49d6ed9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:47.691535 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67439c1-30e6-4657-90ba-9afb49d6ed9a admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:47.692256 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67439c1-30e6-4657-90ba-9afb49d6ed9a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:47.692563 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67439c1-30e6-4657-90ba-9afb49d6ed9a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:47.694145 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67439c1-30e6-4657-90ba-9afb49d6ed9a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:47.706344 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1332/2608] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:20:47.710995 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67439c1-30e6-4657-90ba-9afb49d6ed9a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:47.721000 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67439c1-30e6-4657-90ba-9afb49d6ed9a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:47.725651 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71c1e5-d04a-4aa0-8a4b-8aa7f67503c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:47.726292 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71c1e5-d04a-4aa0-8a4b-8aa7f67503c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:47.726577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71c1e5-d04a-4aa0-8a4b-8aa7f67503c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:47.726855 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a71c1e5-d04a-4aa0-8a4b-8aa7f67503c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:47.727586 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71c1e5-d04a-4aa0-8a4b-8aa7f67503c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:47.729549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a71c1e5-d04a-4aa0-8a4b-8aa7f67503c1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:47.735877 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c7020544-35e7-473a-aeb8-133e815c5f9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48c39c7feed0400b9e47c5598e4e60dd'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:47.736536 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c7020544-35e7-473a-aeb8-133e815c5f9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48c39c7feed0400b9e47c5598e4e60dd'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:47.737142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c7020544-35e7-473a-aeb8-133e815c5f9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48c39c7feed0400b9e47c5598e4e60dd'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:47.739134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:47.747570 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c7020544-35e7-473a-aeb8-133e815c5f9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48c39c7feed0400b9e47c5598e4e60dd'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:47.756058 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1333/2609] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:47 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:20:47.760517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71c1e5-d04a-4aa0-8a4b-8aa7f67503c1 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:47.760974 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-c7020544-35e7-473a-aeb8-133e815c5f9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48c39c7feed0400b9e47c5598e4e60dd'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:47.762173 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5a71c1e5-d04a-4aa0-8a4b-8aa7f67503c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:47.774760 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1277/2610] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:47 2022] DELETE /identity/v3/users/48c39c7feed0400b9e47c5598e4e60dd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:47.779102 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4bc3f-925a-4529-98bb-f9538eddaa05 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:47.779420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4bc3f-925a-4529-98bb-f9538eddaa05 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:47.779696 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a4bc3f-925a-4529-98bb-f9538eddaa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:47.782509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:47.797681 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-07a4bc3f-925a-4529-98bb-f9538eddaa05 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:47.799316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-07a4bc3f-925a-4529-98bb-f9538eddaa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:47.834500 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a71c1e5-d04a-4aa0-8a4b-8aa7f67503c1 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:47.864731 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1278/2611] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:20:47.876463 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4bc3f-925a-4529-98bb-f9538eddaa05 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:47.877906 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-07a4bc3f-925a-4529-98bb-f9538eddaa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:47.906969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842609b-20e6-486c-8030-6ff6ee48e463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:47.907719 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842609b-20e6-486c-8030-6ff6ee48e463 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:47.908006 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842609b-20e6-486c-8030-6ff6ee48e463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:47.908288 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d842609b-20e6-486c-8030-6ff6ee48e463 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:47.908985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842609b-20e6-486c-8030-6ff6ee48e463 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:47.910938 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d842609b-20e6-486c-8030-6ff6ee48e463 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:47.941724 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1334/2612] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:47 2022] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:20:47.944475 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a4bc3f-925a-4529-98bb-f9538eddaa05 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:47.945961 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842609b-20e6-486c-8030-6ff6ee48e463 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:47.948275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498bb69-e9b1-4d34-9a88-c8b01fc3f2c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:47.948960 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498bb69-e9b1-4d34-9a88-c8b01fc3f2c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:47.949267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498bb69-e9b1-4d34-9a88-c8b01fc3f2c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:47.949545 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0498bb69-e9b1-4d34-9a88-c8b01fc3f2c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:47.955480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d842609b-20e6-486c-8030-6ff6ee48e463 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:47.959628 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498bb69-e9b1-4d34-9a88-c8b01fc3f2c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:47.960568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf377e6-b9ab-4726-b36a-c197594d6be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:47.961106 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0498bb69-e9b1-4d34-9a88-c8b01fc3f2c1 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:47.961281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf377e6-b9ab-4726-b36a-c197594d6be2 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:47.961645 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf377e6-b9ab-4726-b36a-c197594d6be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:47.961954 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf377e6-b9ab-4726-b36a-c197594d6be2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:47.962705 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf377e6-b9ab-4726-b36a-c197594d6be2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:47.964388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf377e6-b9ab-4726-b36a-c197594d6be2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:47.971539 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1279/2613] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:47.977326 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1335/2614] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:47.979588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498bb69-e9b1-4d34-9a88-c8b01fc3f2c1 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:47.989238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0498bb69-e9b1-4d34-9a88-c8b01fc3f2c1 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:47.993912 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40281666-e1e4-40cd-b7c8-c40a208e1f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:47.994569 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40281666-e1e4-40cd-b7c8-c40a208e1f74 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:47.994849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40281666-e1e4-40cd-b7c8-c40a208e1f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:47.995124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40281666-e1e4-40cd-b7c8-c40a208e1f74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:47.995882 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40281666-e1e4-40cd-b7c8-c40a208e1f74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:47.997510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40281666-e1e4-40cd-b7c8-c40a208e1f74 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:48.008282 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1280/2615] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:48.012809 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf377e6-b9ab-4726-b36a-c197594d6be2 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:48.022844 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf377e6-b9ab-4726-b36a-c197594d6be2 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:48.029837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f875484-76d0-4fc4-905b-e211ce44f60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:48.030861 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f875484-76d0-4fc4-905b-e211ce44f60a admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:48.031233 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f875484-76d0-4fc4-905b-e211ce44f60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:48.031566 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f875484-76d0-4fc4-905b-e211ce44f60a admin admin] PATH_INFO: `/v3/projects/cf728d6bbd4a4980be2b8674bc5c3024/users/9be924c86b3f460ca05c81f2928c5261/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:48.049943 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f875484-76d0-4fc4-905b-e211ce44f60a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf728d6bbd4a4980be2b8674bc5c3024, user_id=9be924c86b3f460ca05c81f2928c5261, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:48.052818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f875484-76d0-4fc4-905b-e211ce44f60a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:48.067991 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1336/2616] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:48 2022] PUT /identity/v3/projects/cf728d6bbd4a4980be2b8674bc5c3024/users/9be924c86b3f460ca05c81f2928c5261/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:48.079408 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a70954-ee96-4b7e-8484-0faff8ef1067 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:48.079698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a70954-ee96-4b7e-8484-0faff8ef1067 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:48.079971 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a70954-ee96-4b7e-8484-0faff8ef1067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:48.106793 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-44a70954-ee96-4b7e-8484-0faff8ef1067 None None] MFA Rules not processed for user `9be924c86b3f460ca05c81f2928c5261`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:48.108038 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-44a70954-ee96-4b7e-8484-0faff8ef1067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:48.156099 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:48.179510 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1281/2617] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:48.180772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f875484-76d0-4fc4-905b-e211ce44f60a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:48.279452 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f875484-76d0-4fc4-905b-e211ce44f60a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:48.284244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e773ad-4a5b-433d-90e3-abc5d18b56c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:48.284917 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e773ad-4a5b-433d-90e3-abc5d18b56c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:48.285199 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e773ad-4a5b-433d-90e3-abc5d18b56c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:48.285472 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e773ad-4a5b-433d-90e3-abc5d18b56c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:48.286176 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e773ad-4a5b-433d-90e3-abc5d18b56c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:48.288317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e773ad-4a5b-433d-90e3-abc5d18b56c5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:48.322776 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1337/2618] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:48 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:20:48.327031 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a70954-ee96-4b7e-8484-0faff8ef1067 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:48.339987 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e773ad-4a5b-433d-90e3-abc5d18b56c5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:48.342080 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a70954-ee96-4b7e-8484-0faff8ef1067 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:48.343920 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c9e773ad-4a5b-433d-90e3-abc5d18b56c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:48.355582 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:48.416842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ad1ee-54cd-4365-a39c-299d92e50ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:48.417973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ad1ee-54cd-4365-a39c-299d92e50ae7 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:48.418399 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ad1ee-54cd-4365-a39c-299d92e50ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:48.418611 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ad1ee-54cd-4365-a39c-299d92e50ae7 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:48.419880 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ad1ee-54cd-4365-a39c-299d92e50ae7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:48.422353 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ad1ee-54cd-4365-a39c-299d92e50ae7 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:48.432195 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e773ad-4a5b-433d-90e3-abc5d18b56c5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:48.439598 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad115891-5404-4c14-ac68-b57b55a5cdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:48.440695 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad115891-5404-4c14-ac68-b57b55a5cdd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:48.440992 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad115891-5404-4c14-ac68-b57b55a5cdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:48.441659 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad115891-5404-4c14-ac68-b57b55a5cdd6 admin admin] PATH_INFO: `/v3/projects/8f6d6d0a2e3949cb9fc7900ea6a756c6` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:48.442761 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad115891-5404-4c14-ac68-b57b55a5cdd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f6d6d0a2e3949cb9fc7900ea6a756c6)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:48.444823 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad115891-5404-4c14-ac68-b57b55a5cdd6 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:48.445442 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1282/2619] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:48 2022] POST /identity/v3/users => generated 295 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:20:48.449242 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ad1ee-54cd-4365-a39c-299d92e50ae7 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:48.459322 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ad1ee-54cd-4365-a39c-299d92e50ae7 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:48.465517 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83816f61-50d8-4610-a5d5-a773e2aae3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:48.466238 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83816f61-50d8-4610-a5d5-a773e2aae3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:48.466522 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83816f61-50d8-4610-a5d5-a773e2aae3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:48.466798 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83816f61-50d8-4610-a5d5-a773e2aae3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:48.467573 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83816f61-50d8-4610-a5d5-a773e2aae3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:48.469270 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83816f61-50d8-4610-a5d5-a773e2aae3ad admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:48.483864 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1283/2620] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:20:48.484825 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83816f61-50d8-4610-a5d5-a773e2aae3ad admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:48.506984 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83816f61-50d8-4610-a5d5-a773e2aae3ad admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:48.510208 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ad115891-5404-4c14-ac68-b57b55a5cdd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f6d6d0a2e3949cb9fc7900ea6a756c6', 'request_id': 'req-ad115891-5404-4c14-ac68-b57b55a5cdd6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:48.520202 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ad115891-5404-4c14-ac68-b57b55a5cdd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f6d6d0a2e3949cb9fc7900ea6a756c6', 'request_id': 'req-ad115891-5404-4c14-ac68-b57b55a5cdd6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:48.527041 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ad115891-5404-4c14-ac68-b57b55a5cdd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f6d6d0a2e3949cb9fc7900ea6a756c6', 'request_id': 'req-ad115891-5404-4c14-ac68-b57b55a5cdd6'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:48.543961 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ad115891-5404-4c14-ac68-b57b55a5cdd6 admin admin] The token cache is being invalidate because project 8f6d6d0a2e3949cb9fc7900ea6a756c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:48.544807 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ad115891-5404-4c14-ac68-b57b55a5cdd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:48.545468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ad115891-5404-4c14-ac68-b57b55a5cdd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:48.547693 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1338/2621] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:48 2022] DELETE /identity/v3/projects/8f6d6d0a2e3949cb9fc7900ea6a756c6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:48.551222 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad115891-5404-4c14-ac68-b57b55a5cdd6 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:48.552624 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ad115891-5404-4c14-ac68-b57b55a5cdd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:48.577913 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf3bb7-2b27-4c73-a128-ee9a05eeae16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:48.578882 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf3bb7-2b27-4c73-a128-ee9a05eeae16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:48.579164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf3bb7-2b27-4c73-a128-ee9a05eeae16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:48.579471 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bf3bb7-2b27-4c73-a128-ee9a05eeae16 admin admin] PATH_INFO: `/v3/projects/0abef1d67df5480d8e69be29f3241118/users/1028f4ae77444f548d157ed152a2aaf9/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:48.597679 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf3bb7-2b27-4c73-a128-ee9a05eeae16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abef1d67df5480d8e69be29f3241118, user_id=1028f4ae77444f548d157ed152a2aaf9, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:48.600661 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bf3bb7-2b27-4c73-a128-ee9a05eeae16 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:48.618628 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1284/2622] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:48 2022] PUT /identity/v3/projects/0abef1d67df5480d8e69be29f3241118/users/1028f4ae77444f548d157ed152a2aaf9/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:48.619700 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf3bb7-2b27-4c73-a128-ee9a05eeae16 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:48.621427 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d1bf3bb7-2b27-4c73-a128-ee9a05eeae16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:48.633923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad115891-5404-4c14-ac68-b57b55a5cdd6 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:48.675093 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:48.677530 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:48.694704 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bf3bb7-2b27-4c73-a128-ee9a05eeae16 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:48.699875 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe6d8-b294-4907-9a13-497dd7f2faf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:48.700561 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe6d8-b294-4907-9a13-497dd7f2faf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:48.700842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe6d8-b294-4907-9a13-497dd7f2faf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:48.701024 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660d76f-1994-4b67-909a-170fc3f73d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:48.701179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebbe6d8-b294-4907-9a13-497dd7f2faf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:48.701865 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe6d8-b294-4907-9a13-497dd7f2faf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:48.701985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660d76f-1994-4b67-909a-170fc3f73d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:48.702236 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660d76f-1994-4b67-909a-170fc3f73d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:48.702532 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660d76f-1994-4b67-909a-170fc3f73d45 admin admin] PATH_INFO: `/v3/users/0c4ad6a48d5345309f83f0a434465d03` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:48.703535 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebbe6d8-b294-4907-9a13-497dd7f2faf5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:48.703915 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660d76f-1994-4b67-909a-170fc3f73d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4ad6a48d5345309f83f0a434465d03)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:48.706438 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660d76f-1994-4b67-909a-170fc3f73d45 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:48.714412 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1285/2623] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:48 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:48.720656 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe6d8-b294-4907-9a13-497dd7f2faf5 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:48.732843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebbe6d8-b294-4907-9a13-497dd7f2faf5 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:48.738009 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb67348-44c4-4245-991b-e40ad86583e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:48.738919 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb67348-44c4-4245-991b-e40ad86583e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:48.739209 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb67348-44c4-4245-991b-e40ad86583e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:48.739524 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb67348-44c4-4245-991b-e40ad86583e0 admin admin] PATH_INFO: `/v3/projects/0abef1d67df5480d8e69be29f3241118/users/1028f4ae77444f548d157ed152a2aaf9/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:48.741698 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb67348-44c4-4245-991b-e40ad86583e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0abef1d67df5480d8e69be29f3241118, user_id=1028f4ae77444f548d157ed152a2aaf9, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:48.744422 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb67348-44c4-4245-991b-e40ad86583e0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:48.754899 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1286/2624] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:48 2022] PUT /identity/v3/projects/0abef1d67df5480d8e69be29f3241118/users/1028f4ae77444f548d157ed152a2aaf9/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:48.755536 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a660d76f-1994-4b67-909a-170fc3f73d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4ad6a48d5345309f83f0a434465d03'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:48.756186 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a660d76f-1994-4b67-909a-170fc3f73d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4ad6a48d5345309f83f0a434465d03'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:48.764564 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a660d76f-1994-4b67-909a-170fc3f73d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4ad6a48d5345309f83f0a434465d03'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:48.765376 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb639-4a61-4ad2-9460-69e76d846416 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:48.765507 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a660d76f-1994-4b67-909a-170fc3f73d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4ad6a48d5345309f83f0a434465d03'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:48.765692 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb639-4a61-4ad2-9460-69e76d846416 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:48.765958 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1fb639-4a61-4ad2-9460-69e76d846416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:48.772442 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a660d76f-1994-4b67-909a-170fc3f73d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4ad6a48d5345309f83f0a434465d03'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:48.793408 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ee1fb639-4a61-4ad2-9460-69e76d846416 None None] MFA Rules not processed for user `1028f4ae77444f548d157ed152a2aaf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:48.795351 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ee1fb639-4a61-4ad2-9460-69e76d846416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:48.795494 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1339/2625] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:48 2022] DELETE /identity/v3/users/0c4ad6a48d5345309f83f0a434465d03 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:48.867953 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1287/2626] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:48 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:48.879510 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660d76f-1994-4b67-909a-170fc3f73d45 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:48.881186 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a660d76f-1994-4b67-909a-170fc3f73d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:48.940655 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660d76f-1994-4b67-909a-170fc3f73d45 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:48.951196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db964aa-d413-460d-8ffd-5b779a2ad06b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:48.951995 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db964aa-d413-460d-8ffd-5b779a2ad06b service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:48.952186 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db964aa-d413-460d-8ffd-5b779a2ad06b service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:48.952522 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db964aa-d413-460d-8ffd-5b779a2ad06b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:48.954370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5db964aa-d413-460d-8ffd-5b779a2ad06b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:49.019097 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db964aa-d413-460d-8ffd-5b779a2ad06b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:49.020652 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db964aa-d413-460d-8ffd-5b779a2ad06b service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:49.029999 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1340/2627] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:49.077001 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb639-4a61-4ad2-9460-69e76d846416 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:49.078899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ee1fb639-4a61-4ad2-9460-69e76d846416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:49.158104 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1fb639-4a61-4ad2-9460-69e76d846416 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:49.162903 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b081d7b-66b2-41ee-90c8-626fcafeae15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:49.163822 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b081d7b-66b2-41ee-90c8-626fcafeae15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:49.164101 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b081d7b-66b2-41ee-90c8-626fcafeae15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:49.164436 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b081d7b-66b2-41ee-90c8-626fcafeae15 admin admin] PATH_INFO: `/v3/projects/c2dbb365ac60421e83baccf67df934bf` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:49.165666 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b081d7b-66b2-41ee-90c8-626fcafeae15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2dbb365ac60421e83baccf67df934bf)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:49.167629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b081d7b-66b2-41ee-90c8-626fcafeae15 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:49.214926 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9b081d7b-66b2-41ee-90c8-626fcafeae15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2dbb365ac60421e83baccf67df934bf', 'request_id': 'req-9b081d7b-66b2-41ee-90c8-626fcafeae15'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:49.223210 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9b081d7b-66b2-41ee-90c8-626fcafeae15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2dbb365ac60421e83baccf67df934bf', 'request_id': 'req-9b081d7b-66b2-41ee-90c8-626fcafeae15'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:49.228249 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:49.231090 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9b081d7b-66b2-41ee-90c8-626fcafeae15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2dbb365ac60421e83baccf67df934bf', 'request_id': 'req-9b081d7b-66b2-41ee-90c8-626fcafeae15'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:49.246935 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9b081d7b-66b2-41ee-90c8-626fcafeae15 admin admin] The token cache is being invalidate because project c2dbb365ac60421e83baccf67df934bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:49.247220 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9b081d7b-66b2-41ee-90c8-626fcafeae15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:49.248051 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9b081d7b-66b2-41ee-90c8-626fcafeae15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:49.250080 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1288/2628] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:49 2022] DELETE /identity/v3/projects/c2dbb365ac60421e83baccf67df934bf => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:49.255228 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f18f3b-2cf8-437b-96ce-31b0056918a1 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:49.255754 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f18f3b-2cf8-437b-96ce-31b0056918a1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:49.255879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f18f3b-2cf8-437b-96ce-31b0056918a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:49.276544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-53f18f3b-2cf8-437b-96ce-31b0056918a1 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:49.277987 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-53f18f3b-2cf8-437b-96ce-31b0056918a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:49.288591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:49.350182 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1341/2629] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:49.359139 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6724d23-9152-4a53-8a33-268b9d017bbe None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:49.359474 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6724d23-9152-4a53-8a33-268b9d017bbe None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:49.359762 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6724d23-9152-4a53-8a33-268b9d017bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:49.378475 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a6724d23-9152-4a53-8a33-268b9d017bbe None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:49.379774 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a6724d23-9152-4a53-8a33-268b9d017bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:49.388242 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1289/2630] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:20:49.392847 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f18f3b-2cf8-437b-96ce-31b0056918a1 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:49.402973 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f18f3b-2cf8-437b-96ce-31b0056918a1 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:49.408010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233f0d6-3cf3-46e4-a93c-f5775185297e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:49.408666 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233f0d6-3cf3-46e4-a93c-f5775185297e admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:49.408951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233f0d6-3cf3-46e4-a93c-f5775185297e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:49.409227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233f0d6-3cf3-46e4-a93c-f5775185297e admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:49.409985 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233f0d6-3cf3-46e4-a93c-f5775185297e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:49.410291 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233f0d6-3cf3-46e4-a93c-f5775185297e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:49.411972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233f0d6-3cf3-46e4-a93c-f5775185297e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:49.424198 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1342/2631] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:20:49.428814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6724d23-9152-4a53-8a33-268b9d017bbe None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:49.438363 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6724d23-9152-4a53-8a33-268b9d017bbe None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:49.443923 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f70cbc-9450-4638-bc5c-4a597a8591b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:49.444576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f70cbc-9450-4638-bc5c-4a597a8591b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:49.444865 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f70cbc-9450-4638-bc5c-4a597a8591b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:49.445149 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f70cbc-9450-4638-bc5c-4a597a8591b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:49.445841 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f70cbc-9450-4638-bc5c-4a597a8591b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:49.447928 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f70cbc-9450-4638-bc5c-4a597a8591b1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:49.476145 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1290/2632] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:49 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:49.539684 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233f0d6-3cf3-46e4-a93c-f5775185297e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:49.556790 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233f0d6-3cf3-46e4-a93c-f5775185297e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:49.615444 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707e464-ad9c-4696-a1d8-920bae9ff289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:49.616132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707e464-ad9c-4696-a1d8-920bae9ff289 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:49.616415 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707e464-ad9c-4696-a1d8-920bae9ff289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:49.616692 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707e464-ad9c-4696-a1d8-920bae9ff289 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:49.617390 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707e464-ad9c-4696-a1d8-920bae9ff289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:49.621697 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707e464-ad9c-4696-a1d8-920bae9ff289 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:49.646676 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1343/2633] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:49 2022] POST /identity/v3/users => generated 293 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:49.648385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f70cbc-9450-4638-bc5c-4a597a8591b1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:49.659234 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f70cbc-9450-4638-bc5c-4a597a8591b1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:49.667514 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde803f1-e326-4835-9361-1a5d9bd9bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:49.668196 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde803f1-e326-4835-9361-1a5d9bd9bcc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:49.668482 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde803f1-e326-4835-9361-1a5d9bd9bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:49.668758 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde803f1-e326-4835-9361-1a5d9bd9bcc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:49.669497 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde803f1-e326-4835-9361-1a5d9bd9bcc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:49.671583 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde803f1-e326-4835-9361-1a5d9bd9bcc3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:49.682333 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1291/2634] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:49.686780 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707e464-ad9c-4696-a1d8-920bae9ff289 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:49.697395 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707e464-ad9c-4696-a1d8-920bae9ff289 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:49.702655 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a419e477-469c-4b9b-991a-ac67715450f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:49.703346 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419e477-469c-4b9b-991a-ac67715450f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:49.703635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419e477-469c-4b9b-991a-ac67715450f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:49.703909 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a419e477-469c-4b9b-991a-ac67715450f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:49.704638 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419e477-469c-4b9b-991a-ac67715450f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:49.706268 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a419e477-469c-4b9b-991a-ac67715450f9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:49.716280 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1344/2635] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:49.720373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde803f1-e326-4835-9361-1a5d9bd9bcc3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:49.730307 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde803f1-e326-4835-9361-1a5d9bd9bcc3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:49.735142 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a01f3b-2c0f-4102-a679-35168e308b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:49.736054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a01f3b-2c0f-4102-a679-35168e308b7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:49.736335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a01f3b-2c0f-4102-a679-35168e308b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:49.736611 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a01f3b-2c0f-4102-a679-35168e308b7d admin admin] PATH_INFO: `/v3/projects/9753c102a20e43069e625a06e0674948/users/7f6ace633005486e9afbb93a7f3da403/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:49.751579 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a01f3b-2c0f-4102-a679-35168e308b7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9753c102a20e43069e625a06e0674948, user_id=7f6ace633005486e9afbb93a7f3da403, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:49.754231 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a01f3b-2c0f-4102-a679-35168e308b7d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:49.769513 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1292/2636] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:49 2022] PUT /identity/v3/projects/9753c102a20e43069e625a06e0674948/users/7f6ace633005486e9afbb93a7f3da403/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:20:49.779842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35712ddb-6d5d-4b8e-b92c-90bdb91d1dd3 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:49.780138 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35712ddb-6d5d-4b8e-b92c-90bdb91d1dd3 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:49.780435 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35712ddb-6d5d-4b8e-b92c-90bdb91d1dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:49.811577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-35712ddb-6d5d-4b8e-b92c-90bdb91d1dd3 None None] MFA Rules not processed for user `7f6ace633005486e9afbb93a7f3da403`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:49.812817 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-35712ddb-6d5d-4b8e-b92c-90bdb91d1dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:49.884331 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1345/2637] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:49.898204 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a01f3b-2c0f-4102-a679-35168e308b7d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:49.900343 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-23a01f3b-2c0f-4102-a679-35168e308b7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:49.965606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a01f3b-2c0f-4102-a679-35168e308b7d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:49.970113 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73c634-2fc4-4a9a-9482-4f2b06124bd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:49.970852 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73c634-2fc4-4a9a-9482-4f2b06124bd6 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:49.971136 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73c634-2fc4-4a9a-9482-4f2b06124bd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:49.971453 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73c634-2fc4-4a9a-9482-4f2b06124bd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:49.979947 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73c634-2fc4-4a9a-9482-4f2b06124bd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:49.981984 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73c634-2fc4-4a9a-9482-4f2b06124bd6 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:49.991569 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1293/2638] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:51.450152 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736f80f-a180-4257-af94-e61273613faf None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:51.450860 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736f80f-a180-4257-af94-e61273613faf None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:51.450860 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736f80f-a180-4257-af94-e61273613faf None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:51.453336 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1346/2639] 10.222.0.42 () {54 vars in 921 bytes} [Sun Jul 24 01:20:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:20:51.459586 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17dc0e-638f-45f4-869c-4920324660ea None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:51.460136 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17dc0e-638f-45f4-869c-4920324660ea None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:51.460512 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17dc0e-638f-45f4-869c-4920324660ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:51.502798 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-ac17dc0e-638f-45f4-869c-4920324660ea None None] MFA Rules not processed for user `6c32c443ee1a421e98e7656e8e86e27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:51.504371 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ac17dc0e-638f-45f4-869c-4920324660ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:51.593460 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1294/2640] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Jul 24 01:20:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:51.607317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736f80f-a180-4257-af94-e61273613faf None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:51.609258 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1736f80f-a180-4257-af94-e61273613faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:51.618813 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17dc0e-638f-45f4-869c-4920324660ea None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:51.620441 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ac17dc0e-638f-45f4-869c-4920324660ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:51.625141 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:51.634254 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac17dc0e-638f-45f4-869c-4920324660ea None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:51.638546 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f68a9-153b-48db-bb7f-f811ca24e337 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:51.639273 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f68a9-153b-48db-bb7f-f811ca24e337 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:51.639707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f68a9-153b-48db-bb7f-f811ca24e337 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:51.640040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f68a9-153b-48db-bb7f-f811ca24e337 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:51.642028 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f46f68a9-153b-48db-bb7f-f811ca24e337 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:51.662679 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:51.682788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736f80f-a180-4257-af94-e61273613faf None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:51.688520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49c353-d57a-477a-9a8c-438e2e4a14e8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbdf910e67d4185a0ae14edf34ee3b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:51.689416 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49c353-d57a-477a-9a8c-438e2e4a14e8 service glance] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:51.689908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49c353-d57a-477a-9a8c-438e2e4a14e8 service glance] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:51.690282 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49c353-d57a-477a-9a8c-438e2e4a14e8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:51.702958 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49c353-d57a-477a-9a8c-438e2e4a14e8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:51.705017 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49c353-d57a-477a-9a8c-438e2e4a14e8 service glance] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:51.724096 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1347/2641] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:51.733245 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f68a9-153b-48db-bb7f-f811ca24e337 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:51.734782 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f68a9-153b-48db-bb7f-f811ca24e337 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:51.745247 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1295/2642] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:51 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:20:51.791947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba916cf-20b4-4ca5-bcc3-4d5db05f2a21 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:51.792242 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba916cf-20b4-4ca5-bcc3-4d5db05f2a21 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:51.792521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba916cf-20b4-4ca5-bcc3-4d5db05f2a21 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:51.796068 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1348/2643] 10.222.0.42 () {54 vars in 921 bytes} [Sun Jul 24 01:20:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:20:51.802463 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7bce8-fdf9-4c93-9538-2c32d54679d8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:51.802752 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7bce8-fdf9-4c93-9538-2c32d54679d8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:51.803047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7bce8-fdf9-4c93-9538-2c32d54679d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:51.823401 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6dc7bce8-fdf9-4c93-9538-2c32d54679d8 None None] MFA Rules not processed for user `a3efd3928e334e78b4c87bb695718299`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:51.823532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6dc7bce8-fdf9-4c93-9538-2c32d54679d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:51.880565 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1296/2644] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Jul 24 01:20:51 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:51.892411 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba916cf-20b4-4ca5-bcc3-4d5db05f2a21 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:51.894346 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-2ba916cf-20b4-4ca5-bcc3-4d5db05f2a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:51.913613 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba916cf-20b4-4ca5-bcc3-4d5db05f2a21 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:51.919247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156d4575-c23a-4d34-b3a7-555e6b927f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:51.919968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d4575-c23a-4d34-b3a7-555e6b927f3e service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:51.920265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d4575-c23a-4d34-b3a7-555e6b927f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:51.920576 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156d4575-c23a-4d34-b3a7-555e6b927f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:51.929230 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d4575-c23a-4d34-b3a7-555e6b927f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:51.931149 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156d4575-c23a-4d34-b3a7-555e6b927f3e service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:51.939855 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1349/2645] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:52.026554 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51fa37-cd00-460f-abd9-5d3cf82dc55a None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:52.026843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51fa37-cd00-460f-abd9-5d3cf82dc55a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:52.027121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce51fa37-cd00-460f-abd9-5d3cf82dc55a None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:52.028785 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1297/2646] 10.222.0.42 () {54 vars in 921 bytes} [Sun Jul 24 01:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:20:52.035227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce93977-fbd8-474a-a3bb-945f068b787a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:52.035568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce93977-fbd8-474a-a3bb-945f068b787a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:52.035899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce93977-fbd8-474a-a3bb-945f068b787a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:52.056032 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5ce93977-fbd8-474a-a3bb-945f068b787a None None] MFA Rules not processed for user `6c32c443ee1a421e98e7656e8e86e27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:52.057258 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5ce93977-fbd8-474a-a3bb-945f068b787a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:52.067479 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1350/2647] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Jul 24 01:20:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:52.078939 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51fa37-cd00-460f-abd9-5d3cf82dc55a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:52.091084 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce51fa37-cd00-460f-abd9-5d3cf82dc55a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:52.094945 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f73c0-f552-439d-9c1b-c7f14c4ae1b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:52.095671 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f73c0-f552-439d-9c1b-c7f14c4ae1b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:52.095981 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f73c0-f552-439d-9c1b-c7f14c4ae1b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:52.096259 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f73c0-f552-439d-9c1b-c7f14c4ae1b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:52.107439 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f73c0-f552-439d-9c1b-c7f14c4ae1b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:52.108773 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f73c0-f552-439d-9c1b-c7f14c4ae1b2 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:52.119875 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1298/2648] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:54.872831 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85008fab-6228-451f-8f14-9a2f666cdcf0 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:54.873304 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85008fab-6228-451f-8f14-9a2f666cdcf0 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:54.873408 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85008fab-6228-451f-8f14-9a2f666cdcf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:54.899635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-85008fab-6228-451f-8f14-9a2f666cdcf0 None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:54.900859 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-85008fab-6228-451f-8f14-9a2f666cdcf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:54.958071 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1351/2649] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:20:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:54.970368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f73c0-f552-439d-9c1b-c7f14c4ae1b2 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:54.972080 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-862f73c0-f552-439d-9c1b-c7f14c4ae1b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:55.042564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f73c0-f552-439d-9c1b-c7f14c4ae1b2 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:55.049346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1997f0-bc10-4911-b204-f2a80ed0cf2c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:55.050058 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1997f0-bc10-4911-b204-f2a80ed0cf2c service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:55.050425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1997f0-bc10-4911-b204-f2a80ed0cf2c service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:55.050738 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1997f0-bc10-4911-b204-f2a80ed0cf2c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:55.060543 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1997f0-bc10-4911-b204-f2a80ed0cf2c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:55.062401 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1997f0-bc10-4911-b204-f2a80ed0cf2c service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:55.070528 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1299/2650] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:20:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:20:55.463625 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85008fab-6228-451f-8f14-9a2f666cdcf0 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:55.542222 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85008fab-6228-451f-8f14-9a2f666cdcf0 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:55.546996 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fe64b-8929-46bc-9b53-499faab27b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:55.547939 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fe64b-8929-46bc-9b53-499faab27b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:55.548224 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fe64b-8929-46bc-9b53-499faab27b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:55.548497 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fe64b-8929-46bc-9b53-499faab27b67 admin admin] PATH_INFO: `/v3/users/7f6ace633005486e9afbb93a7f3da403` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:55.550006 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fe64b-8929-46bc-9b53-499faab27b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f6ace633005486e9afbb93a7f3da403)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:55.552898 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257fe64b-8929-46bc-9b53-499faab27b67 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:55.628457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:55.645361 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-257fe64b-8929-46bc-9b53-499faab27b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f6ace633005486e9afbb93a7f3da403'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:55.646114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-257fe64b-8929-46bc-9b53-499faab27b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f6ace633005486e9afbb93a7f3da403'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:55.663355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-257fe64b-8929-46bc-9b53-499faab27b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f6ace633005486e9afbb93a7f3da403'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:55.664140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-257fe64b-8929-46bc-9b53-499faab27b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f6ace633005486e9afbb93a7f3da403'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:55.674537 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-257fe64b-8929-46bc-9b53-499faab27b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f6ace633005486e9afbb93a7f3da403'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:55.704254 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1352/2651] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:55 2022] DELETE /identity/v3/users/7f6ace633005486e9afbb93a7f3da403 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:55.709299 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45104b1e-66a6-439d-bdd1-b18b8cb3aaab None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:55.709834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45104b1e-66a6-439d-bdd1-b18b8cb3aaab None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:55.710213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45104b1e-66a6-439d-bdd1-b18b8cb3aaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:55.748921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-45104b1e-66a6-439d-bdd1-b18b8cb3aaab None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:55.748921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-45104b1e-66a6-439d-bdd1-b18b8cb3aaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:55.815048 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:55.875845 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1300/2652] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:55.882707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fe64b-8929-46bc-9b53-499faab27b67 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:55.884242 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-257fe64b-8929-46bc-9b53-499faab27b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:55.950520 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fe64b-8929-46bc-9b53-499faab27b67 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:55.954703 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112fc659-eeea-4744-ba0d-71c779d3c869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:55.955775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fc659-eeea-4744-ba0d-71c779d3c869 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:55.956125 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fc659-eeea-4744-ba0d-71c779d3c869 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:55.956488 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112fc659-eeea-4744-ba0d-71c779d3c869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:55.966409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fc659-eeea-4744-ba0d-71c779d3c869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:55.967983 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112fc659-eeea-4744-ba0d-71c779d3c869 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:55.978569 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1353/2653] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:56.257682 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45104b1e-66a6-439d-bdd1-b18b8cb3aaab None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:56.259450 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-45104b1e-66a6-439d-bdd1-b18b8cb3aaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:56.279171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45104b1e-66a6-439d-bdd1-b18b8cb3aaab None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:56.284814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1189e7-9937-4f72-8b13-149fd242ec82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:56.285794 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1189e7-9937-4f72-8b13-149fd242ec82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:56.286150 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1189e7-9937-4f72-8b13-149fd242ec82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:56.286500 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1189e7-9937-4f72-8b13-149fd242ec82 admin admin] PATH_INFO: `/v3/projects/9753c102a20e43069e625a06e0674948` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:56.288071 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1189e7-9937-4f72-8b13-149fd242ec82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9753c102a20e43069e625a06e0674948)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:56.290462 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1189e7-9937-4f72-8b13-149fd242ec82 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:56.350297 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ea1189e7-9937-4f72-8b13-149fd242ec82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9753c102a20e43069e625a06e0674948', 'request_id': 'req-ea1189e7-9937-4f72-8b13-149fd242ec82'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:56.361817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ea1189e7-9937-4f72-8b13-149fd242ec82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9753c102a20e43069e625a06e0674948', 'request_id': 'req-ea1189e7-9937-4f72-8b13-149fd242ec82'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:56.368626 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ea1189e7-9937-4f72-8b13-149fd242ec82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9753c102a20e43069e625a06e0674948', 'request_id': 'req-ea1189e7-9937-4f72-8b13-149fd242ec82'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:56.381352 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ea1189e7-9937-4f72-8b13-149fd242ec82 admin admin] The token cache is being invalidate because project 9753c102a20e43069e625a06e0674948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:20:56.381668 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ea1189e7-9937-4f72-8b13-149fd242ec82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:56.382365 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ea1189e7-9937-4f72-8b13-149fd242ec82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:20:56.384128 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1301/2654] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:20:56 2022] DELETE /identity/v3/projects/9753c102a20e43069e625a06e0674948 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:56.389466 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec8291-0d10-46e2-8641-4b0d7a6cc8a8 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:56.389750 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec8291-0d10-46e2-8641-4b0d7a6cc8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:56.390038 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec8291-0d10-46e2-8641-4b0d7a6cc8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:56.412006 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-89ec8291-0d10-46e2-8641-4b0d7a6cc8a8 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:56.414514 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-89ec8291-0d10-46e2-8641-4b0d7a6cc8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:56.485988 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1354/2655] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:20:56.493379 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42237e9b-e328-4927-af48-7273ab40d267 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:56.493666 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42237e9b-e328-4927-af48-7273ab40d267 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:56.493940 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42237e9b-e328-4927-af48-7273ab40d267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:56.526003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-42237e9b-e328-4927-af48-7273ab40d267 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:56.527476 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-42237e9b-e328-4927-af48-7273ab40d267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:56.535678 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1302/2656] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:56.540383 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec8291-0d10-46e2-8641-4b0d7a6cc8a8 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:56.551568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec8291-0d10-46e2-8641-4b0d7a6cc8a8 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:56.556682 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ec006-d97e-4935-affc-fe68668aacda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:56.557403 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ec006-d97e-4935-affc-fe68668aacda admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:56.557690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ec006-d97e-4935-affc-fe68668aacda admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:56.557992 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9ec006-d97e-4935-affc-fe68668aacda admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:56.558751 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ec006-d97e-4935-affc-fe68668aacda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:20:56.559095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ec006-d97e-4935-affc-fe68668aacda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:56.560911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9ec006-d97e-4935-affc-fe68668aacda admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:56.577347 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1355/2657] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:20:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:20:56.580885 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42237e9b-e328-4927-af48-7273ab40d267 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:56.591253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42237e9b-e328-4927-af48-7273ab40d267 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:56.601440 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7306c-c7e1-47e2-be27-10bfd6ed853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:56.602131 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7306c-c7e1-47e2-be27-10bfd6ed853b admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:56.602518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7306c-c7e1-47e2-be27-10bfd6ed853b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:56.602786 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef7306c-c7e1-47e2-be27-10bfd6ed853b admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:56.603537 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7306c-c7e1-47e2-be27-10bfd6ed853b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:56.605545 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef7306c-c7e1-47e2-be27-10bfd6ed853b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:56.639344 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1303/2658] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:20:56 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:20:56.641960 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ec006-d97e-4935-affc-fe68668aacda admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:56.652342 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9ec006-d97e-4935-affc-fe68668aacda admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:56.704108 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:20:56.720110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2622d-71c5-44c9-ac52-6d45cc870ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:56.720791 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2622d-71c5-44c9-ac52-6d45cc870ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:56.721102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2622d-71c5-44c9-ac52-6d45cc870ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:56.721371 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2622d-71c5-44c9-ac52-6d45cc870ec3 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:56.722086 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2622d-71c5-44c9-ac52-6d45cc870ec3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:56.724063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2622d-71c5-44c9-ac52-6d45cc870ec3 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:56.747440 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1356/2659] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:20:56 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:20:56.752164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7306c-c7e1-47e2-be27-10bfd6ed853b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:56.763773 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef7306c-c7e1-47e2-be27-10bfd6ed853b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:56.768672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7767f-1eeb-4b16-ab3d-7e57c68a591c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:56.769551 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7767f-1eeb-4b16-ab3d-7e57c68a591c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:56.769796 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7767f-1eeb-4b16-ab3d-7e57c68a591c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:56.770185 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7767f-1eeb-4b16-ab3d-7e57c68a591c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:56.770966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7767f-1eeb-4b16-ab3d-7e57c68a591c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:56.772688 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7767f-1eeb-4b16-ab3d-7e57c68a591c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:56.812230 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2622d-71c5-44c9-ac52-6d45cc870ec3 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:56.818946 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1304/2660] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:56.823401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2622d-71c5-44c9-ac52-6d45cc870ec3 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:56.828517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452db16f-9050-4c22-865d-62824e28fb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:56.834378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452db16f-9050-4c22-865d-62824e28fb1b admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:56.834378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452db16f-9050-4c22-865d-62824e28fb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:56.834378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452db16f-9050-4c22-865d-62824e28fb1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:56.834378 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452db16f-9050-4c22-865d-62824e28fb1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:56.837147 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452db16f-9050-4c22-865d-62824e28fb1b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:56.851508 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1357/2661] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:20:56 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:20:56.859587 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7767f-1eeb-4b16-ab3d-7e57c68a591c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:56.871667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7767f-1eeb-4b16-ab3d-7e57c68a591c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:56.879815 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275a3b0-fd53-4a1d-82be-975f1c33a938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:56.881100 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275a3b0-fd53-4a1d-82be-975f1c33a938 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:56.881538 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275a3b0-fd53-4a1d-82be-975f1c33a938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:56.881972 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275a3b0-fd53-4a1d-82be-975f1c33a938 admin admin] PATH_INFO: `/v3/projects/73c80a72038543328dc88785877a432d/users/0854c8e15544482ab7edb788f7fc45b0/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:56.903879 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275a3b0-fd53-4a1d-82be-975f1c33a938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73c80a72038543328dc88785877a432d, user_id=0854c8e15544482ab7edb788f7fc45b0, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:56.909928 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275a3b0-fd53-4a1d-82be-975f1c33a938 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:56.933600 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1305/2662] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:20:56 2022] PUT /identity/v3/projects/73c80a72038543328dc88785877a432d/users/0854c8e15544482ab7edb788f7fc45b0/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:20:56.944977 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85f94-1378-49df-b87a-b875b66316f2 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:56.945534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85f94-1378-49df-b87a-b875b66316f2 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:56.945706 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf85f94-1378-49df-b87a-b875b66316f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:56.977152 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-4cf85f94-1378-49df-b87a-b875b66316f2 None None] MFA Rules not processed for user `0854c8e15544482ab7edb788f7fc45b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:20:56.978864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-4cf85f94-1378-49df-b87a-b875b66316f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:57.063668 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1358/2663] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:20:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:20:57.072370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275a3b0-fd53-4a1d-82be-975f1c33a938 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:57.074613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-7275a3b0-fd53-4a1d-82be-975f1c33a938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:20:57.171645 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275a3b0-fd53-4a1d-82be-975f1c33a938 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:57.176299 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f1dc7-236c-4385-848f-e97e97fcb521 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:57.176989 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f1dc7-236c-4385-848f-e97e97fcb521 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:57.177737 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f1dc7-236c-4385-848f-e97e97fcb521 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:57.178030 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f1dc7-236c-4385-848f-e97e97fcb521 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:57.192493 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f1dc7-236c-4385-848f-e97e97fcb521 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:57.194273 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7f1dc7-236c-4385-848f-e97e97fcb521 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:20:57.205600 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1306/2664] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:20:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:20:59.883035 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85f94-1378-49df-b87a-b875b66316f2 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:20:59.958798 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf85f94-1378-49df-b87a-b875b66316f2 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:20:59.963944 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03022b15-1fb4-404e-8775-66fce2ea4ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:20:59.964829 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03022b15-1fb4-404e-8775-66fce2ea4ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:20:59.965106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03022b15-1fb4-404e-8775-66fce2ea4ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:20:59.965380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03022b15-1fb4-404e-8775-66fce2ea4ee5 admin admin] PATH_INFO: `/v3/users/0854c8e15544482ab7edb788f7fc45b0` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:20:59.967639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03022b15-1fb4-404e-8775-66fce2ea4ee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0854c8e15544482ab7edb788f7fc45b0)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:20:59.969924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03022b15-1fb4-404e-8775-66fce2ea4ee5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:00.030679 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-03022b15-1fb4-404e-8775-66fce2ea4ee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0854c8e15544482ab7edb788f7fc45b0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:00.031348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-03022b15-1fb4-404e-8775-66fce2ea4ee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0854c8e15544482ab7edb788f7fc45b0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:00.040474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-03022b15-1fb4-404e-8775-66fce2ea4ee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0854c8e15544482ab7edb788f7fc45b0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:00.041084 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-03022b15-1fb4-404e-8775-66fce2ea4ee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0854c8e15544482ab7edb788f7fc45b0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:00.046419 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:00.049254 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-03022b15-1fb4-404e-8775-66fce2ea4ee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0854c8e15544482ab7edb788f7fc45b0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:00.072344 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1359/2665] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:20:59 2022] DELETE /identity/v3/users/0854c8e15544482ab7edb788f7fc45b0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:00.076838 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3cbe0-a1b1-4245-81c3-add081477386 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:00.077383 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3cbe0-a1b1-4245-81c3-add081477386 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:00.077493 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3cbe0-a1b1-4245-81c3-add081477386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:00.083672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:00.097169 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-dda3cbe0-a1b1-4245-81c3-add081477386 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:00.098573 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dda3cbe0-a1b1-4245-81c3-add081477386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:00.181877 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1307/2666] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:00.192339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03022b15-1fb4-404e-8775-66fce2ea4ee5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:00.193896 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-03022b15-1fb4-404e-8775-66fce2ea4ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:00.255849 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03022b15-1fb4-404e-8775-66fce2ea4ee5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:00.259864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e74210e-c82b-42a2-b0ab-08cbc407439c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:00.263612 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74210e-c82b-42a2-b0ab-08cbc407439c service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:00.264345 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74210e-c82b-42a2-b0ab-08cbc407439c service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:00.264676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74210e-c82b-42a2-b0ab-08cbc407439c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:00.275460 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74210e-c82b-42a2-b0ab-08cbc407439c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:00.277141 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e74210e-c82b-42a2-b0ab-08cbc407439c service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:00.288518 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1360/2667] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:00.792898 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3cbe0-a1b1-4245-81c3-add081477386 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:00.794738 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dda3cbe0-a1b1-4245-81c3-add081477386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:00.815350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3cbe0-a1b1-4245-81c3-add081477386 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:00.835950 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb17b1-d101-4643-bfdb-d240447862fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:00.836924 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb17b1-d101-4643-bfdb-d240447862fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:00.837218 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb17b1-d101-4643-bfdb-d240447862fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:00.837497 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb17b1-d101-4643-bfdb-d240447862fa admin admin] PATH_INFO: `/v3/projects/73c80a72038543328dc88785877a432d` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:00.838746 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb17b1-d101-4643-bfdb-d240447862fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=73c80a72038543328dc88785877a432d)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:00.840705 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb17b1-d101-4643-bfdb-d240447862fa admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:00.956653 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dddb17b1-d101-4643-bfdb-d240447862fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73c80a72038543328dc88785877a432d', 'request_id': 'req-dddb17b1-d101-4643-bfdb-d240447862fa'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:00.966114 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dddb17b1-d101-4643-bfdb-d240447862fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73c80a72038543328dc88785877a432d', 'request_id': 'req-dddb17b1-d101-4643-bfdb-d240447862fa'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:00.973119 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dddb17b1-d101-4643-bfdb-d240447862fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73c80a72038543328dc88785877a432d', 'request_id': 'req-dddb17b1-d101-4643-bfdb-d240447862fa'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:00.996518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dddb17b1-d101-4643-bfdb-d240447862fa admin admin] The token cache is being invalidate because project 73c80a72038543328dc88785877a432d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:00.996518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dddb17b1-d101-4643-bfdb-d240447862fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:00.998253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dddb17b1-d101-4643-bfdb-d240447862fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:01.007755 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1308/2668] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:00 2022] DELETE /identity/v3/projects/73c80a72038543328dc88785877a432d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:01.009265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93af5e7-4562-472c-a893-647de32bf22b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:01.009779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93af5e7-4562-472c-a893-647de32bf22b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:01.009884 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93af5e7-4562-472c-a893-647de32bf22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:01.033468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e93af5e7-4562-472c-a893-647de32bf22b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:01.034968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e93af5e7-4562-472c-a893-647de32bf22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:01.131690 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1361/2669] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:21:01.139880 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e59cd-d9b5-4f9d-bbbf-4e49222d4b79 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:01.140489 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e59cd-d9b5-4f9d-bbbf-4e49222d4b79 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:01.140489 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e59cd-d9b5-4f9d-bbbf-4e49222d4b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:01.161020 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f84e59cd-d9b5-4f9d-bbbf-4e49222d4b79 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:01.162334 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f84e59cd-d9b5-4f9d-bbbf-4e49222d4b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:01.171324 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1309/2670] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:01.176169 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93af5e7-4562-472c-a893-647de32bf22b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:01.187544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93af5e7-4562-472c-a893-647de32bf22b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:01.193388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f2dbb-b842-46df-984d-7514dd3e0f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:01.194439 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f2dbb-b842-46df-984d-7514dd3e0f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:01.194775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f2dbb-b842-46df-984d-7514dd3e0f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:01.195150 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f2dbb-b842-46df-984d-7514dd3e0f60 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:01.196182 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f2dbb-b842-46df-984d-7514dd3e0f60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:21:01.196610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f2dbb-b842-46df-984d-7514dd3e0f60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:01.198247 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f2dbb-b842-46df-984d-7514dd3e0f60 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:01.210771 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1362/2671] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:21:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 24 01:21:01.215427 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e59cd-d9b5-4f9d-bbbf-4e49222d4b79 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:01.225016 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e59cd-d9b5-4f9d-bbbf-4e49222d4b79 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:01.230346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10811574-dc2e-41f5-8340-c6fb1e30c2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:01.231007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10811574-dc2e-41f5-8340-c6fb1e30c2aa admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:01.231349 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10811574-dc2e-41f5-8340-c6fb1e30c2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:01.231718 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10811574-dc2e-41f5-8340-c6fb1e30c2aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:01.232449 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10811574-dc2e-41f5-8340-c6fb1e30c2aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:01.234467 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10811574-dc2e-41f5-8340-c6fb1e30c2aa admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:01.265483 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1310/2672] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:21:01 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:01.269743 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f2dbb-b842-46df-984d-7514dd3e0f60 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:01.280542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f2dbb-b842-46df-984d-7514dd3e0f60 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:01.339941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dd7f4-5189-4a5e-a4e7-990cd3ed3b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:01.340635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd7f4-5189-4a5e-a4e7-990cd3ed3b86 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:01.340917 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd7f4-5189-4a5e-a4e7-990cd3ed3b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:01.341196 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105dd7f4-5189-4a5e-a4e7-990cd3ed3b86 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:01.341916 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105dd7f4-5189-4a5e-a4e7-990cd3ed3b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:01.343991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105dd7f4-5189-4a5e-a4e7-990cd3ed3b86 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:01.353968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:01.366362 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1363/2673] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:21:01 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:01.370128 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10811574-dc2e-41f5-8340-c6fb1e30c2aa admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:01.380941 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10811574-dc2e-41f5-8340-c6fb1e30c2aa admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:01.385907 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b63c20-2178-48f9-adf5-623995499488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:01.394281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b63c20-2178-48f9-adf5-623995499488 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:01.394580 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b63c20-2178-48f9-adf5-623995499488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:01.394863 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b63c20-2178-48f9-adf5-623995499488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:01.395661 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b63c20-2178-48f9-adf5-623995499488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:01.397405 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b63c20-2178-48f9-adf5-623995499488 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:01.409931 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1311/2674] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:01.414484 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dd7f4-5189-4a5e-a4e7-990cd3ed3b86 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:01.427517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105dd7f4-5189-4a5e-a4e7-990cd3ed3b86 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:01.432391 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030a937d-def2-40da-b430-f3949a9837d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:01.433074 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a937d-def2-40da-b430-f3949a9837d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:01.433609 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a937d-def2-40da-b430-f3949a9837d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:01.433896 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030a937d-def2-40da-b430-f3949a9837d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:01.434860 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a937d-def2-40da-b430-f3949a9837d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:01.436686 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030a937d-def2-40da-b430-f3949a9837d9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:01.450668 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1364/2675] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:01.454533 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b63c20-2178-48f9-adf5-623995499488 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:01.465387 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b63c20-2178-48f9-adf5-623995499488 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:01.470128 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d15b52-2607-43a6-91e4-aa14d13f0730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:01.471043 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d15b52-2607-43a6-91e4-aa14d13f0730 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:01.471354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d15b52-2607-43a6-91e4-aa14d13f0730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:01.471634 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d15b52-2607-43a6-91e4-aa14d13f0730 admin admin] PATH_INFO: `/v3/projects/9aa0a91f66f14e798d257c8767aeeb32/users/4d3514ac2afb4aff8ddda96e08af63f5/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:01.487734 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d15b52-2607-43a6-91e4-aa14d13f0730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa0a91f66f14e798d257c8767aeeb32, user_id=4d3514ac2afb4aff8ddda96e08af63f5, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:01.490646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d15b52-2607-43a6-91e4-aa14d13f0730 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:01.505791 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1312/2676] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:01 2022] PUT /identity/v3/projects/9aa0a91f66f14e798d257c8767aeeb32/users/4d3514ac2afb4aff8ddda96e08af63f5/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:01.516536 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b365b02-1e59-4585-b851-cfc413531672 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:01.516856 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b365b02-1e59-4585-b851-cfc413531672 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:01.517100 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b365b02-1e59-4585-b851-cfc413531672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:01.548701 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1b365b02-1e59-4585-b851-cfc413531672 None None] MFA Rules not processed for user `4d3514ac2afb4aff8ddda96e08af63f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:01.549932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1b365b02-1e59-4585-b851-cfc413531672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:01.617684 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1365/2677] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:21:01.630124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d15b52-2607-43a6-91e4-aa14d13f0730 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:01.631978 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-67d15b52-2607-43a6-91e4-aa14d13f0730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:01.659946 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:01.697451 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d15b52-2607-43a6-91e4-aa14d13f0730 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:01.701651 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67319b8-92b4-405d-85f3-ae8256f5d739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:01.702326 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67319b8-92b4-405d-85f3-ae8256f5d739 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:01.702630 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67319b8-92b4-405d-85f3-ae8256f5d739 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:01.702896 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67319b8-92b4-405d-85f3-ae8256f5d739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:01.712690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67319b8-92b4-405d-85f3-ae8256f5d739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:01.714178 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67319b8-92b4-405d-85f3-ae8256f5d739 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:01.735152 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1313/2678] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:01.754195 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b365b02-1e59-4585-b851-cfc413531672 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:01.865884 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b365b02-1e59-4585-b851-cfc413531672 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:01.874363 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb292ed-5c5b-4cf3-9d7b-5295d68e90e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:01.874363 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb292ed-5c5b-4cf3-9d7b-5295d68e90e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:01.874363 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb292ed-5c5b-4cf3-9d7b-5295d68e90e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:01.874363 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb292ed-5c5b-4cf3-9d7b-5295d68e90e5 admin admin] PATH_INFO: `/v3/users/4d3514ac2afb4aff8ddda96e08af63f5` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:01.875545 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb292ed-5c5b-4cf3-9d7b-5295d68e90e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d3514ac2afb4aff8ddda96e08af63f5)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:01.876014 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb292ed-5c5b-4cf3-9d7b-5295d68e90e5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:01.952708 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6cb292ed-5c5b-4cf3-9d7b-5295d68e90e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d3514ac2afb4aff8ddda96e08af63f5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:01.953440 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6cb292ed-5c5b-4cf3-9d7b-5295d68e90e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d3514ac2afb4aff8ddda96e08af63f5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:01.961879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6cb292ed-5c5b-4cf3-9d7b-5295d68e90e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d3514ac2afb4aff8ddda96e08af63f5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:01.962566 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6cb292ed-5c5b-4cf3-9d7b-5295d68e90e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d3514ac2afb4aff8ddda96e08af63f5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:01.970727 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6cb292ed-5c5b-4cf3-9d7b-5295d68e90e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d3514ac2afb4aff8ddda96e08af63f5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:02.006365 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:02.015989 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1366/2679] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:01 2022] DELETE /identity/v3/users/4d3514ac2afb4aff8ddda96e08af63f5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:02.020712 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc3312-2918-4b74-b09e-29f08010591a None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:02.020982 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc3312-2918-4b74-b09e-29f08010591a None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:02.021461 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc3312-2918-4b74-b09e-29f08010591a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:02.039692 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-eabc3312-2918-4b74-b09e-29f08010591a None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:02.040999 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-eabc3312-2918-4b74-b09e-29f08010591a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:02.112975 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1314/2680] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:02.119868 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb292ed-5c5b-4cf3-9d7b-5295d68e90e5 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:02.121450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6cb292ed-5c5b-4cf3-9d7b-5295d68e90e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:02.185179 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb292ed-5c5b-4cf3-9d7b-5295d68e90e5 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:02.188877 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7115d9-86a6-4946-924c-4a47f3106750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:02.189542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7115d9-86a6-4946-924c-4a47f3106750 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:02.189828 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7115d9-86a6-4946-924c-4a47f3106750 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:02.190097 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7115d9-86a6-4946-924c-4a47f3106750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:02.212677 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7115d9-86a6-4946-924c-4a47f3106750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:02.214344 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7115d9-86a6-4946-924c-4a47f3106750 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:02.234612 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1367/2681] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 24 01:21:02.593261 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc3312-2918-4b74-b09e-29f08010591a None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:02.594740 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-eabc3312-2918-4b74-b09e-29f08010591a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:02.613306 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc3312-2918-4b74-b09e-29f08010591a None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:02.620100 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c287b00-66bb-4d4c-a9ec-45455146beff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:02.621718 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c287b00-66bb-4d4c-a9ec-45455146beff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:02.622339 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c287b00-66bb-4d4c-a9ec-45455146beff admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:02.622922 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c287b00-66bb-4d4c-a9ec-45455146beff admin admin] PATH_INFO: `/v3/projects/9aa0a91f66f14e798d257c8767aeeb32` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:02.625634 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c287b00-66bb-4d4c-a9ec-45455146beff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa0a91f66f14e798d257c8767aeeb32)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:02.628759 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c287b00-66bb-4d4c-a9ec-45455146beff admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:02.692846 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8c287b00-66bb-4d4c-a9ec-45455146beff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa0a91f66f14e798d257c8767aeeb32', 'request_id': 'req-8c287b00-66bb-4d4c-a9ec-45455146beff'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:02.705464 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8c287b00-66bb-4d4c-a9ec-45455146beff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa0a91f66f14e798d257c8767aeeb32', 'request_id': 'req-8c287b00-66bb-4d4c-a9ec-45455146beff'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:02.712652 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8c287b00-66bb-4d4c-a9ec-45455146beff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa0a91f66f14e798d257c8767aeeb32', 'request_id': 'req-8c287b00-66bb-4d4c-a9ec-45455146beff'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:02.726966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8c287b00-66bb-4d4c-a9ec-45455146beff admin admin] The token cache is being invalidate because project 9aa0a91f66f14e798d257c8767aeeb32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:02.727383 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8c287b00-66bb-4d4c-a9ec-45455146beff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:02.728181 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-8c287b00-66bb-4d4c-a9ec-45455146beff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:02.730969 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1315/2682] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:02 2022] DELETE /identity/v3/projects/9aa0a91f66f14e798d257c8767aeeb32 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:04.947604 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7115d9-86a6-4946-924c-4a47f3106750 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:04.949204 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7d7115d9-86a6-4946-924c-4a47f3106750 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:04.962825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7115d9-86a6-4946-924c-4a47f3106750 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:05.020410 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975678b-3507-4ee8-a8ba-8541e89c8f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:05.021284 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975678b-3507-4ee8-a8ba-8541e89c8f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:05.021560 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975678b-3507-4ee8-a8ba-8541e89c8f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:05.021827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975678b-3507-4ee8-a8ba-8541e89c8f9b admin admin] PATH_INFO: `/v3/users/9be924c86b3f460ca05c81f2928c5261` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:05.023044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975678b-3507-4ee8-a8ba-8541e89c8f9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9be924c86b3f460ca05c81f2928c5261)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:05.025012 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975678b-3507-4ee8-a8ba-8541e89c8f9b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:05.075757 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1975678b-3507-4ee8-a8ba-8541e89c8f9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9be924c86b3f460ca05c81f2928c5261'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:05.076324 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1975678b-3507-4ee8-a8ba-8541e89c8f9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9be924c86b3f460ca05c81f2928c5261'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:05.084835 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1975678b-3507-4ee8-a8ba-8541e89c8f9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9be924c86b3f460ca05c81f2928c5261'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:05.085451 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1975678b-3507-4ee8-a8ba-8541e89c8f9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9be924c86b3f460ca05c81f2928c5261'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:05.092291 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1975678b-3507-4ee8-a8ba-8541e89c8f9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9be924c86b3f460ca05c81f2928c5261'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:05.109393 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1368/2683] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:04 2022] DELETE /identity/v3/users/9be924c86b3f460ca05c81f2928c5261 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:05.113966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881e2a7-e67d-466e-9e9d-280299a1b996 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:05.114469 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881e2a7-e67d-466e-9e9d-280299a1b996 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:05.114587 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c881e2a7-e67d-466e-9e9d-280299a1b996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:05.134290 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c881e2a7-e67d-466e-9e9d-280299a1b996 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:05.135804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c881e2a7-e67d-466e-9e9d-280299a1b996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:05.182540 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:05.199850 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1316/2684] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:05.209793 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975678b-3507-4ee8-a8ba-8541e89c8f9b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:05.211347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1975678b-3507-4ee8-a8ba-8541e89c8f9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:05.230455 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:05.273145 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975678b-3507-4ee8-a8ba-8541e89c8f9b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:05.277872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddff7d-0d96-4355-b19e-b39166dace59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:05.278518 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddff7d-0d96-4355-b19e-b39166dace59 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:05.278798 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddff7d-0d96-4355-b19e-b39166dace59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:05.279071 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ddff7d-0d96-4355-b19e-b39166dace59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:05.289330 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddff7d-0d96-4355-b19e-b39166dace59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:05.290775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ddff7d-0d96-4355-b19e-b39166dace59 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:05.300959 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1369/2685] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:05.627903 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881e2a7-e67d-466e-9e9d-280299a1b996 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:05.629350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c881e2a7-e67d-466e-9e9d-280299a1b996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:05.641544 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c881e2a7-e67d-466e-9e9d-280299a1b996 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:05.646826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2265d8-8c92-4c94-a878-7b41802d90d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:05.647766 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2265d8-8c92-4c94-a878-7b41802d90d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:05.648054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2265d8-8c92-4c94-a878-7b41802d90d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:05.648326 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2265d8-8c92-4c94-a878-7b41802d90d2 admin admin] PATH_INFO: `/v3/projects/cf728d6bbd4a4980be2b8674bc5c3024` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:05.649719 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2265d8-8c92-4c94-a878-7b41802d90d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf728d6bbd4a4980be2b8674bc5c3024)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:05.652126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2265d8-8c92-4c94-a878-7b41802d90d2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:05.707762 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3f2265d8-8c92-4c94-a878-7b41802d90d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf728d6bbd4a4980be2b8674bc5c3024', 'request_id': 'req-3f2265d8-8c92-4c94-a878-7b41802d90d2'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:05.715966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3f2265d8-8c92-4c94-a878-7b41802d90d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf728d6bbd4a4980be2b8674bc5c3024', 'request_id': 'req-3f2265d8-8c92-4c94-a878-7b41802d90d2'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:05.721639 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3f2265d8-8c92-4c94-a878-7b41802d90d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf728d6bbd4a4980be2b8674bc5c3024', 'request_id': 'req-3f2265d8-8c92-4c94-a878-7b41802d90d2'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:05.733438 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3f2265d8-8c92-4c94-a878-7b41802d90d2 admin admin] The token cache is being invalidate because project cf728d6bbd4a4980be2b8674bc5c3024 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:05.733730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3f2265d8-8c92-4c94-a878-7b41802d90d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:05.734386 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-3f2265d8-8c92-4c94-a878-7b41802d90d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:05.735993 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1317/2686] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:05 2022] DELETE /identity/v3/projects/cf728d6bbd4a4980be2b8674bc5c3024 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:05.740260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddff7d-0d96-4355-b19e-b39166dace59 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:05.750436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ddff7d-0d96-4355-b19e-b39166dace59 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:05.807952 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3891a058-622e-4001-a976-b8f0c8781422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:05.808842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891a058-622e-4001-a976-b8f0c8781422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:05.809126 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891a058-622e-4001-a976-b8f0c8781422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:05.809402 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3891a058-622e-4001-a976-b8f0c8781422 admin admin] PATH_INFO: `/v3/users/1028f4ae77444f548d157ed152a2aaf9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:05.810635 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891a058-622e-4001-a976-b8f0c8781422 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1028f4ae77444f548d157ed152a2aaf9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:05.812607 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3891a058-622e-4001-a976-b8f0c8781422 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:05.863356 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3891a058-622e-4001-a976-b8f0c8781422 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1028f4ae77444f548d157ed152a2aaf9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:05.864042 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3891a058-622e-4001-a976-b8f0c8781422 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1028f4ae77444f548d157ed152a2aaf9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:05.871405 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3891a058-622e-4001-a976-b8f0c8781422 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1028f4ae77444f548d157ed152a2aaf9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:05.872210 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3891a058-622e-4001-a976-b8f0c8781422 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1028f4ae77444f548d157ed152a2aaf9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:05.879177 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-3891a058-622e-4001-a976-b8f0c8781422 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1028f4ae77444f548d157ed152a2aaf9'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:05.895986 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1370/2687] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:05 2022] DELETE /identity/v3/users/1028f4ae77444f548d157ed152a2aaf9 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:06.183243 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2265d8-8c92-4c94-a878-7b41802d90d2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:06.184746 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3f2265d8-8c92-4c94-a878-7b41802d90d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:06.200159 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2265d8-8c92-4c94-a878-7b41802d90d2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:06.258498 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73717c1-6f6c-4e48-b2ca-7e5976c2e384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:06.259378 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73717c1-6f6c-4e48-b2ca-7e5976c2e384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:06.259666 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73717c1-6f6c-4e48-b2ca-7e5976c2e384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:06.259950 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73717c1-6f6c-4e48-b2ca-7e5976c2e384 admin admin] PATH_INFO: `/v3/projects/0abef1d67df5480d8e69be29f3241118` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:06.261183 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73717c1-6f6c-4e48-b2ca-7e5976c2e384 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0abef1d67df5480d8e69be29f3241118)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:06.263114 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73717c1-6f6c-4e48-b2ca-7e5976c2e384 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:06.309831 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e73717c1-6f6c-4e48-b2ca-7e5976c2e384 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0abef1d67df5480d8e69be29f3241118', 'request_id': 'req-e73717c1-6f6c-4e48-b2ca-7e5976c2e384'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:06.319131 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e73717c1-6f6c-4e48-b2ca-7e5976c2e384 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0abef1d67df5480d8e69be29f3241118', 'request_id': 'req-e73717c1-6f6c-4e48-b2ca-7e5976c2e384'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:06.324826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e73717c1-6f6c-4e48-b2ca-7e5976c2e384 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0abef1d67df5480d8e69be29f3241118', 'request_id': 'req-e73717c1-6f6c-4e48-b2ca-7e5976c2e384'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:06.337675 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e73717c1-6f6c-4e48-b2ca-7e5976c2e384 admin admin] The token cache is being invalidate because project 0abef1d67df5480d8e69be29f3241118 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:06.337966 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e73717c1-6f6c-4e48-b2ca-7e5976c2e384 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:06.338689 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-e73717c1-6f6c-4e48-b2ca-7e5976c2e384 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:06.340297 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1318/2688] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:06 2022] DELETE /identity/v3/projects/0abef1d67df5480d8e69be29f3241118 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:06.345421 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d86aa-86c3-4c21-b57a-2d42ecd6121e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:06.346007 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d86aa-86c3-4c21-b57a-2d42ecd6121e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:06.346007 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d86aa-86c3-4c21-b57a-2d42ecd6121e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:06.365358 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-b55d86aa-86c3-4c21-b57a-2d42ecd6121e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:06.366487 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b55d86aa-86c3-4c21-b57a-2d42ecd6121e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:06.403157 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:06.432485 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1371/2689] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:06.440803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454d585-175c-4f34-b106-08801a0e0f77 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:06.441198 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454d585-175c-4f34-b106-08801a0e0f77 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:06.441463 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6454d585-175c-4f34-b106-08801a0e0f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:06.448066 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:06.463033 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6454d585-175c-4f34-b106-08801a0e0f77 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:06.464807 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6454d585-175c-4f34-b106-08801a0e0f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:06.473459 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1319/2690] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:06.477998 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d86aa-86c3-4c21-b57a-2d42ecd6121e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:06.487831 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d86aa-86c3-4c21-b57a-2d42ecd6121e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:06.492463 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135de89-a3eb-46c7-b17c-d081f85cd614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:06.493167 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135de89-a3eb-46c7-b17c-d081f85cd614 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:06.493450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135de89-a3eb-46c7-b17c-d081f85cd614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:06.493725 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0135de89-a3eb-46c7-b17c-d081f85cd614 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:06.494459 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135de89-a3eb-46c7-b17c-d081f85cd614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:21:06.494769 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135de89-a3eb-46c7-b17c-d081f85cd614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:06.496432 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0135de89-a3eb-46c7-b17c-d081f85cd614 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:06.509377 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1372/2691] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:21:06.513828 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454d585-175c-4f34-b106-08801a0e0f77 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:06.523396 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6454d585-175c-4f34-b106-08801a0e0f77 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:06.528850 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715c18e-9272-46a2-8180-1c32be0fa05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:06.529501 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715c18e-9272-46a2-8180-1c32be0fa05e admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:06.529783 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715c18e-9272-46a2-8180-1c32be0fa05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:06.530054 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7715c18e-9272-46a2-8180-1c32be0fa05e admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:06.530743 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715c18e-9272-46a2-8180-1c32be0fa05e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:06.532702 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7715c18e-9272-46a2-8180-1c32be0fa05e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:06.565668 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1320/2692] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:21:06 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:06.570454 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135de89-a3eb-46c7-b17c-d081f85cd614 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:06.581488 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0135de89-a3eb-46c7-b17c-d081f85cd614 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:06.640141 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77057da1-34aa-4420-bc73-f7dd173aad76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:06.640731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77057da1-34aa-4420-bc73-f7dd173aad76 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:06.641016 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77057da1-34aa-4420-bc73-f7dd173aad76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:06.641291 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77057da1-34aa-4420-bc73-f7dd173aad76 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:06.641986 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77057da1-34aa-4420-bc73-f7dd173aad76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:06.643949 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77057da1-34aa-4420-bc73-f7dd173aad76 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:06.665046 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1373/2693] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:21:06 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:06.669366 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715c18e-9272-46a2-8180-1c32be0fa05e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:06.681920 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7715c18e-9272-46a2-8180-1c32be0fa05e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:06.689592 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8076022-9b42-4817-bc61-c6b8e4f51d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:06.690307 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8076022-9b42-4817-bc61-c6b8e4f51d9c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:06.690594 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8076022-9b42-4817-bc61-c6b8e4f51d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:06.690875 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8076022-9b42-4817-bc61-c6b8e4f51d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:06.691659 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8076022-9b42-4817-bc61-c6b8e4f51d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:06.693317 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8076022-9b42-4817-bc61-c6b8e4f51d9c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:06.705748 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1321/2694] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:06.710059 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77057da1-34aa-4420-bc73-f7dd173aad76 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:06.720332 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77057da1-34aa-4420-bc73-f7dd173aad76 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:06.725134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce4f6f-c254-4304-af0c-c1ed470da7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:06.725817 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce4f6f-c254-4304-af0c-c1ed470da7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:06.726096 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce4f6f-c254-4304-af0c-c1ed470da7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:06.726375 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce4f6f-c254-4304-af0c-c1ed470da7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:06.727112 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce4f6f-c254-4304-af0c-c1ed470da7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:06.728844 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce4f6f-c254-4304-af0c-c1ed470da7b4 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:06.739361 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1374/2695] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:06.743753 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8076022-9b42-4817-bc61-c6b8e4f51d9c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:06.754067 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8076022-9b42-4817-bc61-c6b8e4f51d9c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:06.758706 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c89ee0-8e53-4f4b-af50-95dcf629e7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:06.759645 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c89ee0-8e53-4f4b-af50-95dcf629e7d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:06.759928 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c89ee0-8e53-4f4b-af50-95dcf629e7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:06.760204 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c89ee0-8e53-4f4b-af50-95dcf629e7d2 admin admin] PATH_INFO: `/v3/projects/64812326be594452ad8d4cfaa718da64/users/a31c1305b3b5458893034fffbcf8ac1b/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:06.780070 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c89ee0-8e53-4f4b-af50-95dcf629e7d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64812326be594452ad8d4cfaa718da64, user_id=a31c1305b3b5458893034fffbcf8ac1b, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:06.782983 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c89ee0-8e53-4f4b-af50-95dcf629e7d2 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:06.797382 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1322/2696] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:06 2022] PUT /identity/v3/projects/64812326be594452ad8d4cfaa718da64/users/a31c1305b3b5458893034fffbcf8ac1b/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:06.808679 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5b1fd-98db-4bc2-9eab-94b2f9d58fe7 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:06.808999 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5b1fd-98db-4bc2-9eab-94b2f9d58fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:06.809283 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb5b1fd-98db-4bc2-9eab-94b2f9d58fe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:06.839014 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-1cb5b1fd-98db-4bc2-9eab-94b2f9d58fe7 None None] MFA Rules not processed for user `a31c1305b3b5458893034fffbcf8ac1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:06.840275 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1cb5b1fd-98db-4bc2-9eab-94b2f9d58fe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:06.906019 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1375/2697] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:06.910695 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c89ee0-8e53-4f4b-af50-95dcf629e7d2 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:06.972396 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c89ee0-8e53-4f4b-af50-95dcf629e7d2 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:06.979043 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86789c0-c52e-4bf6-a1f4-8e7a5477eb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:06.980076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86789c0-c52e-4bf6-a1f4-8e7a5477eb9c admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:06.980463 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86789c0-c52e-4bf6-a1f4-8e7a5477eb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:06.980863 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86789c0-c52e-4bf6-a1f4-8e7a5477eb9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:06.981945 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86789c0-c52e-4bf6-a1f4-8e7a5477eb9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:06.984889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86789c0-c52e-4bf6-a1f4-8e7a5477eb9c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:07.014722 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1323/2698] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:21:06 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:07.018931 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5b1fd-98db-4bc2-9eab-94b2f9d58fe7 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:07.030462 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb5b1fd-98db-4bc2-9eab-94b2f9d58fe7 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:07.061077 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:07.096500 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f7286-c5fa-4cbf-a313-aefa09b1d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:07.097173 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f7286-c5fa-4cbf-a313-aefa09b1d66d admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:07.097452 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f7286-c5fa-4cbf-a313-aefa09b1d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:07.097724 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f7286-c5fa-4cbf-a313-aefa09b1d66d admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:07.098404 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f7286-c5fa-4cbf-a313-aefa09b1d66d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:07.100371 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f7286-c5fa-4cbf-a313-aefa09b1d66d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:07.121147 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1376/2699] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:21:07 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:07.125261 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86789c0-c52e-4bf6-a1f4-8e7a5477eb9c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:07.136364 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86789c0-c52e-4bf6-a1f4-8e7a5477eb9c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:07.141524 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dae8b-060c-4a61-98ee-2aa16091eba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:07.142215 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dae8b-060c-4a61-98ee-2aa16091eba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:07.142496 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dae8b-060c-4a61-98ee-2aa16091eba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:07.142772 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4dae8b-060c-4a61-98ee-2aa16091eba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:07.143549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dae8b-060c-4a61-98ee-2aa16091eba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:07.145147 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4dae8b-060c-4a61-98ee-2aa16091eba8 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:07.156250 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1324/2700] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:07.160372 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f7286-c5fa-4cbf-a313-aefa09b1d66d admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:07.170913 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f7286-c5fa-4cbf-a313-aefa09b1d66d admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:07.176890 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85051c53-1ac1-41c0-adf4-b926d855a6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:07.177807 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85051c53-1ac1-41c0-adf4-b926d855a6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:07.178093 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85051c53-1ac1-41c0-adf4-b926d855a6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:07.178347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85051c53-1ac1-41c0-adf4-b926d855a6aa admin admin] PATH_INFO: `/v3/projects/13b7228ea7444e3a8aa488c136c515ab/users/113a0d2162834c2d9cd5d40560b05919/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:07.194305 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85051c53-1ac1-41c0-adf4-b926d855a6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b7228ea7444e3a8aa488c136c515ab, user_id=113a0d2162834c2d9cd5d40560b05919, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:07.197148 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85051c53-1ac1-41c0-adf4-b926d855a6aa admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:07.213519 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1377/2701] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:07 2022] PUT /identity/v3/projects/13b7228ea7444e3a8aa488c136c515ab/users/113a0d2162834c2d9cd5d40560b05919/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:21:07.217777 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dae8b-060c-4a61-98ee-2aa16091eba8 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:07.228427 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4dae8b-060c-4a61-98ee-2aa16091eba8 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:07.286116 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70314763-e22a-4273-a021-76aaf6b243fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:07.286822 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70314763-e22a-4273-a021-76aaf6b243fc admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:07.287111 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70314763-e22a-4273-a021-76aaf6b243fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:07.287511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70314763-e22a-4273-a021-76aaf6b243fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:07.288148 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70314763-e22a-4273-a021-76aaf6b243fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:07.289873 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70314763-e22a-4273-a021-76aaf6b243fc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:07.300334 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1325/2702] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:07.304699 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85051c53-1ac1-41c0-adf4-b926d855a6aa admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:07.315691 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85051c53-1ac1-41c0-adf4-b926d855a6aa admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:07.321298 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8ad95-c8a5-4e16-85d4-ce66dda323e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:07.322216 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8ad95-c8a5-4e16-85d4-ce66dda323e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:07.322496 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8ad95-c8a5-4e16-85d4-ce66dda323e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:07.322771 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8ad95-c8a5-4e16-85d4-ce66dda323e2 admin admin] PATH_INFO: `/v3/projects/13b7228ea7444e3a8aa488c136c515ab/users/113a0d2162834c2d9cd5d40560b05919/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:07.324994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8ad95-c8a5-4e16-85d4-ce66dda323e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13b7228ea7444e3a8aa488c136c515ab, user_id=113a0d2162834c2d9cd5d40560b05919, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:07.327712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8ad95-c8a5-4e16-85d4-ce66dda323e2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:07.338999 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1378/2703] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:07 2022] PUT /identity/v3/projects/13b7228ea7444e3a8aa488c136c515ab/users/113a0d2162834c2d9cd5d40560b05919/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:07.349442 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940304c-3113-4aa6-9076-946f4b3c55e0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:07.349738 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940304c-3113-4aa6-9076-946f4b3c55e0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:07.350037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5940304c-3113-4aa6-9076-946f4b3c55e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:07.369328 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:07.378906 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5940304c-3113-4aa6-9076-946f4b3c55e0 None None] MFA Rules not processed for user `113a0d2162834c2d9cd5d40560b05919`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:07.380570 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5940304c-3113-4aa6-9076-946f4b3c55e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:07.449895 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1326/2704] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:07.461102 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8ad95-c8a5-4e16-85d4-ce66dda323e2 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:07.463188 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d7f8ad95-c8a5-4e16-85d4-ce66dda323e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:07.528675 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8ad95-c8a5-4e16-85d4-ce66dda323e2 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:07.533141 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a158bb3-135e-4f2d-8e03-1743f0f9c167 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:07.533787 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a158bb3-135e-4f2d-8e03-1743f0f9c167 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:07.534091 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a158bb3-135e-4f2d-8e03-1743f0f9c167 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:07.534394 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a158bb3-135e-4f2d-8e03-1743f0f9c167 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:07.544749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a158bb3-135e-4f2d-8e03-1743f0f9c167 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:07.546628 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a158bb3-135e-4f2d-8e03-1743f0f9c167 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:07.556900 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1379/2705] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:07.656298 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940304c-3113-4aa6-9076-946f4b3c55e0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:07.667070 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5940304c-3113-4aa6-9076-946f4b3c55e0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:07.671983 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb32b7-e504-4f50-93a0-f328a7ab5a7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:07.672633 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb32b7-e504-4f50-93a0-f328a7ab5a7c service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:07.672921 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb32b7-e504-4f50-93a0-f328a7ab5a7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:07.673204 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb32b7-e504-4f50-93a0-f328a7ab5a7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:07.744078 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb32b7-e504-4f50-93a0-f328a7ab5a7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:07.745464 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb32b7-e504-4f50-93a0-f328a7ab5a7c service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:07.754803 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1327/2706] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:10.383885 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a158bb3-135e-4f2d-8e03-1743f0f9c167 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:10.447687 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a158bb3-135e-4f2d-8e03-1743f0f9c167 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:10.452457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e860594-fb8a-4839-9056-9c4c18881f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:10.453342 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e860594-fb8a-4839-9056-9c4c18881f18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:10.453619 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e860594-fb8a-4839-9056-9c4c18881f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:10.453893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e860594-fb8a-4839-9056-9c4c18881f18 admin admin] PATH_INFO: `/v3/users/a31c1305b3b5458893034fffbcf8ac1b` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:10.455089 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e860594-fb8a-4839-9056-9c4c18881f18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a31c1305b3b5458893034fffbcf8ac1b)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:10.457082 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e860594-fb8a-4839-9056-9c4c18881f18 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:10.493380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:10.509168 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1e860594-fb8a-4839-9056-9c4c18881f18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a31c1305b3b5458893034fffbcf8ac1b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:10.509852 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1e860594-fb8a-4839-9056-9c4c18881f18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a31c1305b3b5458893034fffbcf8ac1b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:10.521441 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1e860594-fb8a-4839-9056-9c4c18881f18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a31c1305b3b5458893034fffbcf8ac1b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:10.522063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1e860594-fb8a-4839-9056-9c4c18881f18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a31c1305b3b5458893034fffbcf8ac1b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:10.529207 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-1e860594-fb8a-4839-9056-9c4c18881f18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a31c1305b3b5458893034fffbcf8ac1b'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:10.548583 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1380/2707] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:10 2022] DELETE /identity/v3/users/a31c1305b3b5458893034fffbcf8ac1b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:10.553137 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f4679-41c7-49aa-8a73-4187034d720e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:10.553622 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f4679-41c7-49aa-8a73-4187034d720e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:10.553736 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0f4679-41c7-49aa-8a73-4187034d720e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:10.570933 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-6b0f4679-41c7-49aa-8a73-4187034d720e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:10.572162 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6b0f4679-41c7-49aa-8a73-4187034d720e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:10.643931 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1328/2708] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:10.656454 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e860594-fb8a-4839-9056-9c4c18881f18 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:10.658680 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-1e860594-fb8a-4839-9056-9c4c18881f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:10.728836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e860594-fb8a-4839-9056-9c4c18881f18 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:10.733480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fd214-f9d9-438a-9e31-ba7bc7cb4bb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:10.734126 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fd214-f9d9-438a-9e31-ba7bc7cb4bb5 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:10.734414 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fd214-f9d9-438a-9e31-ba7bc7cb4bb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:10.734680 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67fd214-f9d9-438a-9e31-ba7bc7cb4bb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:10.744240 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fd214-f9d9-438a-9e31-ba7bc7cb4bb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:10.745701 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67fd214-f9d9-438a-9e31-ba7bc7cb4bb5 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:10.755480 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1381/2709] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:11.031591 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f4679-41c7-49aa-8a73-4187034d720e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:11.033280 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6b0f4679-41c7-49aa-8a73-4187034d720e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:11.048312 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0f4679-41c7-49aa-8a73-4187034d720e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:11.053928 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5bbc2-b886-4d59-a191-ddacdd22084e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:11.054947 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5bbc2-b886-4d59-a191-ddacdd22084e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:11.055111 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5bbc2-b886-4d59-a191-ddacdd22084e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:11.055420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5bbc2-b886-4d59-a191-ddacdd22084e admin admin] PATH_INFO: `/v3/projects/64812326be594452ad8d4cfaa718da64` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:11.056821 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5bbc2-b886-4d59-a191-ddacdd22084e admin admin] RBAC: Authorizing `identity:delete_project(project_id=64812326be594452ad8d4cfaa718da64)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:11.058902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5bbc2-b886-4d59-a191-ddacdd22084e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:11.093056 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:11.109208 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cff5bbc2-b886-4d59-a191-ddacdd22084e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64812326be594452ad8d4cfaa718da64', 'request_id': 'req-cff5bbc2-b886-4d59-a191-ddacdd22084e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.116867 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cff5bbc2-b886-4d59-a191-ddacdd22084e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64812326be594452ad8d4cfaa718da64', 'request_id': 'req-cff5bbc2-b886-4d59-a191-ddacdd22084e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.122486 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cff5bbc2-b886-4d59-a191-ddacdd22084e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64812326be594452ad8d4cfaa718da64', 'request_id': 'req-cff5bbc2-b886-4d59-a191-ddacdd22084e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.133912 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cff5bbc2-b886-4d59-a191-ddacdd22084e admin admin] The token cache is being invalidate because project 64812326be594452ad8d4cfaa718da64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:11.134205 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cff5bbc2-b886-4d59-a191-ddacdd22084e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.134947 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-cff5bbc2-b886-4d59-a191-ddacdd22084e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.136630 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1329/2710] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:11 2022] DELETE /identity/v3/projects/64812326be594452ad8d4cfaa718da64 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:11.140827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fd214-f9d9-438a-9e31-ba7bc7cb4bb5 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:11.150509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67fd214-f9d9-438a-9e31-ba7bc7cb4bb5 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:11.208818 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ec93fe-50d4-4578-8887-354ba80bff94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:11.209737 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec93fe-50d4-4578-8887-354ba80bff94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:11.210019 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec93fe-50d4-4578-8887-354ba80bff94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:11.210291 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ec93fe-50d4-4578-8887-354ba80bff94 admin admin] PATH_INFO: `/v3/users/113a0d2162834c2d9cd5d40560b05919` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:11.211548 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec93fe-50d4-4578-8887-354ba80bff94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=113a0d2162834c2d9cd5d40560b05919)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:11.213868 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ec93fe-50d4-4578-8887-354ba80bff94 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:11.266106 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-11ec93fe-50d4-4578-8887-354ba80bff94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113a0d2162834c2d9cd5d40560b05919'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.266795 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-11ec93fe-50d4-4578-8887-354ba80bff94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113a0d2162834c2d9cd5d40560b05919'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.271215 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:11.277634 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-11ec93fe-50d4-4578-8887-354ba80bff94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113a0d2162834c2d9cd5d40560b05919'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.278682 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-11ec93fe-50d4-4578-8887-354ba80bff94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113a0d2162834c2d9cd5d40560b05919'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.288258 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-11ec93fe-50d4-4578-8887-354ba80bff94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113a0d2162834c2d9cd5d40560b05919'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.309424 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1382/2711] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:11 2022] DELETE /identity/v3/users/113a0d2162834c2d9cd5d40560b05919 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:11.631582 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5bbc2-b886-4d59-a191-ddacdd22084e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:11.633576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cff5bbc2-b886-4d59-a191-ddacdd22084e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:11.661550 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5bbc2-b886-4d59-a191-ddacdd22084e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:11.732420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0a16f5-8a51-473c-9654-505d8bb4f640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:11.733343 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a16f5-8a51-473c-9654-505d8bb4f640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:11.734194 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a16f5-8a51-473c-9654-505d8bb4f640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:11.734506 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0a16f5-8a51-473c-9654-505d8bb4f640 admin admin] PATH_INFO: `/v3/projects/13b7228ea7444e3a8aa488c136c515ab` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:11.735778 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a16f5-8a51-473c-9654-505d8bb4f640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13b7228ea7444e3a8aa488c136c515ab)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:11.737701 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0a16f5-8a51-473c-9654-505d8bb4f640 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:11.800223 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2c0a16f5-8a51-473c-9654-505d8bb4f640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13b7228ea7444e3a8aa488c136c515ab', 'request_id': 'req-2c0a16f5-8a51-473c-9654-505d8bb4f640'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.808660 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2c0a16f5-8a51-473c-9654-505d8bb4f640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13b7228ea7444e3a8aa488c136c515ab', 'request_id': 'req-2c0a16f5-8a51-473c-9654-505d8bb4f640'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.814528 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2c0a16f5-8a51-473c-9654-505d8bb4f640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13b7228ea7444e3a8aa488c136c515ab', 'request_id': 'req-2c0a16f5-8a51-473c-9654-505d8bb4f640'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.826234 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2c0a16f5-8a51-473c-9654-505d8bb4f640 admin admin] The token cache is being invalidate because project 13b7228ea7444e3a8aa488c136c515ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:11.826532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2c0a16f5-8a51-473c-9654-505d8bb4f640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.827203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-2c0a16f5-8a51-473c-9654-505d8bb4f640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:11.828804 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1330/2712] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:11 2022] DELETE /identity/v3/projects/13b7228ea7444e3a8aa488c136c515ab => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:11.834045 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd92494-28bf-4ffd-b0e6-c3bfa5bc79a5 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:11.834619 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd92494-28bf-4ffd-b0e6-c3bfa5bc79a5 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:11.834619 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd92494-28bf-4ffd-b0e6-c3bfa5bc79a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:11.855631 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5cd92494-28bf-4ffd-b0e6-c3bfa5bc79a5 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:11.856959 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5cd92494-28bf-4ffd-b0e6-c3bfa5bc79a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:11.924854 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1383/2713] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:21:11.932936 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c397aa-6c06-4d2a-b1e8-ea2faf8b25b0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:11.933227 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c397aa-6c06-4d2a-b1e8-ea2faf8b25b0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:11.933511 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c397aa-6c06-4d2a-b1e8-ea2faf8b25b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:11.955723 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-c2c397aa-6c06-4d2a-b1e8-ea2faf8b25b0 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:11.957327 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-c2c397aa-6c06-4d2a-b1e8-ea2faf8b25b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:11.967138 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1331/2714] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:11.972183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd92494-28bf-4ffd-b0e6-c3bfa5bc79a5 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:11.982007 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd92494-28bf-4ffd-b0e6-c3bfa5bc79a5 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:11.987349 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fa52d-2b5f-4107-a7fc-c0e1cc2a7611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:11.988079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fa52d-2b5f-4107-a7fc-c0e1cc2a7611 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:11.988425 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fa52d-2b5f-4107-a7fc-c0e1cc2a7611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:11.988768 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7fa52d-2b5f-4107-a7fc-c0e1cc2a7611 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:11.989571 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fa52d-2b5f-4107-a7fc-c0e1cc2a7611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:21:11.989967 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fa52d-2b5f-4107-a7fc-c0e1cc2a7611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:11.991974 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7fa52d-2b5f-4107-a7fc-c0e1cc2a7611 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:12.005471 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1384/2715] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:21:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:21:12.009804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c397aa-6c06-4d2a-b1e8-ea2faf8b25b0 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:12.019504 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c397aa-6c06-4d2a-b1e8-ea2faf8b25b0 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:12.024451 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ce922-6ec6-4b27-b931-f4373e5e9f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:12.025049 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ce922-6ec6-4b27-b931-f4373e5e9f1f admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:12.025382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ce922-6ec6-4b27-b931-f4373e5e9f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:12.025662 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528ce922-6ec6-4b27-b931-f4373e5e9f1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:12.026367 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ce922-6ec6-4b27-b931-f4373e5e9f1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:12.028526 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528ce922-6ec6-4b27-b931-f4373e5e9f1f admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:12.055734 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1332/2716] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:21:12 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:12.061515 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fa52d-2b5f-4107-a7fc-c0e1cc2a7611 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:12.071672 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7fa52d-2b5f-4107-a7fc-c0e1cc2a7611 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:12.126384 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe24f21-9e31-469f-be4d-c9c652166071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:12.127061 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe24f21-9e31-469f-be4d-c9c652166071 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:12.127388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe24f21-9e31-469f-be4d-c9c652166071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:12.127667 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe24f21-9e31-469f-be4d-c9c652166071 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:12.128351 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe24f21-9e31-469f-be4d-c9c652166071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:12.130294 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe24f21-9e31-469f-be4d-c9c652166071 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:12.153411 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1385/2717] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:21:12 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:21:12.157802 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ce922-6ec6-4b27-b931-f4373e5e9f1f admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:12.168801 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528ce922-6ec6-4b27-b931-f4373e5e9f1f admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:12.174306 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57751761-cc43-446b-9bea-3aaa20ceee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:12.175035 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57751761-cc43-446b-9bea-3aaa20ceee81 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:12.175270 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57751761-cc43-446b-9bea-3aaa20ceee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:12.175593 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57751761-cc43-446b-9bea-3aaa20ceee81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:12.176335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57751761-cc43-446b-9bea-3aaa20ceee81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:12.177973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57751761-cc43-446b-9bea-3aaa20ceee81 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:12.189652 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1333/2718] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:12.193686 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe24f21-9e31-469f-be4d-c9c652166071 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:12.203877 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe24f21-9e31-469f-be4d-c9c652166071 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:12.208654 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a646c6-060d-4ea5-bcdb-680ef6cc0cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:12.209317 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a646c6-060d-4ea5-bcdb-680ef6cc0cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:12.209600 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a646c6-060d-4ea5-bcdb-680ef6cc0cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:12.209844 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a646c6-060d-4ea5-bcdb-680ef6cc0cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:12.210573 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a646c6-060d-4ea5-bcdb-680ef6cc0cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:12.212260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a646c6-060d-4ea5-bcdb-680ef6cc0cd5 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:12.223060 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1386/2719] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:21:12.227143 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57751761-cc43-446b-9bea-3aaa20ceee81 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:12.237345 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57751761-cc43-446b-9bea-3aaa20ceee81 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:12.242636 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ddb65-192d-4e23-ac8c-05f4acf6cf71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:12.243703 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ddb65-192d-4e23-ac8c-05f4acf6cf71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:12.244018 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ddb65-192d-4e23-ac8c-05f4acf6cf71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:12.244284 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52ddb65-192d-4e23-ac8c-05f4acf6cf71 admin admin] PATH_INFO: `/v3/projects/3fa5c1438e594e1f9a82c4f0dc9d6728/users/8459aacaf3b04c97bfa5396114d5dd75/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:12.246546 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:12.263425 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ddb65-192d-4e23-ac8c-05f4acf6cf71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa5c1438e594e1f9a82c4f0dc9d6728, user_id=8459aacaf3b04c97bfa5396114d5dd75, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:12.266364 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52ddb65-192d-4e23-ac8c-05f4acf6cf71 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:12.280143 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1334/2720] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:12 2022] PUT /identity/v3/projects/3fa5c1438e594e1f9a82c4f0dc9d6728/users/8459aacaf3b04c97bfa5396114d5dd75/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:12.290489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9836cc0-aba1-46d5-922b-621b5eeca875 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:12.290783 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9836cc0-aba1-46d5-922b-621b5eeca875 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:12.291060 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9836cc0-aba1-46d5-922b-621b5eeca875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:12.318525 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-a9836cc0-aba1-46d5-922b-621b5eeca875 None None] MFA Rules not processed for user `8459aacaf3b04c97bfa5396114d5dd75`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:12.319825 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a9836cc0-aba1-46d5-922b-621b5eeca875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:12.343908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:12.392391 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1387/2721] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:12.404232 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ddb65-192d-4e23-ac8c-05f4acf6cf71 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:12.406462 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b52ddb65-192d-4e23-ac8c-05f4acf6cf71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:12.467045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52ddb65-192d-4e23-ac8c-05f4acf6cf71 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:12.471032 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f735cc4f-241f-4237-a541-669d32fd4a1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:12.471728 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735cc4f-241f-4237-a541-669d32fd4a1f service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:12.472018 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735cc4f-241f-4237-a541-669d32fd4a1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:12.472295 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f735cc4f-241f-4237-a541-669d32fd4a1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:12.480785 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735cc4f-241f-4237-a541-669d32fd4a1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:12.482235 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f735cc4f-241f-4237-a541-669d32fd4a1f service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:12.491668 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1335/2722] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:12.513790 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9836cc0-aba1-46d5-922b-621b5eeca875 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:12.586274 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9836cc0-aba1-46d5-922b-621b5eeca875 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:12.591781 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d39165-187b-4632-8c58-e5d22c897101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:12.592659 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d39165-187b-4632-8c58-e5d22c897101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:12.592942 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d39165-187b-4632-8c58-e5d22c897101 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:12.593215 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d39165-187b-4632-8c58-e5d22c897101 admin admin] PATH_INFO: `/v3/users/8459aacaf3b04c97bfa5396114d5dd75` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:12.594512 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d39165-187b-4632-8c58-e5d22c897101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8459aacaf3b04c97bfa5396114d5dd75)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:12.596502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d39165-187b-4632-8c58-e5d22c897101 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:12.645801 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-85d39165-187b-4632-8c58-e5d22c897101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8459aacaf3b04c97bfa5396114d5dd75'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:12.646460 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-85d39165-187b-4632-8c58-e5d22c897101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8459aacaf3b04c97bfa5396114d5dd75'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:12.654883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-85d39165-187b-4632-8c58-e5d22c897101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8459aacaf3b04c97bfa5396114d5dd75'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:12.655943 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-85d39165-187b-4632-8c58-e5d22c897101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8459aacaf3b04c97bfa5396114d5dd75'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:12.666941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-85d39165-187b-4632-8c58-e5d22c897101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8459aacaf3b04c97bfa5396114d5dd75'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:12.686775 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1388/2723] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:12 2022] DELETE /identity/v3/users/8459aacaf3b04c97bfa5396114d5dd75 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:12.691422 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5bad3-2769-4f7e-a16e-d61672386a28 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:12.691903 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5bad3-2769-4f7e-a16e-d61672386a28 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:12.692000 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e5bad3-2769-4f7e-a16e-d61672386a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:12.709389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d2e5bad3-2769-4f7e-a16e-d61672386a28 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:12.710586 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d2e5bad3-2769-4f7e-a16e-d61672386a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:12.773864 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1336/2724] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:12.783966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d39165-187b-4632-8c58-e5d22c897101 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:12.785563 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-85d39165-187b-4632-8c58-e5d22c897101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:12.837922 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:12.849169 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d39165-187b-4632-8c58-e5d22c897101 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:12.853721 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7398eb1-5bbe-4526-bef1-3caf159f3a38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:12.854645 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7398eb1-5bbe-4526-bef1-3caf159f3a38 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:12.855409 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7398eb1-5bbe-4526-bef1-3caf159f3a38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:12.855599 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7398eb1-5bbe-4526-bef1-3caf159f3a38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:12.865906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7398eb1-5bbe-4526-bef1-3caf159f3a38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:12.867390 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7398eb1-5bbe-4526-bef1-3caf159f3a38 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:12.877792 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1389/2725] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:13.163450 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5bad3-2769-4f7e-a16e-d61672386a28 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:13.165224 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d2e5bad3-2769-4f7e-a16e-d61672386a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:13.178023 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e5bad3-2769-4f7e-a16e-d61672386a28 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:13.183679 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738afe1-ce59-49af-abe8-3a9fe9cda7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:13.184562 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738afe1-ce59-49af-abe8-3a9fe9cda7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.184859 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738afe1-ce59-49af-abe8-3a9fe9cda7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.185183 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738afe1-ce59-49af-abe8-3a9fe9cda7be admin admin] PATH_INFO: `/v3/projects/3fa5c1438e594e1f9a82c4f0dc9d6728` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.186450 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738afe1-ce59-49af-abe8-3a9fe9cda7be admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa5c1438e594e1f9a82c4f0dc9d6728)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:13.188455 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738afe1-ce59-49af-abe8-3a9fe9cda7be admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:13.238036 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4738afe1-ce59-49af-abe8-3a9fe9cda7be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa5c1438e594e1f9a82c4f0dc9d6728', 'request_id': 'req-4738afe1-ce59-49af-abe8-3a9fe9cda7be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:13.245112 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4738afe1-ce59-49af-abe8-3a9fe9cda7be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa5c1438e594e1f9a82c4f0dc9d6728', 'request_id': 'req-4738afe1-ce59-49af-abe8-3a9fe9cda7be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:13.251076 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4738afe1-ce59-49af-abe8-3a9fe9cda7be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa5c1438e594e1f9a82c4f0dc9d6728', 'request_id': 'req-4738afe1-ce59-49af-abe8-3a9fe9cda7be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:13.263663 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4738afe1-ce59-49af-abe8-3a9fe9cda7be admin admin] The token cache is being invalidate because project 3fa5c1438e594e1f9a82c4f0dc9d6728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:13.263954 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4738afe1-ce59-49af-abe8-3a9fe9cda7be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:13.264620 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4738afe1-ce59-49af-abe8-3a9fe9cda7be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:13.266230 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1337/2726] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:13 2022] DELETE /identity/v3/projects/3fa5c1438e594e1f9a82c4f0dc9d6728 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:13.271229 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23072b13-e393-45a0-9957-4db9255115ac None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.271549 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23072b13-e393-45a0-9957-4db9255115ac None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.271835 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23072b13-e393-45a0-9957-4db9255115ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.292105 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-23072b13-e393-45a0-9957-4db9255115ac None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:13.293274 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-23072b13-e393-45a0-9957-4db9255115ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:13.365075 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1390/2727] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:13.366926 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000ec9-e4ea-4cfb-881f-5db8befd9320 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.367221 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000ec9-e4ea-4cfb-881f-5db8befd9320 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.367573 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8000ec9-e4ea-4cfb-881f-5db8befd9320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.387596 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e8000ec9-e4ea-4cfb-881f-5db8befd9320 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:13.388804 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e8000ec9-e4ea-4cfb-881f-5db8befd9320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:13.396645 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1338/2728] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:21:13.401137 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23072b13-e393-45a0-9957-4db9255115ac None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:13.413191 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23072b13-e393-45a0-9957-4db9255115ac None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:13.418191 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464194d9-5054-4370-b2e8-3e51d40baee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:13.418858 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464194d9-5054-4370-b2e8-3e51d40baee9 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.419170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464194d9-5054-4370-b2e8-3e51d40baee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.419481 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464194d9-5054-4370-b2e8-3e51d40baee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.420209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464194d9-5054-4370-b2e8-3e51d40baee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:21:13.420882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464194d9-5054-4370-b2e8-3e51d40baee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:13.422489 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464194d9-5054-4370-b2e8-3e51d40baee9 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:13.436074 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1391/2729] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:21:13.440763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000ec9-e4ea-4cfb-881f-5db8befd9320 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:13.445355 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:13.451800 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8000ec9-e4ea-4cfb-881f-5db8befd9320 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:13.458228 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64702bc4-1486-4ef6-bb27-9c59383a1964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:13.458927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64702bc4-1486-4ef6-bb27-9c59383a1964 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.459213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64702bc4-1486-4ef6-bb27-9c59383a1964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.459531 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64702bc4-1486-4ef6-bb27-9c59383a1964 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.460228 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64702bc4-1486-4ef6-bb27-9c59383a1964 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:13.462236 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64702bc4-1486-4ef6-bb27-9c59383a1964 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:13.489025 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1339/2730] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:21:13 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:13.493358 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464194d9-5054-4370-b2e8-3e51d40baee9 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:13.503842 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464194d9-5054-4370-b2e8-3e51d40baee9 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:13.567820 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94608e97-00da-4916-bf07-6a8810a709d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:13.568433 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94608e97-00da-4916-bf07-6a8810a709d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.568713 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94608e97-00da-4916-bf07-6a8810a709d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.568989 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94608e97-00da-4916-bf07-6a8810a709d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.569719 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94608e97-00da-4916-bf07-6a8810a709d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:13.571719 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94608e97-00da-4916-bf07-6a8810a709d2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:13.593764 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1392/2731] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:21:13 2022] POST /identity/v3/users => generated 288 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:21:13.597946 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64702bc4-1486-4ef6-bb27-9c59383a1964 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:13.608627 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64702bc4-1486-4ef6-bb27-9c59383a1964 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:13.614272 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b7a46-7bc5-4e1c-a85f-e604a5083059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:13.614951 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b7a46-7bc5-4e1c-a85f-e604a5083059 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.615431 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b7a46-7bc5-4e1c-a85f-e604a5083059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.615611 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b7a46-7bc5-4e1c-a85f-e604a5083059 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.616241 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b7a46-7bc5-4e1c-a85f-e604a5083059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:13.617934 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b7a46-7bc5-4e1c-a85f-e604a5083059 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:13.629465 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1340/2732] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:21:13.633863 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94608e97-00da-4916-bf07-6a8810a709d2 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:13.643984 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94608e97-00da-4916-bf07-6a8810a709d2 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:13.648733 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc8881c-2857-440c-897b-264ab2d49d07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:13.649393 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8881c-2857-440c-897b-264ab2d49d07 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.649714 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8881c-2857-440c-897b-264ab2d49d07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.649974 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8881c-2857-440c-897b-264ab2d49d07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.650702 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8881c-2857-440c-897b-264ab2d49d07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:13.652345 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc8881c-2857-440c-897b-264ab2d49d07 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:13.662306 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1393/2733] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:21:13.666532 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b7a46-7bc5-4e1c-a85f-e604a5083059 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:13.677478 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b7a46-7bc5-4e1c-a85f-e604a5083059 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:13.682862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae102da-8a65-497c-971d-85a369bf3627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:13.683914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae102da-8a65-497c-971d-85a369bf3627 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.684373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae102da-8a65-497c-971d-85a369bf3627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.684717 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae102da-8a65-497c-971d-85a369bf3627 admin admin] PATH_INFO: `/v3/projects/355a07ac7ec048cb91f17ed1432a0dbb/users/5058e672546b4d08beabb1de197e9c02/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.700723 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae102da-8a65-497c-971d-85a369bf3627 admin admin] RBAC: Authorizing `identity:create_grant(project_id=355a07ac7ec048cb91f17ed1432a0dbb, user_id=5058e672546b4d08beabb1de197e9c02, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:13.703565 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae102da-8a65-497c-971d-85a369bf3627 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:13.718816 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1341/2734] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:13 2022] PUT /identity/v3/projects/355a07ac7ec048cb91f17ed1432a0dbb/users/5058e672546b4d08beabb1de197e9c02/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:13.730365 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec65dc-e22e-498b-9a2a-616ccb15ddb4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.730659 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec65dc-e22e-498b-9a2a-616ccb15ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.730934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec65dc-e22e-498b-9a2a-616ccb15ddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.759627 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7aec65dc-e22e-498b-9a2a-616ccb15ddb4 None None] MFA Rules not processed for user `5058e672546b4d08beabb1de197e9c02`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:13.760968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7aec65dc-e22e-498b-9a2a-616ccb15ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:13.811933 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:13.844786 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1394/2735] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:13.849780 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae102da-8a65-497c-971d-85a369bf3627 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:13.915610 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae102da-8a65-497c-971d-85a369bf3627 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:13.921657 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ae2e5-9fce-4fcc-9f8d-dd2a6cdca067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:13.922372 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ae2e5-9fce-4fcc-9f8d-dd2a6cdca067 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:13.922639 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ae2e5-9fce-4fcc-9f8d-dd2a6cdca067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:13.922912 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66ae2e5-9fce-4fcc-9f8d-dd2a6cdca067 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:13.923851 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ae2e5-9fce-4fcc-9f8d-dd2a6cdca067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:13.925812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66ae2e5-9fce-4fcc-9f8d-dd2a6cdca067 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:13.957299 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1342/2736] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:21:13 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:21:13.958495 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec65dc-e22e-498b-9a2a-616ccb15ddb4 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:13.969452 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec65dc-e22e-498b-9a2a-616ccb15ddb4 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.029519 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb2ac9-049c-4855-9f9d-1e5a8238d1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.030212 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2ac9-049c-4855-9f9d-1e5a8238d1e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.030498 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2ac9-049c-4855-9f9d-1e5a8238d1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.030772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb2ac9-049c-4855-9f9d-1e5a8238d1e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.031508 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb2ac9-049c-4855-9f9d-1e5a8238d1e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.033472 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb2ac9-049c-4855-9f9d-1e5a8238d1e0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.054781 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1395/2737] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:21:13 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:14.058890 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ae2e5-9fce-4fcc-9f8d-dd2a6cdca067 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.069993 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66ae2e5-9fce-4fcc-9f8d-dd2a6cdca067 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.074826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74910392-cce8-4859-98c7-9323b21c6356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.075537 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74910392-cce8-4859-98c7-9323b21c6356 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.075826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74910392-cce8-4859-98c7-9323b21c6356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.076108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74910392-cce8-4859-98c7-9323b21c6356 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.076873 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74910392-cce8-4859-98c7-9323b21c6356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.078490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74910392-cce8-4859-98c7-9323b21c6356 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.093026 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1343/2738] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:14.094548 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb2ac9-049c-4855-9f9d-1e5a8238d1e0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.104840 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb2ac9-049c-4855-9f9d-1e5a8238d1e0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.109911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c714d2-edbd-4480-a925-ae1693597a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.110601 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c714d2-edbd-4480-a925-ae1693597a5e admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.110882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c714d2-edbd-4480-a925-ae1693597a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.111156 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c714d2-edbd-4480-a925-ae1693597a5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.111923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c714d2-edbd-4480-a925-ae1693597a5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.113546 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c714d2-edbd-4480-a925-ae1693597a5e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.124313 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1396/2739] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:21:14.128510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74910392-cce8-4859-98c7-9323b21c6356 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.138678 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74910392-cce8-4859-98c7-9323b21c6356 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.144346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f514251-e10b-47d2-92f1-79b4affd4a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.145373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f514251-e10b-47d2-92f1-79b4affd4a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.145373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f514251-e10b-47d2-92f1-79b4affd4a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.145373 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f514251-e10b-47d2-92f1-79b4affd4a85 admin admin] PATH_INFO: `/v3/projects/995a77782c4b4eb0b57537d4e6192c1a/users/c9a4c66061684452b8ef06f59f0c3c1f/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.163799 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f514251-e10b-47d2-92f1-79b4affd4a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=995a77782c4b4eb0b57537d4e6192c1a, user_id=c9a4c66061684452b8ef06f59f0c3c1f, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.166428 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f514251-e10b-47d2-92f1-79b4affd4a85 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.185210 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1344/2740] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:14 2022] PUT /identity/v3/projects/995a77782c4b4eb0b57537d4e6192c1a/users/c9a4c66061684452b8ef06f59f0c3c1f/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:21:14.196765 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36578ea-5056-49f0-930a-f12be113c665 None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.197060 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36578ea-5056-49f0-930a-f12be113c665 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.197342 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36578ea-5056-49f0-930a-f12be113c665 None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.199235 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1397/2741] 10.222.0.42 () {54 vars in 921 bytes} [Sun Jul 24 01:21:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:21:14.209266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e485893-9b2a-4360-911e-3dbee0c0b171 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.209560 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e485893-9b2a-4360-911e-3dbee0c0b171 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.209848 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e485893-9b2a-4360-911e-3dbee0c0b171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.240226 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5e485893-9b2a-4360-911e-3dbee0c0b171 None None] MFA Rules not processed for user `a3efd3928e334e78b4c87bb695718299`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:14.241546 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5e485893-9b2a-4360-911e-3dbee0c0b171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:14.258572 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252bfab-aa0f-49c4-8b3e-ffa2f4ef42e1 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.259431 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252bfab-aa0f-49c4-8b3e-ffa2f4ef42e1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.260503 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7252bfab-aa0f-49c4-8b3e-ffa2f4ef42e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.299627 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7252bfab-aa0f-49c4-8b3e-ffa2f4ef42e1 None None] MFA Rules not processed for user `c9a4c66061684452b8ef06f59f0c3c1f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:14.301319 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7252bfab-aa0f-49c4-8b3e-ffa2f4ef42e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:14.309288 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1345/2742] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Jul 24 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:14.322321 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e485893-9b2a-4360-911e-3dbee0c0b171 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.324602 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5e485893-9b2a-4360-911e-3dbee0c0b171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:14.332350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:14.339543 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e485893-9b2a-4360-911e-3dbee0c0b171 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.344065 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43241355-e182-46b3-844a-fc90ae552c7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.344724 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43241355-e182-46b3-844a-fc90ae552c7a service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.345010 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43241355-e182-46b3-844a-fc90ae552c7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.345291 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43241355-e182-46b3-844a-fc90ae552c7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.353053 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43241355-e182-46b3-844a-fc90ae552c7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.354506 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43241355-e182-46b3-844a-fc90ae552c7a service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.362341 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1346/2743] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:14.387455 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1398/2744] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:14.392185 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43241355-e182-46b3-844a-fc90ae552c7a service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.455828 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43241355-e182-46b3-844a-fc90ae552c7a service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.460560 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b19dd-c9f5-429b-9738-5a29d80346f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.461226 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b19dd-c9f5-429b-9738-5a29d80346f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.461509 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b19dd-c9f5-429b-9738-5a29d80346f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.461925 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b19dd-c9f5-429b-9738-5a29d80346f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.462571 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b19dd-c9f5-429b-9738-5a29d80346f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.464553 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b19dd-c9f5-429b-9738-5a29d80346f1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.492159 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1347/2745] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:21:14 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:21:14.496800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252bfab-aa0f-49c4-8b3e-ffa2f4ef42e1 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.508136 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7252bfab-aa0f-49c4-8b3e-ffa2f4ef42e1 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.556071 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:14.567118 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d19b8-e53f-47cf-b216-f5505a65f13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.567832 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d19b8-e53f-47cf-b216-f5505a65f13a admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.568115 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d19b8-e53f-47cf-b216-f5505a65f13a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.568392 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958d19b8-e53f-47cf-b216-f5505a65f13a admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.569155 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d19b8-e53f-47cf-b216-f5505a65f13a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.571087 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958d19b8-e53f-47cf-b216-f5505a65f13a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.592737 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1399/2746] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:21:14 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:14.596802 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b19dd-c9f5-429b-9738-5a29d80346f1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.607877 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b19dd-c9f5-429b-9738-5a29d80346f1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.612930 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab8e36-46bc-4bc8-b796-954fd351f333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.613596 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab8e36-46bc-4bc8-b796-954fd351f333 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.613875 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab8e36-46bc-4bc8-b796-954fd351f333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.614150 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab8e36-46bc-4bc8-b796-954fd351f333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.614900 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab8e36-46bc-4bc8-b796-954fd351f333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.616551 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab8e36-46bc-4bc8-b796-954fd351f333 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.627661 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1348/2747] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:14.632626 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d19b8-e53f-47cf-b216-f5505a65f13a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.649685 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958d19b8-e53f-47cf-b216-f5505a65f13a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.654702 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc2e74-27eb-402f-8ea2-ac4b3ca44ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.655675 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc2e74-27eb-402f-8ea2-ac4b3ca44ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.655960 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc2e74-27eb-402f-8ea2-ac4b3ca44ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.656244 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc2e74-27eb-402f-8ea2-ac4b3ca44ef7 admin admin] PATH_INFO: `/v3/projects/175bd4af4a2041668ed32da77c8c157c/users/196b90e444f643fb9712a873f7afc689/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.671501 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc2e74-27eb-402f-8ea2-ac4b3ca44ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=175bd4af4a2041668ed32da77c8c157c, user_id=196b90e444f643fb9712a873f7afc689, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.674219 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc2e74-27eb-402f-8ea2-ac4b3ca44ef7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.689536 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1400/2748] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:14 2022] PUT /identity/v3/projects/175bd4af4a2041668ed32da77c8c157c/users/196b90e444f643fb9712a873f7afc689/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:14.693738 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab8e36-46bc-4bc8-b796-954fd351f333 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.704117 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab8e36-46bc-4bc8-b796-954fd351f333 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.773117 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1abe0f-7ccc-4c9b-8360-6c0d72f70beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.773790 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1abe0f-7ccc-4c9b-8360-6c0d72f70beb admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.774075 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1abe0f-7ccc-4c9b-8360-6c0d72f70beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.774350 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1abe0f-7ccc-4c9b-8360-6c0d72f70beb admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.775117 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1abe0f-7ccc-4c9b-8360-6c0d72f70beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.776823 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1abe0f-7ccc-4c9b-8360-6c0d72f70beb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.786960 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1349/2749] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:14.791663 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc2e74-27eb-402f-8ea2-ac4b3ca44ef7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.802983 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc2e74-27eb-402f-8ea2-ac4b3ca44ef7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:14.808749 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c729c7e-d6d6-4fbe-9a16-91df35738d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:14.809676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c729c7e-d6d6-4fbe-9a16-91df35738d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.809957 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c729c7e-d6d6-4fbe-9a16-91df35738d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.810236 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c729c7e-d6d6-4fbe-9a16-91df35738d7b admin admin] PATH_INFO: `/v3/projects/175bd4af4a2041668ed32da77c8c157c/users/196b90e444f643fb9712a873f7afc689/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.812355 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c729c7e-d6d6-4fbe-9a16-91df35738d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=175bd4af4a2041668ed32da77c8c157c, user_id=196b90e444f643fb9712a873f7afc689, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:14.815135 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c729c7e-d6d6-4fbe-9a16-91df35738d7b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:14.826325 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1401/2750] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:14 2022] PUT /identity/v3/projects/175bd4af4a2041668ed32da77c8c157c/users/196b90e444f643fb9712a873f7afc689/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:14.836905 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b0c7-4114-4e9e-bb1b-6b538dd1e7a8 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:14.837210 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b0c7-4114-4e9e-bb1b-6b538dd1e7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:14.837504 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04b0c7-4114-4e9e-bb1b-6b538dd1e7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:14.864112 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-bd04b0c7-4114-4e9e-bb1b-6b538dd1e7a8 None None] MFA Rules not processed for user `196b90e444f643fb9712a873f7afc689`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:14.865241 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bd04b0c7-4114-4e9e-bb1b-6b538dd1e7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:14.912408 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:14.945005 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1350/2751] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:14 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:14.957170 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c729c7e-d6d6-4fbe-9a16-91df35738d7b admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:14.959171 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-8c729c7e-d6d6-4fbe-9a16-91df35738d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:15.021340 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c729c7e-d6d6-4fbe-9a16-91df35738d7b admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:15.025406 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4121f84-4f8d-4531-8647-c9819082d530 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:15.026063 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4121f84-4f8d-4531-8647-c9819082d530 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:15.026351 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4121f84-4f8d-4531-8647-c9819082d530 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:15.026636 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4121f84-4f8d-4531-8647-c9819082d530 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:15.086380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4121f84-4f8d-4531-8647-c9819082d530 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:15.087992 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4121f84-4f8d-4531-8647-c9819082d530 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:15.097209 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1402/2752] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:15.469309 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a11056-dddd-4d9a-b6ba-7486c74df0df None None] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:15.469819 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a11056-dddd-4d9a-b6ba-7486c74df0df None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:15.470842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a11056-dddd-4d9a-b6ba-7486c74df0df None None] PATH_INFO: `/` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:15.471578 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1351/2753] 10.222.0.42 () {54 vars in 921 bytes} [Sun Jul 24 01:21:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 24 01:21:15.478767 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d6775-0b55-44cd-8262-5163117c1b20 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:15.479144 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d6775-0b55-44cd-8262-5163117c1b20 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:15.479425 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6d6775-0b55-44cd-8262-5163117c1b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:15.503084 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3e6d6775-0b55-44cd-8262-5163117c1b20 None None] MFA Rules not processed for user `6c32c443ee1a421e98e7656e8e86e27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:15.504514 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3e6d6775-0b55-44cd-8262-5163117c1b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:15.558002 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:15.581783 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1403/2754] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Jul 24 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:15.592445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a11056-dddd-4d9a-b6ba-7486c74df0df None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:15.652061 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a11056-dddd-4d9a-b6ba-7486c74df0df None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:15.655780 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c817fe-5e79-4cef-8865-d6d16d25a094 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:15.656438 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c817fe-5e79-4cef-8865-d6d16d25a094 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:15.656722 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c817fe-5e79-4cef-8865-d6d16d25a094 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:15.657124 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c817fe-5e79-4cef-8865-d6d16d25a094 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:15.668331 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c817fe-5e79-4cef-8865-d6d16d25a094 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:15.669944 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c817fe-5e79-4cef-8865-d6d16d25a094 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:15.682924 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1352/2755] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:15.824224 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92642feb-c24f-4a48-a692-2dd436a2bd41 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:15.824517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92642feb-c24f-4a48-a692-2dd436a2bd41 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:15.824791 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92642feb-c24f-4a48-a692-2dd436a2bd41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:15.844725 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-92642feb-c24f-4a48-a692-2dd436a2bd41 None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:15.845942 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-92642feb-c24f-4a48-a692-2dd436a2bd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:15.906823 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1404/2756] 10.222.0.42 () {58 vars in 967 bytes} [Sun Jul 24 01:21:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:15.919267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c817fe-5e79-4cef-8865-d6d16d25a094 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:15.921063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f1c817fe-5e79-4cef-8865-d6d16d25a094 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:15.996199 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c817fe-5e79-4cef-8865-d6d16d25a094 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:16.001957 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1c874-9b9e-4592-a955-6722df3c8320 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:16.002656 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1c874-9b9e-4592-a955-6722df3c8320 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:16.002936 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1c874-9b9e-4592-a955-6722df3c8320 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:16.003208 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd1c874-9b9e-4592-a955-6722df3c8320 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:16.012286 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1c874-9b9e-4592-a955-6722df3c8320 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:16.013870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd1c874-9b9e-4592-a955-6722df3c8320 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:16.022670 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1353/2757] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:21:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 01:21:16.673205 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92642feb-c24f-4a48-a692-2dd436a2bd41 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:16.674812 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-92642feb-c24f-4a48-a692-2dd436a2bd41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:16.687665 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92642feb-c24f-4a48-a692-2dd436a2bd41 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:16.691604 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fba49d-8d90-48d9-931c-82d4cfc7d298 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:16.692265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fba49d-8d90-48d9-931c-82d4cfc7d298 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:16.692554 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fba49d-8d90-48d9-931c-82d4cfc7d298 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:16.692834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fba49d-8d90-48d9-931c-82d4cfc7d298 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:16.749672 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fba49d-8d90-48d9-931c-82d4cfc7d298 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:16.751114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fba49d-8d90-48d9-931c-82d4cfc7d298 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:16.760058 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1405/2758] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:16 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:17.287400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1c874-9b9e-4592-a955-6722df3c8320 service swift] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:17.297291 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd1c874-9b9e-4592-a955-6722df3c8320 service swift] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:17.301263 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b5c5eb-f147-48f7-a0fc-a747cd62e48c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:17.301901 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5c5eb-f147-48f7-a0fc-a747cd62e48c service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:17.302185 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5c5eb-f147-48f7-a0fc-a747cd62e48c service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:17.302459 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b5c5eb-f147-48f7-a0fc-a747cd62e48c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:17.311981 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5c5eb-f147-48f7-a0fc-a747cd62e48c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:17.313421 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b5c5eb-f147-48f7-a0fc-a747cd62e48c service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:17.322796 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1354/2759] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:21.204879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fba49d-8d90-48d9-931c-82d4cfc7d298 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:21.277941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fba49d-8d90-48d9-931c-82d4cfc7d298 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:21.283727 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b203d9c-9779-422e-a5d1-80d484957827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:21.284618 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b203d9c-9779-422e-a5d1-80d484957827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:21.284898 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b203d9c-9779-422e-a5d1-80d484957827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:21.285169 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b203d9c-9779-422e-a5d1-80d484957827 admin admin] PATH_INFO: `/v3/users/5058e672546b4d08beabb1de197e9c02` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:21.286436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b203d9c-9779-422e-a5d1-80d484957827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5058e672546b4d08beabb1de197e9c02)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:21.288429 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b203d9c-9779-422e-a5d1-80d484957827 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:21.332822 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:21.347054 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6b203d9c-9779-422e-a5d1-80d484957827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5058e672546b4d08beabb1de197e9c02'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:21.348241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6b203d9c-9779-422e-a5d1-80d484957827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5058e672546b4d08beabb1de197e9c02'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:21.358221 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6b203d9c-9779-422e-a5d1-80d484957827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5058e672546b4d08beabb1de197e9c02'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:21.358962 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6b203d9c-9779-422e-a5d1-80d484957827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5058e672546b4d08beabb1de197e9c02'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:21.366498 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6b203d9c-9779-422e-a5d1-80d484957827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5058e672546b4d08beabb1de197e9c02'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:21.383465 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1406/2760] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:21 2022] DELETE /identity/v3/users/5058e672546b4d08beabb1de197e9c02 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:21.388387 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbd83c-ec69-40db-a679-38876c6b82be None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:21.388914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbd83c-ec69-40db-a679-38876c6b82be None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:21.388914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbd83c-ec69-40db-a679-38876c6b82be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:21.407221 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-e3fbd83c-ec69-40db-a679-38876c6b82be None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:21.408466 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e3fbd83c-ec69-40db-a679-38876c6b82be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:21.479599 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1355/2761] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:21.489448 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b203d9c-9779-422e-a5d1-80d484957827 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:21.491128 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6b203d9c-9779-422e-a5d1-80d484957827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:21.550084 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b203d9c-9779-422e-a5d1-80d484957827 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:21.554001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528ba2b-20ef-4c57-933f-4a7c26446ec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:21.554653 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528ba2b-20ef-4c57-933f-4a7c26446ec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:21.554934 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528ba2b-20ef-4c57-933f-4a7c26446ec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:21.555213 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6528ba2b-20ef-4c57-933f-4a7c26446ec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:21.564794 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528ba2b-20ef-4c57-933f-4a7c26446ec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:21.566250 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6528ba2b-20ef-4c57-933f-4a7c26446ec8 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:21.576582 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1407/2762] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:21.911339 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbd83c-ec69-40db-a679-38876c6b82be None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:21.912896 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-e3fbd83c-ec69-40db-a679-38876c6b82be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:21.926267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbd83c-ec69-40db-a679-38876c6b82be None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:21.931741 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:21.932745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:21.933000 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:21.933280 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be admin admin] PATH_INFO: `/v3/projects/355a07ac7ec048cb91f17ed1432a0dbb` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:21.934742 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be admin admin] RBAC: Authorizing `identity:delete_project(project_id=355a07ac7ec048cb91f17ed1432a0dbb)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:21.936555 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:21.938347 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:21.985958 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '355a07ac7ec048cb91f17ed1432a0dbb', 'request_id': 'req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:21.994229 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '355a07ac7ec048cb91f17ed1432a0dbb', 'request_id': 'req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:21.999810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '355a07ac7ec048cb91f17ed1432a0dbb', 'request_id': 'req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.011253 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be admin admin] The token cache is being invalidate because project 355a07ac7ec048cb91f17ed1432a0dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:22.011579 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.012301 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.013962 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1356/2763] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:21 2022] DELETE /identity/v3/projects/355a07ac7ec048cb91f17ed1432a0dbb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:22.018248 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528ba2b-20ef-4c57-933f-4a7c26446ec8 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:22.028829 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6528ba2b-20ef-4c57-933f-4a7c26446ec8 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:22.088811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c077a-ab61-4071-915b-606e3f3fa238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:22.089761 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c077a-ab61-4071-915b-606e3f3fa238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:22.090036 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c077a-ab61-4071-915b-606e3f3fa238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:22.090307 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c077a-ab61-4071-915b-606e3f3fa238 admin admin] PATH_INFO: `/v3/users/c9a4c66061684452b8ef06f59f0c3c1f` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:22.091543 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c077a-ab61-4071-915b-606e3f3fa238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9a4c66061684452b8ef06f59f0c3c1f)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:22.093492 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c077a-ab61-4071-915b-606e3f3fa238 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:22.139183 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c59c077a-ab61-4071-915b-606e3f3fa238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9a4c66061684452b8ef06f59f0c3c1f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.139874 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c59c077a-ab61-4071-915b-606e3f3fa238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9a4c66061684452b8ef06f59f0c3c1f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.151668 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c59c077a-ab61-4071-915b-606e3f3fa238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9a4c66061684452b8ef06f59f0c3c1f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.152326 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c59c077a-ab61-4071-915b-606e3f3fa238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9a4c66061684452b8ef06f59f0c3c1f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.154496 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:22.161905 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-c59c077a-ab61-4071-915b-606e3f3fa238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9a4c66061684452b8ef06f59f0c3c1f'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.185355 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1408/2764] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:22 2022] DELETE /identity/v3/users/c9a4c66061684452b8ef06f59f0c3c1f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:22.483915 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:22.485548 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:22.502265 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dfc84d-a459-4ca7-b5a0-c02bd6a2e5be admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:22.561480 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7db4e-0831-4ac6-9a7a-5898de052b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:22.562360 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7db4e-0831-4ac6-9a7a-5898de052b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:22.562646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7db4e-0831-4ac6-9a7a-5898de052b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:22.562927 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db7db4e-0831-4ac6-9a7a-5898de052b66 admin admin] PATH_INFO: `/v3/projects/995a77782c4b4eb0b57537d4e6192c1a` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:22.564200 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7db4e-0831-4ac6-9a7a-5898de052b66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=995a77782c4b4eb0b57537d4e6192c1a)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:22.566138 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db7db4e-0831-4ac6-9a7a-5898de052b66 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:22.612488 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9db7db4e-0831-4ac6-9a7a-5898de052b66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '995a77782c4b4eb0b57537d4e6192c1a', 'request_id': 'req-9db7db4e-0831-4ac6-9a7a-5898de052b66'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.622171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9db7db4e-0831-4ac6-9a7a-5898de052b66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '995a77782c4b4eb0b57537d4e6192c1a', 'request_id': 'req-9db7db4e-0831-4ac6-9a7a-5898de052b66'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.627661 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9db7db4e-0831-4ac6-9a7a-5898de052b66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '995a77782c4b4eb0b57537d4e6192c1a', 'request_id': 'req-9db7db4e-0831-4ac6-9a7a-5898de052b66'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.638875 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9db7db4e-0831-4ac6-9a7a-5898de052b66 admin admin] The token cache is being invalidate because project 995a77782c4b4eb0b57537d4e6192c1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:22.639165 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9db7db4e-0831-4ac6-9a7a-5898de052b66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.639832 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-9db7db4e-0831-4ac6-9a7a-5898de052b66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.641362 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1357/2765] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:22 2022] DELETE /identity/v3/projects/995a77782c4b4eb0b57537d4e6192c1a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:22.645467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c077a-ab61-4071-915b-606e3f3fa238 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:22.646914 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c59c077a-ab61-4071-915b-606e3f3fa238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:22.660192 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c077a-ab61-4071-915b-606e3f3fa238 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:22.719521 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003b66d-dbe3-45a7-aade-99a32dd235ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:22.720426 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003b66d-dbe3-45a7-aade-99a32dd235ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:22.720736 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003b66d-dbe3-45a7-aade-99a32dd235ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:22.721016 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003b66d-dbe3-45a7-aade-99a32dd235ea admin admin] PATH_INFO: `/v3/users/196b90e444f643fb9712a873f7afc689` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:22.722241 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003b66d-dbe3-45a7-aade-99a32dd235ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=196b90e444f643fb9712a873f7afc689)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:22.724251 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003b66d-dbe3-45a7-aade-99a32dd235ea admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:22.772864 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f003b66d-dbe3-45a7-aade-99a32dd235ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196b90e444f643fb9712a873f7afc689'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.773534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f003b66d-dbe3-45a7-aade-99a32dd235ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196b90e444f643fb9712a873f7afc689'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.782600 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f003b66d-dbe3-45a7-aade-99a32dd235ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196b90e444f643fb9712a873f7afc689'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.783341 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f003b66d-dbe3-45a7-aade-99a32dd235ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196b90e444f643fb9712a873f7afc689'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.790802 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-f003b66d-dbe3-45a7-aade-99a32dd235ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196b90e444f643fb9712a873f7afc689'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:22.813811 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1409/2766] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:22 2022] DELETE /identity/v3/users/196b90e444f643fb9712a873f7afc689 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:23.121815 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7db4e-0831-4ac6-9a7a-5898de052b66 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:23.123368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9db7db4e-0831-4ac6-9a7a-5898de052b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:23.137464 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db7db4e-0831-4ac6-9a7a-5898de052b66 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:23.156929 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:23.198673 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1070a317-2456-491c-b0c2-f30874c9c1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:23.199572 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070a317-2456-491c-b0c2-f30874c9c1be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:23.199851 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070a317-2456-491c-b0c2-f30874c9c1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:23.200126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1070a317-2456-491c-b0c2-f30874c9c1be admin admin] PATH_INFO: `/v3/projects/175bd4af4a2041668ed32da77c8c157c` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:23.201331 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070a317-2456-491c-b0c2-f30874c9c1be admin admin] RBAC: Authorizing `identity:delete_project(project_id=175bd4af4a2041668ed32da77c8c157c)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:23.203267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1070a317-2456-491c-b0c2-f30874c9c1be admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:23.252577 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1070a317-2456-491c-b0c2-f30874c9c1be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '175bd4af4a2041668ed32da77c8c157c', 'request_id': 'req-1070a317-2456-491c-b0c2-f30874c9c1be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:23.260814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1070a317-2456-491c-b0c2-f30874c9c1be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '175bd4af4a2041668ed32da77c8c157c', 'request_id': 'req-1070a317-2456-491c-b0c2-f30874c9c1be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:23.266367 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1070a317-2456-491c-b0c2-f30874c9c1be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '175bd4af4a2041668ed32da77c8c157c', 'request_id': 'req-1070a317-2456-491c-b0c2-f30874c9c1be'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:23.277175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1070a317-2456-491c-b0c2-f30874c9c1be admin admin] The token cache is being invalidate because project 175bd4af4a2041668ed32da77c8c157c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:23.277459 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1070a317-2456-491c-b0c2-f30874c9c1be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:23.278138 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1070a317-2456-491c-b0c2-f30874c9c1be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:23.279720 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1358/2767] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:23 2022] DELETE /identity/v3/projects/175bd4af4a2041668ed32da77c8c157c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:23.285385 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd4976-4cb5-4177-ab7a-7d8111989d0e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:23.285777 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd4976-4cb5-4177-ab7a-7d8111989d0e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:23.286132 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd4976-4cb5-4177-ab7a-7d8111989d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:23.312411 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-cdfd4976-4cb5-4177-ab7a-7d8111989d0e None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:23.314308 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-cdfd4976-4cb5-4177-ab7a-7d8111989d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:23.371495 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:23.386238 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1410/2768] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:23.395189 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd987fd7-fce2-4084-a18e-415681518612 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:23.395527 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd987fd7-fce2-4084-a18e-415681518612 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:23.395810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd987fd7-fce2-4084-a18e-415681518612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:23.414531 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-cd987fd7-fce2-4084-a18e-415681518612 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:23.415775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-cd987fd7-fce2-4084-a18e-415681518612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:23.424591 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1359/2769] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:21:23.428893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd4976-4cb5-4177-ab7a-7d8111989d0e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:23.438827 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd4976-4cb5-4177-ab7a-7d8111989d0e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:23.444991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f4d61-e294-4733-a377-8d2109691866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:23.445644 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f4d61-e294-4733-a377-8d2109691866 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:23.445932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f4d61-e294-4733-a377-8d2109691866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:23.446194 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f4d61-e294-4733-a377-8d2109691866 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:23.446904 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f4d61-e294-4733-a377-8d2109691866 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:21:23.447203 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f4d61-e294-4733-a377-8d2109691866 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:23.448893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f4d61-e294-4733-a377-8d2109691866 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:23.460829 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1411/2770] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:21:23.467359 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd987fd7-fce2-4084-a18e-415681518612 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:23.481370 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd987fd7-fce2-4084-a18e-415681518612 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:23.489301 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569300f-b385-48b4-8f5b-6e8381ca7921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:23.490007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569300f-b385-48b4-8f5b-6e8381ca7921 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:23.490335 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569300f-b385-48b4-8f5b-6e8381ca7921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:23.490697 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569300f-b385-48b4-8f5b-6e8381ca7921 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:23.491765 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569300f-b385-48b4-8f5b-6e8381ca7921 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:23.494886 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569300f-b385-48b4-8f5b-6e8381ca7921 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:23.530369 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1360/2771] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:21:23 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:21:23.534911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f4d61-e294-4733-a377-8d2109691866 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:23.549186 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f4d61-e294-4733-a377-8d2109691866 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:23.628720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9df10-5b17-40bb-a9ce-72b95cb41859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:23.629400 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9df10-5b17-40bb-a9ce-72b95cb41859 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:23.629691 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9df10-5b17-40bb-a9ce-72b95cb41859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:23.629968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e9df10-5b17-40bb-a9ce-72b95cb41859 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:23.630657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9df10-5b17-40bb-a9ce-72b95cb41859 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:23.632650 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e9df10-5b17-40bb-a9ce-72b95cb41859 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:23.659706 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1412/2772] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:21:23 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:21:23.664298 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569300f-b385-48b4-8f5b-6e8381ca7921 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:23.675649 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569300f-b385-48b4-8f5b-6e8381ca7921 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:23.680703 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d92a9f-eb86-43fa-a369-71c7b9672a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:23.681363 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d92a9f-eb86-43fa-a369-71c7b9672a5a admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:23.681641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d92a9f-eb86-43fa-a369-71c7b9672a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:23.681913 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d92a9f-eb86-43fa-a369-71c7b9672a5a admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:23.682695 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d92a9f-eb86-43fa-a369-71c7b9672a5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:23.684320 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d92a9f-eb86-43fa-a369-71c7b9672a5a admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:23.694718 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1361/2773] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:23.698922 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9df10-5b17-40bb-a9ce-72b95cb41859 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:23.709483 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e9df10-5b17-40bb-a9ce-72b95cb41859 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:23.714755 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee583819-5439-45fe-bfc2-37f935640f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:23.715463 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee583819-5439-45fe-bfc2-37f935640f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:23.715757 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee583819-5439-45fe-bfc2-37f935640f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:23.716026 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee583819-5439-45fe-bfc2-37f935640f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:23.716766 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee583819-5439-45fe-bfc2-37f935640f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:23.718380 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee583819-5439-45fe-bfc2-37f935640f32 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:23.728613 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1413/2774] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:21:23.732763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d92a9f-eb86-43fa-a369-71c7b9672a5a admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:23.742732 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d92a9f-eb86-43fa-a369-71c7b9672a5a admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:23.747389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ca153-d9b7-4715-88b3-62e1809c229d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:23.748267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ca153-d9b7-4715-88b3-62e1809c229d admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:23.748556 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ca153-d9b7-4715-88b3-62e1809c229d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:23.748830 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ca153-d9b7-4715-88b3-62e1809c229d admin admin] PATH_INFO: `/v3/projects/ee0a32392282491fad19ce7b79727117/users/86e44fa9ba8541399f5963f157e5a5dd/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:23.763841 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ca153-d9b7-4715-88b3-62e1809c229d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee0a32392282491fad19ce7b79727117, user_id=86e44fa9ba8541399f5963f157e5a5dd, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:23.766609 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ca153-d9b7-4715-88b3-62e1809c229d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:23.785960 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1362/2775] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:21:23 2022] PUT /identity/v3/projects/ee0a32392282491fad19ce7b79727117/users/86e44fa9ba8541399f5963f157e5a5dd/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:23.799056 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a1ecd-d10e-4262-9a4a-a71efb26c111 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:23.799385 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a1ecd-d10e-4262-9a4a-a71efb26c111 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:23.799690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a1ecd-d10e-4262-9a4a-a71efb26c111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:23.830479 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-947a1ecd-d10e-4262-9a4a-a71efb26c111 None None] MFA Rules not processed for user `86e44fa9ba8541399f5963f157e5a5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:23.831804 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-947a1ecd-d10e-4262-9a4a-a71efb26c111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:23.903113 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1414/2776] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:23 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:23.914994 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ca153-d9b7-4715-88b3-62e1809c229d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:23.917222 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-657ca153-d9b7-4715-88b3-62e1809c229d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:23.970006 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:23.975672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ca153-d9b7-4715-88b3-62e1809c229d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:23.980501 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38dc67-8d3e-4773-8c21-c1685b980e5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:23.981168 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38dc67-8d3e-4773-8c21-c1685b980e5b service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:23.981461 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38dc67-8d3e-4773-8c21-c1685b980e5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:23.981747 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38dc67-8d3e-4773-8c21-c1685b980e5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:23.991852 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38dc67-8d3e-4773-8c21-c1685b980e5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:23.993344 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38dc67-8d3e-4773-8c21-c1685b980e5b service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:24.002576 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1363/2777] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:23 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:33.899606 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=75,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:33.999053 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=5 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:21:59.160346 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a1ecd-d10e-4262-9a4a-a71efb26c111 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:59.224893 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a1ecd-d10e-4262-9a4a-a71efb26c111 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:59.229837 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351b475-bce7-4b62-a035-4d67d7e69913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:59.230715 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351b475-bce7-4b62-a035-4d67d7e69913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:59.230998 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351b475-bce7-4b62-a035-4d67d7e69913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:59.231272 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351b475-bce7-4b62-a035-4d67d7e69913 admin admin] PATH_INFO: `/v3/users/86e44fa9ba8541399f5963f157e5a5dd` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:59.232529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351b475-bce7-4b62-a035-4d67d7e69913 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86e44fa9ba8541399f5963f157e5a5dd)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:59.234526 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351b475-bce7-4b62-a035-4d67d7e69913 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:59.283715 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a351b475-bce7-4b62-a035-4d67d7e69913 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86e44fa9ba8541399f5963f157e5a5dd'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.284360 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a351b475-bce7-4b62-a035-4d67d7e69913 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86e44fa9ba8541399f5963f157e5a5dd'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.293607 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a351b475-bce7-4b62-a035-4d67d7e69913 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86e44fa9ba8541399f5963f157e5a5dd'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.294510 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a351b475-bce7-4b62-a035-4d67d7e69913 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86e44fa9ba8541399f5963f157e5a5dd'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.302329 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a351b475-bce7-4b62-a035-4d67d7e69913 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86e44fa9ba8541399f5963f157e5a5dd'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.326979 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1415/2778] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:21:59 2022] DELETE /identity/v3/users/86e44fa9ba8541399f5963f157e5a5dd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:21:59.331774 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f4c6c-3381-4175-bd74-6a9ac552e10d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:59.332272 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f4c6c-3381-4175-bd74-6a9ac552e10d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:59.332380 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f4c6c-3381-4175-bd74-6a9ac552e10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:59.349930 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2f4f4c6c-3381-4175-bd74-6a9ac552e10d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:21:59.351134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2f4f4c6c-3381-4175-bd74-6a9ac552e10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:59.411333 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1364/2779] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:21:59.421349 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351b475-bce7-4b62-a035-4d67d7e69913 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:59.422802 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a351b475-bce7-4b62-a035-4d67d7e69913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:59.482347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351b475-bce7-4b62-a035-4d67d7e69913 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:59.487744 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec39af-d665-4cce-a682-2e3d21f9dcc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:59.488715 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec39af-d665-4cce-a682-2e3d21f9dcc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:59.489095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec39af-d665-4cce-a682-2e3d21f9dcc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:59.489480 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec39af-d665-4cce-a682-2e3d21f9dcc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:59.504853 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec39af-d665-4cce-a682-2e3d21f9dcc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:59.507014 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec39af-d665-4cce-a682-2e3d21f9dcc7 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:59.519755 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1416/2780] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:21:59.793022 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f4c6c-3381-4175-bd74-6a9ac552e10d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:21:59.794493 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2f4f4c6c-3381-4175-bd74-6a9ac552e10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:21:59.807420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f4c6c-3381-4175-bd74-6a9ac552e10d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:21:59.817818 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:21:59.818430 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:21:59.818833 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:21:59.819121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc admin admin] PATH_INFO: `/v3/projects/ee0a32392282491fad19ce7b79727117` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:21:59.820516 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee0a32392282491fad19ce7b79727117)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:21:59.822457 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:21:59.870767 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee0a32392282491fad19ce7b79727117', 'request_id': 'req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.879626 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee0a32392282491fad19ce7b79727117', 'request_id': 'req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.885791 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee0a32392282491fad19ce7b79727117', 'request_id': 'req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.897509 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc admin admin] The token cache is being invalidate because project ee0a32392282491fad19ce7b79727117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:21:59.897816 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.898536 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:21:59.900177 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1365/2781] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:21:59 2022] DELETE /identity/v3/projects/ee0a32392282491fad19ce7b79727117 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:22:09.515331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:09.894317 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:17.412053 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec39af-d665-4cce-a682-2e3d21f9dcc7 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:17.414524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-08ec39af-d665-4cce-a682-2e3d21f9dcc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:17.480090 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec39af-d665-4cce-a682-2e3d21f9dcc7 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:17.532418 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58ddc68-bc0b-46cf-aed0-2ace0fe31e85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:17.533255 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ddc68-bc0b-46cf-aed0-2ace0fe31e85 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:17.533593 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ddc68-bc0b-46cf-aed0-2ace0fe31e85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:17.533930 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58ddc68-bc0b-46cf-aed0-2ace0fe31e85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:17.537094 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-b58ddc68-bc0b-46cf-aed0-2ace0fe31e85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:17.615101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ddc68-bc0b-46cf-aed0-2ace0fe31e85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:17.616644 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58ddc68-bc0b-46cf-aed0-2ace0fe31e85 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:17.628635 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1417/2782] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:22:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:22:20.288172 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:20.289869 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:20.356715 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e30f23a-17e6-4d6f-9a6a-10361ae8cefc admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:20.360526 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583d262-cd63-408a-86be-07a168b66bbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:20.361184 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583d262-cd63-408a-86be-07a168b66bbf service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:20.361427 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583d262-cd63-408a-86be-07a168b66bbf service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:20.361745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583d262-cd63-408a-86be-07a168b66bbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:20.363647 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b583d262-cd63-408a-86be-07a168b66bbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:20.377607 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583d262-cd63-408a-86be-07a168b66bbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:20.379047 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583d262-cd63-408a-86be-07a168b66bbf service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:20.390297 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1366/2783] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:22:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:22:24.582461 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e094d-8a45-4821-b09d-85ca1991c4a4 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:24.582991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e094d-8a45-4821-b09d-85ca1991c4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:24.583093 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77e094d-8a45-4821-b09d-85ca1991c4a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:24.601673 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-e77e094d-8a45-4821-b09d-85ca1991c4a4 None None] MFA Rules not processed for user `fe042f088ffb4b7db88cafe05b11808c`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:22:24.602867 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-e77e094d-8a45-4821-b09d-85ca1991c4a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:24.657301 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1418/2784] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:22:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:22:25.294842 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583d262-cd63-408a-86be-07a168b66bbf service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:25.296443 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b583d262-cd63-408a-86be-07a168b66bbf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:25.377004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583d262-cd63-408a-86be-07a168b66bbf service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:25.382683 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f8959-4c70-48a7-b27d-13580992a2d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333db0711d0f41fe8066ba5b9d91dacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:25.383343 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f8959-4c70-48a7-b27d-13580992a2d9 service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:25.383648 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f8959-4c70-48a7-b27d-13580992a2d9 service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:25.383895 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7f8959-4c70-48a7-b27d-13580992a2d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:25.385853 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-bf7f8959-4c70-48a7-b27d-13580992a2d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:25.397479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f8959-4c70-48a7-b27d-13580992a2d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:25.399092 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7f8959-4c70-48a7-b27d-13580992a2d9 service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:25.409177 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1367/2785] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:22:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:22:27.282853 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e094d-8a45-4821-b09d-85ca1991c4a4 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:22:27.288065 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:27.294949 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77e094d-8a45-4821-b09d-85ca1991c4a4 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:22:27.298779 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7bc3f-731a-4362-b698-735daef3470c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:22:27.299517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7bc3f-731a-4362-b698-735daef3470c service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:22:27.299806 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7bc3f-731a-4362-b698-735daef3470c service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:22:27.300069 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f7bc3f-731a-4362-b698-735daef3470c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:22:27.301909 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-63f7bc3f-731a-4362-b698-735daef3470c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:22:27.312517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7bc3f-731a-4362-b698-735daef3470c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:22:27.313960 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f7bc3f-731a-4362-b698-735daef3470c service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:22:27.323904 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1419/2786] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:22:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:22:35.404970 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=58 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:22:37.320348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:08.929093 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f8959-4c70-48a7-b27d-13580992a2d9 service placement] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:08.939518 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7f8959-4c70-48a7-b27d-13580992a2d9 service placement] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:08.944136 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad5e13-c19b-49be-8b0e-b5a3a80f6a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:08.944783 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad5e13-c19b-49be-8b0e-b5a3a80f6a5a service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:08.945069 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad5e13-c19b-49be-8b0e-b5a3a80f6a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:08.945338 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ad5e13-c19b-49be-8b0e-b5a3a80f6a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:08.947495 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-b2ad5e13-c19b-49be-8b0e-b5a3a80f6a5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:09.009696 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad5e13-c19b-49be-8b0e-b5a3a80f6a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:09.011173 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ad5e13-c19b-49be-8b0e-b5a3a80f6a5a service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:09.020609 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1368/2787] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:09.886916 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7bc3f-731a-4362-b698-735daef3470c service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:09.888986 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-63f7bc3f-731a-4362-b698-735daef3470c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:09.912388 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f7bc3f-731a-4362-b698-735daef3470c service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:09.918392 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155a09c-9bc7-45a4-aeae-9ae81fe2a275 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:09.919639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155a09c-9bc7-45a4-aeae-9ae81fe2a275 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:09.919991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155a09c-9bc7-45a4-aeae-9ae81fe2a275 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:09.920359 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7155a09c-9bc7-45a4-aeae-9ae81fe2a275 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:09.922215 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7155a09c-9bc7-45a4-aeae-9ae81fe2a275 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:09.935895 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155a09c-9bc7-45a4-aeae-9ae81fe2a275 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:09.937500 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7155a09c-9bc7-45a4-aeae-9ae81fe2a275 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:09.949837 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1420/2788] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:12.186784 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad5e13-c19b-49be-8b0e-b5a3a80f6a5a service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:12.200104 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ad5e13-c19b-49be-8b0e-b5a3a80f6a5a service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:12.206015 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272be19-1334-435d-b88a-86fece1a90d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:12.206656 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272be19-1334-435d-b88a-86fece1a90d5 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:12.206949 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272be19-1334-435d-b88a-86fece1a90d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:12.207215 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272be19-1334-435d-b88a-86fece1a90d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:12.209039 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0272be19-1334-435d-b88a-86fece1a90d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:12.221381 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272be19-1334-435d-b88a-86fece1a90d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:12.223147 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0272be19-1334-435d-b88a-86fece1a90d5 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:12.233770 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1369/2789] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:13.779509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155a09c-9bc7-45a4-aeae-9ae81fe2a275 service nova] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:13.791165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7155a09c-9bc7-45a4-aeae-9ae81fe2a275 service nova] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:13.795573 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d83670-4382-41f1-a697-4c2280a23a60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:13.796222 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d83670-4382-41f1-a697-4c2280a23a60 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:13.796506 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d83670-4382-41f1-a697-4c2280a23a60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:13.796782 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d83670-4382-41f1-a697-4c2280a23a60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:13.798775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-88d83670-4382-41f1-a697-4c2280a23a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:13.865114 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d83670-4382-41f1-a697-4c2280a23a60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:13.866570 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d83670-4382-41f1-a697-4c2280a23a60 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:13.876295 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1421/2790] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:17.026255 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272be19-1334-435d-b88a-86fece1a90d5 service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:17.038499 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0272be19-1334-435d-b88a-86fece1a90d5 service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:17.043901 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76c51b-18de-48af-a81b-40b034198ec0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333db0711d0f41fe8066ba5b9d91dacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:17.044646 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76c51b-18de-48af-a81b-40b034198ec0 service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:17.046004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76c51b-18de-48af-a81b-40b034198ec0 service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:17.046364 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d76c51b-18de-48af-a81b-40b034198ec0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:17.049897 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-8d76c51b-18de-48af-a81b-40b034198ec0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:17.062181 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76c51b-18de-48af-a81b-40b034198ec0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:17.063942 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d76c51b-18de-48af-a81b-40b034198ec0 service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:17.074593 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1370/2791] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:23:20.294813 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d83670-4382-41f1-a697-4c2280a23a60 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:20.296391 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-88d83670-4382-41f1-a697-4c2280a23a60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:20.309404 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d83670-4382-41f1-a697-4c2280a23a60 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:20.314078 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca746a2f-6e3c-455a-92eb-1ce873fa47b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:20.314970 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca746a2f-6e3c-455a-92eb-1ce873fa47b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:20.315281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca746a2f-6e3c-455a-92eb-1ce873fa47b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:20.315597 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca746a2f-6e3c-455a-92eb-1ce873fa47b7 admin admin] PATH_INFO: `/v3/users/2f6dd6349c9a467ca7cd5aaf1b9c6a07` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:20.316823 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca746a2f-6e3c-455a-92eb-1ce873fa47b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6dd6349c9a467ca7cd5aaf1b9c6a07)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:20.318778 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca746a2f-6e3c-455a-92eb-1ce873fa47b7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:20.365095 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ca746a2f-6e3c-455a-92eb-1ce873fa47b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6dd6349c9a467ca7cd5aaf1b9c6a07'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:20.365757 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ca746a2f-6e3c-455a-92eb-1ce873fa47b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6dd6349c9a467ca7cd5aaf1b9c6a07'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:20.375412 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ca746a2f-6e3c-455a-92eb-1ce873fa47b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6dd6349c9a467ca7cd5aaf1b9c6a07'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:20.376133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ca746a2f-6e3c-455a-92eb-1ce873fa47b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6dd6349c9a467ca7cd5aaf1b9c6a07'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:20.383160 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-ca746a2f-6e3c-455a-92eb-1ce873fa47b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6dd6349c9a467ca7cd5aaf1b9c6a07'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:20.400802 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1422/2792] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:23:20 2022] DELETE /identity/v3/users/2f6dd6349c9a467ca7cd5aaf1b9c6a07 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:23:20.583460 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76c51b-18de-48af-a81b-40b034198ec0 service placement] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:20.594813 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d76c51b-18de-48af-a81b-40b034198ec0 service placement] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:20.653343 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746273c-a66a-45e1-abdf-1a5268f291ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:20.654226 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746273c-a66a-45e1-abdf-1a5268f291ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:20.654508 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746273c-a66a-45e1-abdf-1a5268f291ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:20.654813 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746273c-a66a-45e1-abdf-1a5268f291ed admin admin] PATH_INFO: `/v3/projects/935463280c7a4d6eaab209974e8b1bf8` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:20.656114 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746273c-a66a-45e1-abdf-1a5268f291ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=935463280c7a4d6eaab209974e8b1bf8)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:20.658104 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6746273c-a66a-45e1-abdf-1a5268f291ed admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:20.709200 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6746273c-a66a-45e1-abdf-1a5268f291ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '935463280c7a4d6eaab209974e8b1bf8', 'request_id': 'req-6746273c-a66a-45e1-abdf-1a5268f291ed'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:20.719670 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6746273c-a66a-45e1-abdf-1a5268f291ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '935463280c7a4d6eaab209974e8b1bf8', 'request_id': 'req-6746273c-a66a-45e1-abdf-1a5268f291ed'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:20.725523 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6746273c-a66a-45e1-abdf-1a5268f291ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '935463280c7a4d6eaab209974e8b1bf8', 'request_id': 'req-6746273c-a66a-45e1-abdf-1a5268f291ed'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:20.736775 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6746273c-a66a-45e1-abdf-1a5268f291ed admin admin] The token cache is being invalidate because project 935463280c7a4d6eaab209974e8b1bf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:23:20.737062 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6746273c-a66a-45e1-abdf-1a5268f291ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:20.737822 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-6746273c-a66a-45e1-abdf-1a5268f291ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:20.739483 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1371/2793] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:23:20 2022] DELETE /identity/v3/projects/935463280c7a4d6eaab209974e8b1bf8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:20.743721 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca746a2f-6e3c-455a-92eb-1ce873fa47b7 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:20.745598 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-ca746a2f-6e3c-455a-92eb-1ce873fa47b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:20.760162 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca746a2f-6e3c-455a-92eb-1ce873fa47b7 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:20.811161 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:20.821422 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa38e-8896-4f21-8b07-1e17c5accf18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:20.822331 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa38e-8896-4f21-8b07-1e17c5accf18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:20.822622 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa38e-8896-4f21-8b07-1e17c5accf18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:20.822913 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557aa38e-8896-4f21-8b07-1e17c5accf18 admin admin] PATH_INFO: `/v3/users/f2775d3a80ac4db482f202dba2219811` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:20.824309 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557aa38e-8896-4f21-8b07-1e17c5accf18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2775d3a80ac4db482f202dba2219811)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:20.826811 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557aa38e-8896-4f21-8b07-1e17c5accf18 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:20.874172 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-557aa38e-8896-4f21-8b07-1e17c5accf18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2775d3a80ac4db482f202dba2219811'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:20.874834 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-557aa38e-8896-4f21-8b07-1e17c5accf18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2775d3a80ac4db482f202dba2219811'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:20.884298 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-557aa38e-8896-4f21-8b07-1e17c5accf18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2775d3a80ac4db482f202dba2219811'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:20.885143 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-557aa38e-8896-4f21-8b07-1e17c5accf18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2775d3a80ac4db482f202dba2219811'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:20.892758 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-557aa38e-8896-4f21-8b07-1e17c5accf18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2775d3a80ac4db482f202dba2219811'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:20.910647 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1423/2794] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:23:20 2022] DELETE /identity/v3/users/f2775d3a80ac4db482f202dba2219811 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:21.104131 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746273c-a66a-45e1-abdf-1a5268f291ed admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:21.105687 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6746273c-a66a-45e1-abdf-1a5268f291ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:21.114662 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:21.120424 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746273c-a66a-45e1-abdf-1a5268f291ed admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:21.183399 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:21.184267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:21.184564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:21.184837 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3 admin admin] PATH_INFO: `/v3/projects/cc04cdecfa6d4242a959c4d8a42f5af5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:21.186067 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc04cdecfa6d4242a959c4d8a42f5af5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:21.188024 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:21.235169 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc04cdecfa6d4242a959c4d8a42f5af5', 'request_id': 'req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:21.245517 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc04cdecfa6d4242a959c4d8a42f5af5', 'request_id': 'req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:21.251138 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc04cdecfa6d4242a959c4d8a42f5af5', 'request_id': 'req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:21.261886 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3 admin admin] The token cache is being invalidate because project cc04cdecfa6d4242a959c4d8a42f5af5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:23:21.262173 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:21.262834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:23:21.264420 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1372/2795] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:23:21 2022] DELETE /identity/v3/projects/cc04cdecfa6d4242a959c4d8a42f5af5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:23:30.907426 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:31.259240 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=50,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:23:52.515457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa38e-8896-4f21-8b07-1e17c5accf18 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:23:52.518836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-557aa38e-8896-4f21-8b07-1e17c5accf18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:52.604256 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557aa38e-8896-4f21-8b07-1e17c5accf18 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:23:52.669375 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ca70f-2b04-49f7-94df-836409390ee8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:23:52.670021 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ca70f-2b04-49f7-94df-836409390ee8 service nova] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:23:52.670301 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ca70f-2b04-49f7-94df-836409390ee8 service nova] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:23:52.670585 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ca70f-2b04-49f7-94df-836409390ee8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:23:52.672569 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-320ca70f-2b04-49f7-94df-836409390ee8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:23:52.731120 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ca70f-2b04-49f7-94df-836409390ee8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:23:52.732755 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ca70f-2b04-49f7-94df-836409390ee8 service nova] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:23:52.741936 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1424/2796] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:23:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:02.737910 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=84 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:10.324048 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:10.325960 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:10.344561 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3d4c3a-b1df-4929-89a4-bb1c60d03ed3 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:10.350390 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185a11e-dad5-4a46-a553-6ed4f31770ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:10.351068 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185a11e-dad5-4a46-a553-6ed4f31770ea service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:10.351379 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185a11e-dad5-4a46-a553-6ed4f31770ea service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:10.351658 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185a11e-dad5-4a46-a553-6ed4f31770ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:10.354075 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3185a11e-dad5-4a46-a553-6ed4f31770ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:10.368198 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185a11e-dad5-4a46-a553-6ed4f31770ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:10.369739 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185a11e-dad5-4a46-a553-6ed4f31770ea service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:10.381943 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1373/2797] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:12.553300 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00aec6b-b5d7-40ff-960c-416ecc1ae77c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:12.553791 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00aec6b-b5d7-40ff-960c-416ecc1ae77c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:12.553894 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00aec6b-b5d7-40ff-960c-416ecc1ae77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:12.608300 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f00aec6b-b5d7-40ff-960c-416ecc1ae77c None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:12.609610 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f00aec6b-b5d7-40ff-960c-416ecc1ae77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:12.677468 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1425/2798] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:24:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:12.725633 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185a11e-dad5-4a46-a553-6ed4f31770ea service nova] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:12.727144 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3185a11e-dad5-4a46-a553-6ed4f31770ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:12.817524 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185a11e-dad5-4a46-a553-6ed4f31770ea service nova] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:12.822593 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86641a-c2cf-4e4b-9b4e-d81063fe9a23 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:12.823233 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86641a-c2cf-4e4b-9b4e-d81063fe9a23 service swift] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:12.823546 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86641a-c2cf-4e4b-9b4e-d81063fe9a23 service swift] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:12.823832 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86641a-c2cf-4e4b-9b4e-d81063fe9a23 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:12.831968 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86641a-c2cf-4e4b-9b4e-d81063fe9a23 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:12.833557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be86641a-c2cf-4e4b-9b4e-d81063fe9a23 service swift] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:12.842004 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1374/2799] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:24:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:24:22.674584 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=40 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:22.838681 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=47 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:26.727789 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cddebc-7b27-4510-bb42-5e15ed0828ed None None] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:26.728679 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cddebc-7b27-4510-bb42-5e15ed0828ed None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:26.728962 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cddebc-7b27-4510-bb42-5e15ed0828ed None None] PATH_INFO: `/` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:26.730368 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1426/2800] 10.222.0.42 () {54 vars in 921 bytes} [Sun Jul 24 01:24:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 24 01:24:26.735660 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dabd5f-442d-4669-a469-dc83f10c3d3c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:26.736127 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dabd5f-442d-4669-a469-dc83f10c3d3c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:26.736321 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dabd5f-442d-4669-a469-dc83f10c3d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:26.774556 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-00dabd5f-442d-4669-a469-dc83f10c3d3c None None] MFA Rules not processed for user `6c32c443ee1a421e98e7656e8e86e27a`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:26.775708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-00dabd5f-442d-4669-a469-dc83f10c3d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:26.785392 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1375/2801] 10.222.0.42 () {58 vars in 1018 bytes} [Sun Jul 24 01:24:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:26.797887 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cddebc-7b27-4510-bb42-5e15ed0828ed None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:26.799754 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a9cddebc-7b27-4510-bb42-5e15ed0828ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:26.880654 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cddebc-7b27-4510-bb42-5e15ed0828ed None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:26.884414 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4e903-021e-4b6a-9c22-ab5d9d824fc1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'adbdf910e67d4185a0ae14edf34ee3b9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:26.885064 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4e903-021e-4b6a-9c22-ab5d9d824fc1 service glance] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:26.885348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4e903-021e-4b6a-9c22-ab5d9d824fc1 service glance] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:26.885623 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4e903-021e-4b6a-9c22-ab5d9d824fc1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:26.895849 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4e903-021e-4b6a-9c22-ab5d9d824fc1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:26.897370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4e903-021e-4b6a-9c22-ab5d9d824fc1 service glance] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:26.908603 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1427/2802] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:26 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:28.974869 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efabc3-4ee9-4ca4-a006-582f40398557 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:28.975396 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efabc3-4ee9-4ca4-a006-582f40398557 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:28.975644 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09efabc3-4ee9-4ca4-a006-582f40398557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:28.995264 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-09efabc3-4ee9-4ca4-a006-582f40398557 None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:28.996491 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-09efabc3-4ee9-4ca4-a006-582f40398557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:29.004974 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1376/2803] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:24:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:29.017025 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4e903-021e-4b6a-9c22-ab5d9d824fc1 service glance] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:29.029213 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4e903-021e-4b6a-9c22-ab5d9d824fc1 service glance] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:29.035148 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da99daa-a76e-4c55-a988-6165c8311337 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:29.035828 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da99daa-a76e-4c55-a988-6165c8311337 service swift] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:29.036115 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da99daa-a76e-4c55-a988-6165c8311337 service swift] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:29.036394 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da99daa-a76e-4c55-a988-6165c8311337 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:29.045263 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da99daa-a76e-4c55-a988-6165c8311337 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:29.046852 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da99daa-a76e-4c55-a988-6165c8311337 service swift] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:29.055443 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1428/2804] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:24:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:24:38.989204 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=12 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:39.052334 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=41 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:46.492630 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60991242-91f2-439a-b0d7-62d5467d154c None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:46.493135 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60991242-91f2-439a-b0d7-62d5467d154c None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:46.493135 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60991242-91f2-439a-b0d7-62d5467d154c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:46.511762 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-60991242-91f2-439a-b0d7-62d5467d154c None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:24:46.512968 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-60991242-91f2-439a-b0d7-62d5467d154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:46.521469 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1377/2805] 10.222.0.42 () {58 vars in 967 bytes} [Sun Jul 24 01:24:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:24:46.533868 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da99daa-a76e-4c55-a988-6165c8311337 service swift] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:46.545987 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da99daa-a76e-4c55-a988-6165c8311337 service swift] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:46.552065 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b730b-0c8a-45bd-9116-96b36ed89bda service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:46.552698 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b730b-0c8a-45bd-9116-96b36ed89bda service swift] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:46.552975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b730b-0c8a-45bd-9116-96b36ed89bda service swift] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:46.553560 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065b730b-0c8a-45bd-9116-96b36ed89bda service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:46.562259 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b730b-0c8a-45bd-9116-96b36ed89bda service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:46.563906 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065b730b-0c8a-45bd-9116-96b36ed89bda service swift] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:46.572651 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1429/2806] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:24:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:24:47.911706 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60991242-91f2-439a-b0d7-62d5467d154c None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:24:47.913389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-60991242-91f2-439a-b0d7-62d5467d154c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:47.987523 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60991242-91f2-439a-b0d7-62d5467d154c None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:24:47.992870 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300ee28-62ac-4ee5-9681-a778bdb6c7cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333db0711d0f41fe8066ba5b9d91dacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:24:47.993529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300ee28-62ac-4ee5-9681-a778bdb6c7cf service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:24:47.993813 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300ee28-62ac-4ee5-9681-a778bdb6c7cf service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:24:47.994093 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300ee28-62ac-4ee5-9681-a778bdb6c7cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:24:47.996085 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3300ee28-62ac-4ee5-9681-a778bdb6c7cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:24:48.007692 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300ee28-62ac-4ee5-9681-a778bdb6c7cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:24:48.009303 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300ee28-62ac-4ee5-9681-a778bdb6c7cf service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:24:48.019327 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1378/2807] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:24:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:24:56.568926 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=6 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:24:58.015289 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=35 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:43.903064 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b730b-0c8a-45bd-9116-96b36ed89bda service swift] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:43.904814 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-065b730b-0c8a-45bd-9116-96b36ed89bda service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:43.965347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065b730b-0c8a-45bd-9116-96b36ed89bda service swift] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:43.969477 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939adb1f-f461-4b3e-8e2d-444c077d6d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:43.970120 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939adb1f-f461-4b3e-8e2d-444c077d6d99 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:43.970408 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939adb1f-f461-4b3e-8e2d-444c077d6d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:43.970688 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939adb1f-f461-4b3e-8e2d-444c077d6d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:43.972609 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-939adb1f-f461-4b3e-8e2d-444c077d6d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:44.035688 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939adb1f-f461-4b3e-8e2d-444c077d6d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:44.037141 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939adb1f-f461-4b3e-8e2d-444c077d6d99 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:44.047281 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1430/2808] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:47.132801 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300ee28-62ac-4ee5-9681-a778bdb6c7cf service placement] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:47.143990 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300ee28-62ac-4ee5-9681-a778bdb6c7cf service placement] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:47.150571 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a5bfc-feb1-4c68-8993-99d960e9cf55 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333db0711d0f41fe8066ba5b9d91dacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:47.151222 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a5bfc-feb1-4c68-8993-99d960e9cf55 service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:47.151529 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a5bfc-feb1-4c68-8993-99d960e9cf55 service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:47.151853 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a5bfc-feb1-4c68-8993-99d960e9cf55 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:47.153755 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-209a5bfc-feb1-4c68-8993-99d960e9cf55 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:47.166189 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a5bfc-feb1-4c68-8993-99d960e9cf55 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:47.167862 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a5bfc-feb1-4c68-8993-99d960e9cf55 service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:47.180486 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1379/2809] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:47.203998 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939adb1f-f461-4b3e-8e2d-444c077d6d99 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:47.206047 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-939adb1f-f461-4b3e-8e2d-444c077d6d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:47.220552 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939adb1f-f461-4b3e-8e2d-444c077d6d99 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:47.226440 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f0821-713a-429b-b05c-437dd01e58a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:47.227525 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f0821-713a-429b-b05c-437dd01e58a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:47.228028 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f0821-713a-429b-b05c-437dd01e58a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:47.228502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f0821-713a-429b-b05c-437dd01e58a2 admin admin] PATH_INFO: `/v3/users/fe042f088ffb4b7db88cafe05b11808c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:47.229819 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f0821-713a-429b-b05c-437dd01e58a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe042f088ffb4b7db88cafe05b11808c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:47.233694 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f0821-713a-429b-b05c-437dd01e58a2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:47.286716 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8d9f0821-713a-429b-b05c-437dd01e58a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe042f088ffb4b7db88cafe05b11808c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.287401 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8d9f0821-713a-429b-b05c-437dd01e58a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe042f088ffb4b7db88cafe05b11808c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.298769 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8d9f0821-713a-429b-b05c-437dd01e58a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe042f088ffb4b7db88cafe05b11808c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.299601 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8d9f0821-713a-429b-b05c-437dd01e58a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe042f088ffb4b7db88cafe05b11808c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.306690 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-8d9f0821-713a-429b-b05c-437dd01e58a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe042f088ffb4b7db88cafe05b11808c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.324528 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1431/2810] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:47 2022] DELETE /identity/v3/users/fe042f088ffb4b7db88cafe05b11808c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:47.500063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a5bfc-feb1-4c68-8993-99d960e9cf55 service placement] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:47.513707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a5bfc-feb1-4c68-8993-99d960e9cf55 service placement] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:47.572281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebc6b3-b2f3-4298-b676-dc23bf5596a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:47.573103 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebc6b3-b2f3-4298-b676-dc23bf5596a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:47.573388 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebc6b3-b2f3-4298-b676-dc23bf5596a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:47.573669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebc6b3-b2f3-4298-b676-dc23bf5596a5 admin admin] PATH_INFO: `/v3/projects/013fccf2797345bf95efcafd089dfcf1` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:47.574941 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebc6b3-b2f3-4298-b676-dc23bf5596a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=013fccf2797345bf95efcafd089dfcf1)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:47.576917 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eebc6b3-b2f3-4298-b676-dc23bf5596a5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:47.630531 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1eebc6b3-b2f3-4298-b676-dc23bf5596a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '013fccf2797345bf95efcafd089dfcf1', 'request_id': 'req-1eebc6b3-b2f3-4298-b676-dc23bf5596a5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.638763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1eebc6b3-b2f3-4298-b676-dc23bf5596a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '013fccf2797345bf95efcafd089dfcf1', 'request_id': 'req-1eebc6b3-b2f3-4298-b676-dc23bf5596a5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.644794 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1eebc6b3-b2f3-4298-b676-dc23bf5596a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '013fccf2797345bf95efcafd089dfcf1', 'request_id': 'req-1eebc6b3-b2f3-4298-b676-dc23bf5596a5'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.656165 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1eebc6b3-b2f3-4298-b676-dc23bf5596a5 admin admin] The token cache is being invalidate because project 013fccf2797345bf95efcafd089dfcf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:47.656458 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1eebc6b3-b2f3-4298-b676-dc23bf5596a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.657088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-1eebc6b3-b2f3-4298-b676-dc23bf5596a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:47.658658 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1380/2811] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:47 2022] DELETE /identity/v3/projects/013fccf2797345bf95efcafd089dfcf1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:47.664078 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a711dc4-82f6-4b4f-8e35-1d779131b00b None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:47.664379 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a711dc4-82f6-4b4f-8e35-1d779131b00b None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:47.664662 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a711dc4-82f6-4b4f-8e35-1d779131b00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:47.684560 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-3a711dc4-82f6-4b4f-8e35-1d779131b00b None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:47.685788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-3a711dc4-82f6-4b4f-8e35-1d779131b00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:47.705075 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:47.749871 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1432/2812] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:25:47.757833 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afe31c-5357-4dfe-be04-25cd432ff625 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:47.758175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afe31c-5357-4dfe-be04-25cd432ff625 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:47.758455 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5afe31c-5357-4dfe-be04-25cd432ff625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:47.777917 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f5afe31c-5357-4dfe-be04-25cd432ff625 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:47.779131 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f5afe31c-5357-4dfe-be04-25cd432ff625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:47.788381 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1381/2813] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:47.793101 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a711dc4-82f6-4b4f-8e35-1d779131b00b None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:47.803591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a711dc4-82f6-4b4f-8e35-1d779131b00b None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:47.809616 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4587a6e-a333-4023-8e13-322bf2fe5cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:47.810286 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4587a6e-a333-4023-8e13-322bf2fe5cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:47.810563 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4587a6e-a333-4023-8e13-322bf2fe5cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:47.810836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4587a6e-a333-4023-8e13-322bf2fe5cc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:47.811597 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4587a6e-a333-4023-8e13-322bf2fe5cc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:47.811902 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4587a6e-a333-4023-8e13-322bf2fe5cc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:47.813551 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4587a6e-a333-4023-8e13-322bf2fe5cc1 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:47.826054 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1433/2814] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:47.830534 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afe31c-5357-4dfe-be04-25cd432ff625 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:47.840226 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5afe31c-5357-4dfe-be04-25cd432ff625 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:47.845372 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fd467-552f-4cfa-be9d-994f5b479e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:47.846052 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fd467-552f-4cfa-be9d-994f5b479e7d admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:47.846333 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fd467-552f-4cfa-be9d-994f5b479e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:47.846610 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7fd467-552f-4cfa-be9d-994f5b479e7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:47.847318 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fd467-552f-4cfa-be9d-994f5b479e7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:47.849266 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7fd467-552f-4cfa-be9d-994f5b479e7d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:47.887401 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1382/2815] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:47 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:47.891596 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4587a6e-a333-4023-8e13-322bf2fe5cc1 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:47.903911 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4587a6e-a333-4023-8e13-322bf2fe5cc1 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:47.966613 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f1e1b-4754-42ab-a83d-4cb41d4469b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:47.967285 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f1e1b-4754-42ab-a83d-4cb41d4469b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:47.967621 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f1e1b-4754-42ab-a83d-4cb41d4469b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:47.967896 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f1e1b-4754-42ab-a83d-4cb41d4469b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:47.968582 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f1e1b-4754-42ab-a83d-4cb41d4469b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:47.970542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f1e1b-4754-42ab-a83d-4cb41d4469b2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:47.991495 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1434/2816] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:47 2022] POST /identity/v3/users => generated 287 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:25:47.995946 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fd467-552f-4cfa-be9d-994f5b479e7d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:48.006307 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7fd467-552f-4cfa-be9d-994f5b479e7d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:48.011720 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3be82d-0fc2-45a9-b552-9adc2dbe2d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:48.013383 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3be82d-0fc2-45a9-b552-9adc2dbe2d4b admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:48.013383 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3be82d-0fc2-45a9-b552-9adc2dbe2d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:48.013383 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3be82d-0fc2-45a9-b552-9adc2dbe2d4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:48.013782 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3be82d-0fc2-45a9-b552-9adc2dbe2d4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:48.015261 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3be82d-0fc2-45a9-b552-9adc2dbe2d4b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:48.026969 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1383/2817] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:48.031162 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f1e1b-4754-42ab-a83d-4cb41d4469b2 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:48.042678 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f1e1b-4754-42ab-a83d-4cb41d4469b2 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:48.048617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9c597-17c8-47e5-a1b2-453c00e0e8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:48.049308 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9c597-17c8-47e5-a1b2-453c00e0e8cb admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:48.049551 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9c597-17c8-47e5-a1b2-453c00e0e8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:48.049845 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9c597-17c8-47e5-a1b2-453c00e0e8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:48.050581 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9c597-17c8-47e5-a1b2-453c00e0e8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:48.052268 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9c597-17c8-47e5-a1b2-453c00e0e8cb admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:48.063094 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1435/2818] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:48.068247 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3be82d-0fc2-45a9-b552-9adc2dbe2d4b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:48.079102 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3be82d-0fc2-45a9-b552-9adc2dbe2d4b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:48.084756 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e175d6-cf64-4ef4-9654-c760ccb8b4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:48.085800 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e175d6-cf64-4ef4-9654-c760ccb8b4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:48.086166 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e175d6-cf64-4ef4-9654-c760ccb8b4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:48.086501 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e175d6-cf64-4ef4-9654-c760ccb8b4e9 admin admin] PATH_INFO: `/v3/projects/d3b91c64b4d9409a965b1045f1f47ab0/users/712b2dcbd8f944158fa77e3f4b0a86ff/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:48.102957 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e175d6-cf64-4ef4-9654-c760ccb8b4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3b91c64b4d9409a965b1045f1f47ab0, user_id=712b2dcbd8f944158fa77e3f4b0a86ff, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:48.105848 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e175d6-cf64-4ef4-9654-c760ccb8b4e9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:48.120210 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1384/2819] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:48 2022] PUT /identity/v3/projects/d3b91c64b4d9409a965b1045f1f47ab0/users/712b2dcbd8f944158fa77e3f4b0a86ff/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:48.130432 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef8240-fe26-4a50-92d0-1e8f6d033d78 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:48.130759 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef8240-fe26-4a50-92d0-1e8f6d033d78 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:48.131052 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef8240-fe26-4a50-92d0-1e8f6d033d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:48.161201 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-9eef8240-fe26-4a50-92d0-1e8f6d033d78 None None] MFA Rules not processed for user `712b2dcbd8f944158fa77e3f4b0a86ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:48.162655 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-9eef8240-fe26-4a50-92d0-1e8f6d033d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:48.226162 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1436/2820] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:48.237834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e175d6-cf64-4ef4-9654-c760ccb8b4e9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:48.239830 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-06e175d6-cf64-4ef4-9654-c760ccb8b4e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:48.246789 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:48.319757 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e175d6-cf64-4ef4-9654-c760ccb8b4e9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:48.326739 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b79e982-7612-4897-ab5c-cadac1a77934 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6c32c443ee1a421e98e7656e8e86e27a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:48.327422 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79e982-7612-4897-ab5c-cadac1a77934 service nova] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:48.327708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79e982-7612-4897-ab5c-cadac1a77934 service nova] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:48.327993 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b79e982-7612-4897-ab5c-cadac1a77934 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:48.336785 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79e982-7612-4897-ab5c-cadac1a77934 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:48.338409 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b79e982-7612-4897-ab5c-cadac1a77934 service nova] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:48.348216 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1385/2821] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:48 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:51.036219 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef8240-fe26-4a50-92d0-1e8f6d033d78 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:51.055441 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:51.103260 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef8240-fe26-4a50-92d0-1e8f6d033d78 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:51.108470 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528414f-ad65-4050-adfc-67a0fbb46e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:51.109348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528414f-ad65-4050-adfc-67a0fbb46e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:51.109637 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528414f-ad65-4050-adfc-67a0fbb46e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:51.109918 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a528414f-ad65-4050-adfc-67a0fbb46e0e admin admin] PATH_INFO: `/v3/users/712b2dcbd8f944158fa77e3f4b0a86ff` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:51.111147 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528414f-ad65-4050-adfc-67a0fbb46e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=712b2dcbd8f944158fa77e3f4b0a86ff)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:51.113133 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a528414f-ad65-4050-adfc-67a0fbb46e0e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:51.163844 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a528414f-ad65-4050-adfc-67a0fbb46e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712b2dcbd8f944158fa77e3f4b0a86ff'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:51.164487 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a528414f-ad65-4050-adfc-67a0fbb46e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712b2dcbd8f944158fa77e3f4b0a86ff'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:51.173676 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a528414f-ad65-4050-adfc-67a0fbb46e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712b2dcbd8f944158fa77e3f4b0a86ff'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:51.174309 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a528414f-ad65-4050-adfc-67a0fbb46e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712b2dcbd8f944158fa77e3f4b0a86ff'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:51.181209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-a528414f-ad65-4050-adfc-67a0fbb46e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712b2dcbd8f944158fa77e3f4b0a86ff'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:51.198523 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1437/2822] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:51 2022] DELETE /identity/v3/users/712b2dcbd8f944158fa77e3f4b0a86ff => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:51.203447 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1023-6788-48ba-9fa2-ff6134d39fe5 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:51.203948 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1023-6788-48ba-9fa2-ff6134d39fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:51.204048 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b1023-6788-48ba-9fa2-ff6134d39fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:51.221857 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-788b1023-6788-48ba-9fa2-ff6134d39fe5 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:51.223063 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-788b1023-6788-48ba-9fa2-ff6134d39fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:51.284025 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1386/2823] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:51.295938 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528414f-ad65-4050-adfc-67a0fbb46e0e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:51.297836 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-a528414f-ad65-4050-adfc-67a0fbb46e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:51.366719 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a528414f-ad65-4050-adfc-67a0fbb46e0e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:51.370882 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c318b98b-b3b2-4318-ad77-422a33b382e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:51.371567 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318b98b-b3b2-4318-ad77-422a33b382e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:51.371853 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318b98b-b3b2-4318-ad77-422a33b382e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:51.372136 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c318b98b-b3b2-4318-ad77-422a33b382e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:51.381449 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318b98b-b3b2-4318-ad77-422a33b382e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:51.382891 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c318b98b-b3b2-4318-ad77-422a33b382e5 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:51.392505 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1438/2824] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:51.676747 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b1023-6788-48ba-9fa2-ff6134d39fe5 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:51.678301 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-788b1023-6788-48ba-9fa2-ff6134d39fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:51.690677 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b1023-6788-48ba-9fa2-ff6134d39fe5 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:51.695590 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee20f93-bdac-4b87-9972-fa1b330fda7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:51.696473 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee20f93-bdac-4b87-9972-fa1b330fda7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:51.696753 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee20f93-bdac-4b87-9972-fa1b330fda7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:51.697051 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee20f93-bdac-4b87-9972-fa1b330fda7b admin admin] PATH_INFO: `/v3/projects/d3b91c64b4d9409a965b1045f1f47ab0` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:51.698275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee20f93-bdac-4b87-9972-fa1b330fda7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3b91c64b4d9409a965b1045f1f47ab0)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:51.700274 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee20f93-bdac-4b87-9972-fa1b330fda7b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:51.747633 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bee20f93-bdac-4b87-9972-fa1b330fda7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3b91c64b4d9409a965b1045f1f47ab0', 'request_id': 'req-bee20f93-bdac-4b87-9972-fa1b330fda7b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:51.756126 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bee20f93-bdac-4b87-9972-fa1b330fda7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3b91c64b4d9409a965b1045f1f47ab0', 'request_id': 'req-bee20f93-bdac-4b87-9972-fa1b330fda7b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:51.762078 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bee20f93-bdac-4b87-9972-fa1b330fda7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3b91c64b4d9409a965b1045f1f47ab0', 'request_id': 'req-bee20f93-bdac-4b87-9972-fa1b330fda7b'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:51.773179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bee20f93-bdac-4b87-9972-fa1b330fda7b admin admin] The token cache is being invalidate because project d3b91c64b4d9409a965b1045f1f47ab0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:51.773466 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bee20f93-bdac-4b87-9972-fa1b330fda7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:51.774108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-bee20f93-bdac-4b87-9972-fa1b330fda7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:51.775647 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1387/2825] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:51 2022] DELETE /identity/v3/projects/d3b91c64b4d9409a965b1045f1f47ab0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:51.781658 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb9544-119b-40da-b728-f87736d7d9e6 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:51.782026 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb9544-119b-40da-b728-f87736d7d9e6 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:51.782313 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceb9544-119b-40da-b728-f87736d7d9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:51.801642 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-7ceb9544-119b-40da-b728-f87736d7d9e6 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:51.802857 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-7ceb9544-119b-40da-b728-f87736d7d9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:51.839766 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:51.867922 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1439/2826] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:25:51.875911 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17409573-8b64-4385-ae9a-865f5eb7bef4 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:51.876205 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17409573-8b64-4385-ae9a-865f5eb7bef4 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:51.876484 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17409573-8b64-4385-ae9a-865f5eb7bef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:51.896186 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-17409573-8b64-4385-ae9a-865f5eb7bef4 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:51.897389 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-17409573-8b64-4385-ae9a-865f5eb7bef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:51.906062 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1388/2827] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:51.910822 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb9544-119b-40da-b728-f87736d7d9e6 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:51.923502 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceb9544-119b-40da-b728-f87736d7d9e6 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:51.929505 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38be9ad-3526-4c26-a629-2973283388ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:51.930152 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38be9ad-3526-4c26-a629-2973283388ec admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:51.930443 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38be9ad-3526-4c26-a629-2973283388ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:51.930712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38be9ad-3526-4c26-a629-2973283388ec admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:51.931474 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38be9ad-3526-4c26-a629-2973283388ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:51.931783 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38be9ad-3526-4c26-a629-2973283388ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:51.933406 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38be9ad-3526-4c26-a629-2973283388ec admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:51.949485 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1440/2828] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:51.954033 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17409573-8b64-4385-ae9a-865f5eb7bef4 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:51.964049 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17409573-8b64-4385-ae9a-865f5eb7bef4 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:51.970058 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f5b0a-aec8-45ba-aae3-7696cafe22c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:51.970721 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f5b0a-aec8-45ba-aae3-7696cafe22c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:51.971005 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f5b0a-aec8-45ba-aae3-7696cafe22c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:51.971275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29f5b0a-aec8-45ba-aae3-7696cafe22c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:51.972000 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f5b0a-aec8-45ba-aae3-7696cafe22c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:51.973939 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29f5b0a-aec8-45ba-aae3-7696cafe22c6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:51.977558 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:52.002775 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1389/2829] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:51 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:52.007278 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38be9ad-3526-4c26-a629-2973283388ec admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:52.018087 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38be9ad-3526-4c26-a629-2973283388ec admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:52.077134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5dfbd-b9f1-47c6-9f97-f85c0ff3f62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:52.077792 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5dfbd-b9f1-47c6-9f97-f85c0ff3f62a admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:52.078092 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5dfbd-b9f1-47c6-9f97-f85c0ff3f62a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:52.078381 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5dfbd-b9f1-47c6-9f97-f85c0ff3f62a admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:52.079083 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5dfbd-b9f1-47c6-9f97-f85c0ff3f62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:52.081033 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5dfbd-b9f1-47c6-9f97-f85c0ff3f62a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:52.102986 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1441/2830] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:52 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:52.107288 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f5b0a-aec8-45ba-aae3-7696cafe22c6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:52.118270 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29f5b0a-aec8-45ba-aae3-7696cafe22c6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:52.124105 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3027f-5431-4bfb-bdf3-6180571085dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:52.124780 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3027f-5431-4bfb-bdf3-6180571085dc admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:52.125069 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3027f-5431-4bfb-bdf3-6180571085dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:52.125354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3027f-5431-4bfb-bdf3-6180571085dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:52.126089 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3027f-5431-4bfb-bdf3-6180571085dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:52.127761 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e3027f-5431-4bfb-bdf3-6180571085dc admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:52.140183 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1390/2831] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:52.144265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5dfbd-b9f1-47c6-9f97-f85c0ff3f62a admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:52.155805 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5dfbd-b9f1-47c6-9f97-f85c0ff3f62a admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:52.160941 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20c19ff-4bf6-4232-b0c8-398ef1658c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:52.161609 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c19ff-4bf6-4232-b0c8-398ef1658c2a admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:52.161895 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c19ff-4bf6-4232-b0c8-398ef1658c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:52.162173 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20c19ff-4bf6-4232-b0c8-398ef1658c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:52.162907 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c19ff-4bf6-4232-b0c8-398ef1658c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:52.164569 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20c19ff-4bf6-4232-b0c8-398ef1658c2a admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:52.176025 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1442/2832] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:52.180242 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3027f-5431-4bfb-bdf3-6180571085dc admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:52.190790 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3027f-5431-4bfb-bdf3-6180571085dc admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:52.196729 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b739ed-87f4-48cb-9796-b91423682984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:52.197648 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b739ed-87f4-48cb-9796-b91423682984 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:52.197930 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b739ed-87f4-48cb-9796-b91423682984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:52.198206 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b739ed-87f4-48cb-9796-b91423682984 admin admin] PATH_INFO: `/v3/projects/919155c7ed9b427fbec791eb01bdcd67/users/c9300948cbdb4728b1146201288982db/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:52.213843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b739ed-87f4-48cb-9796-b91423682984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=919155c7ed9b427fbec791eb01bdcd67, user_id=c9300948cbdb4728b1146201288982db, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:52.216607 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b739ed-87f4-48cb-9796-b91423682984 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:52.231573 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1391/2833] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:52 2022] PUT /identity/v3/projects/919155c7ed9b427fbec791eb01bdcd67/users/c9300948cbdb4728b1146201288982db/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:52.243326 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58c1e-ffed-49ba-9e3c-4931ffd26396 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:52.243649 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58c1e-ffed-49ba-9e3c-4931ffd26396 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:52.243940 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f58c1e-ffed-49ba-9e3c-4931ffd26396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:52.272250 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-56f58c1e-ffed-49ba-9e3c-4931ffd26396 None None] MFA Rules not processed for user `c9300948cbdb4728b1146201288982db`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:52.273541 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-56f58c1e-ffed-49ba-9e3c-4931ffd26396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:52.339226 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1443/2834] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:52.344134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b739ed-87f4-48cb-9796-b91423682984 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:52.407203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b739ed-87f4-48cb-9796-b91423682984 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:52.412414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf2832-99e0-4ccc-a35c-4df3161074d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:52.413071 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf2832-99e0-4ccc-a35c-4df3161074d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:52.413362 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf2832-99e0-4ccc-a35c-4df3161074d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:52.413638 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddf2832-99e0-4ccc-a35c-4df3161074d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:52.414323 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf2832-99e0-4ccc-a35c-4df3161074d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:52.416621 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddf2832-99e0-4ccc-a35c-4df3161074d0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:52.445048 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1392/2835] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:52 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:52.449534 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58c1e-ffed-49ba-9e3c-4931ffd26396 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:52.462918 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f58c1e-ffed-49ba-9e3c-4931ffd26396 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:52.495874 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:52.526354 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934556a-2162-41e3-b45e-7357336a13c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:52.527037 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934556a-2162-41e3-b45e-7357336a13c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:52.527336 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934556a-2162-41e3-b45e-7357336a13c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:52.527630 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f934556a-2162-41e3-b45e-7357336a13c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:52.528323 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934556a-2162-41e3-b45e-7357336a13c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:52.530290 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f934556a-2162-41e3-b45e-7357336a13c3 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:52.550877 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1444/2836] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:52 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:52.555016 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf2832-99e0-4ccc-a35c-4df3161074d0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:52.565564 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddf2832-99e0-4ccc-a35c-4df3161074d0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:52.571003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac682f-5b80-4b68-8132-ce230ed47693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:52.571771 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac682f-5b80-4b68-8132-ce230ed47693 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:52.572811 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac682f-5b80-4b68-8132-ce230ed47693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:52.573088 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac682f-5b80-4b68-8132-ce230ed47693 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:52.573997 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac682f-5b80-4b68-8132-ce230ed47693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:52.575675 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ac682f-5b80-4b68-8132-ce230ed47693 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:52.587714 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1393/2837] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:52.592107 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934556a-2162-41e3-b45e-7357336a13c3 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:52.602781 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f934556a-2162-41e3-b45e-7357336a13c3 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:52.608738 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83447397-417c-406b-8f36-967baa4d6e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:52.609639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83447397-417c-406b-8f36-967baa4d6e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:52.609925 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83447397-417c-406b-8f36-967baa4d6e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:52.610216 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83447397-417c-406b-8f36-967baa4d6e76 admin admin] PATH_INFO: `/v3/projects/8002e2ec2eae49aab8fbf47a0dc7fe02/users/54ab398837894c988b15ddd203a4d9cb/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:52.625663 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83447397-417c-406b-8f36-967baa4d6e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8002e2ec2eae49aab8fbf47a0dc7fe02, user_id=54ab398837894c988b15ddd203a4d9cb, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:52.628408 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83447397-417c-406b-8f36-967baa4d6e76 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:52.643289 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1445/2838] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:52 2022] PUT /identity/v3/projects/8002e2ec2eae49aab8fbf47a0dc7fe02/users/54ab398837894c988b15ddd203a4d9cb/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:52.647522 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac682f-5b80-4b68-8132-ce230ed47693 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:52.658985 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac682f-5b80-4b68-8132-ce230ed47693 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:52.723980 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dfc5c-902a-4edd-ae07-77067c002f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:52.724817 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dfc5c-902a-4edd-ae07-77067c002f5c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:52.725101 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dfc5c-902a-4edd-ae07-77067c002f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:52.725415 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dfc5c-902a-4edd-ae07-77067c002f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:52.726396 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92dfc5c-902a-4edd-ae07-77067c002f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:52.728846 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92dfc5c-902a-4edd-ae07-77067c002f5c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:52.739915 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1394/2839] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:52.744202 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83447397-417c-406b-8f36-967baa4d6e76 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:52.754753 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83447397-417c-406b-8f36-967baa4d6e76 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:52.760257 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927553a-d486-4538-8eac-f42647bdc956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:52.761159 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927553a-d486-4538-8eac-f42647bdc956 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:52.761473 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927553a-d486-4538-8eac-f42647bdc956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:52.761746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f927553a-d486-4538-8eac-f42647bdc956 admin admin] PATH_INFO: `/v3/projects/8002e2ec2eae49aab8fbf47a0dc7fe02/users/54ab398837894c988b15ddd203a4d9cb/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:52.764027 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927553a-d486-4538-8eac-f42647bdc956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8002e2ec2eae49aab8fbf47a0dc7fe02, user_id=54ab398837894c988b15ddd203a4d9cb, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:52.766716 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f927553a-d486-4538-8eac-f42647bdc956 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:52.778230 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1446/2840] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:52 2022] PUT /identity/v3/projects/8002e2ec2eae49aab8fbf47a0dc7fe02/users/54ab398837894c988b15ddd203a4d9cb/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:52.788213 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52f6c1-eeb9-466a-a864-5e4bdd861a31 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:52.788536 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52f6c1-eeb9-466a-a864-5e4bdd861a31 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:52.788818 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e52f6c1-eeb9-466a-a864-5e4bdd861a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:52.817687 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-2e52f6c1-eeb9-466a-a864-5e4bdd861a31 None None] MFA Rules not processed for user `54ab398837894c988b15ddd203a4d9cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:52.818937 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-2e52f6c1-eeb9-466a-a864-5e4bdd861a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:52.828385 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:52.891558 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1395/2841] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:52.905264 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927553a-d486-4538-8eac-f42647bdc956 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:52.907136 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f927553a-d486-4538-8eac-f42647bdc956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:52.968175 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f927553a-d486-4538-8eac-f42647bdc956 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:52.972397 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a91c48a-587c-4486-8130-46226f407344 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:52.973050 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91c48a-587c-4486-8130-46226f407344 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:52.973345 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91c48a-587c-4486-8130-46226f407344 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:52.973619 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a91c48a-587c-4486-8130-46226f407344 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:52.983589 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91c48a-587c-4486-8130-46226f407344 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:52.985047 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a91c48a-587c-4486-8130-46226f407344 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:52.995041 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1447/2842] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:53.024058 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52f6c1-eeb9-466a-a864-5e4bdd861a31 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:53.090604 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e52f6c1-eeb9-466a-a864-5e4bdd861a31 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:53.095741 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758a929-1db2-48bb-9347-4d5940ef3b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:53.096620 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a929-1db2-48bb-9347-4d5940ef3b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:53.096995 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a929-1db2-48bb-9347-4d5940ef3b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:53.097135 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4758a929-1db2-48bb-9347-4d5940ef3b7b admin admin] PATH_INFO: `/v3/users/c9300948cbdb4728b1146201288982db` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:53.098404 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758a929-1db2-48bb-9347-4d5940ef3b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9300948cbdb4728b1146201288982db)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:53.100397 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4758a929-1db2-48bb-9347-4d5940ef3b7b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:53.152598 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4758a929-1db2-48bb-9347-4d5940ef3b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9300948cbdb4728b1146201288982db'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.153273 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4758a929-1db2-48bb-9347-4d5940ef3b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9300948cbdb4728b1146201288982db'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.153883 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4758a929-1db2-48bb-9347-4d5940ef3b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9300948cbdb4728b1146201288982db'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.161479 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4758a929-1db2-48bb-9347-4d5940ef3b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9300948cbdb4728b1146201288982db'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.174134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4758a929-1db2-48bb-9347-4d5940ef3b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9300948cbdb4728b1146201288982db'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.188638 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1396/2843] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:53 2022] DELETE /identity/v3/users/c9300948cbdb4728b1146201288982db => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:53.193563 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04779a44-de6a-40e5-9609-1aad0c603b54 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:53.194054 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04779a44-de6a-40e5-9609-1aad0c603b54 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:53.194163 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04779a44-de6a-40e5-9609-1aad0c603b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:53.211669 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-04779a44-de6a-40e5-9609-1aad0c603b54 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:53.212876 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-04779a44-de6a-40e5-9609-1aad0c603b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:53.270420 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1448/2844] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:53.283713 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758a929-1db2-48bb-9347-4d5940ef3b7b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:53.285504 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4758a929-1db2-48bb-9347-4d5940ef3b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:53.317205 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:53.348003 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4758a929-1db2-48bb-9347-4d5940ef3b7b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:53.352719 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3330bb9-e422-4812-bcee-56665182ea56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:53.353381 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3330bb9-e422-4812-bcee-56665182ea56 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:53.353664 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3330bb9-e422-4812-bcee-56665182ea56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:53.353941 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3330bb9-e422-4812-bcee-56665182ea56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:53.363730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3330bb9-e422-4812-bcee-56665182ea56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:53.365188 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3330bb9-e422-4812-bcee-56665182ea56 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:53.374559 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1397/2845] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:53.654698 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04779a44-de6a-40e5-9609-1aad0c603b54 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:53.656165 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-04779a44-de6a-40e5-9609-1aad0c603b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:53.668949 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04779a44-de6a-40e5-9609-1aad0c603b54 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:53.673916 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:53.674798 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:53.675079 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:53.675370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0 admin admin] PATH_INFO: `/v3/projects/919155c7ed9b427fbec791eb01bdcd67` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:53.677065 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=919155c7ed9b427fbec791eb01bdcd67)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:53.678976 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:53.712068 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:53.730518 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '919155c7ed9b427fbec791eb01bdcd67', 'request_id': 'req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.736617 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '919155c7ed9b427fbec791eb01bdcd67', 'request_id': 'req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.741961 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '919155c7ed9b427fbec791eb01bdcd67', 'request_id': 'req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.755682 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0 admin admin] The token cache is being invalidate because project 919155c7ed9b427fbec791eb01bdcd67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:53.755968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.756562 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.758157 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1449/2846] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:53 2022] DELETE /identity/v3/projects/919155c7ed9b427fbec791eb01bdcd67 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:53.762207 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3330bb9-e422-4812-bcee-56665182ea56 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:53.772281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3330bb9-e422-4812-bcee-56665182ea56 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:53.831205 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623f2c63-c0bb-4eb8-978d-de4465459514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:53.832131 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f2c63-c0bb-4eb8-978d-de4465459514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:53.832412 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f2c63-c0bb-4eb8-978d-de4465459514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:53.832688 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623f2c63-c0bb-4eb8-978d-de4465459514 admin admin] PATH_INFO: `/v3/users/54ab398837894c988b15ddd203a4d9cb` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:53.833873 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f2c63-c0bb-4eb8-978d-de4465459514 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54ab398837894c988b15ddd203a4d9cb)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:53.835848 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623f2c63-c0bb-4eb8-978d-de4465459514 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:53.880688 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-623f2c63-c0bb-4eb8-978d-de4465459514 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54ab398837894c988b15ddd203a4d9cb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.881316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-623f2c63-c0bb-4eb8-978d-de4465459514 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54ab398837894c988b15ddd203a4d9cb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.881902 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-623f2c63-c0bb-4eb8-978d-de4465459514 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54ab398837894c988b15ddd203a4d9cb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.888605 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-623f2c63-c0bb-4eb8-978d-de4465459514 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54ab398837894c988b15ddd203a4d9cb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.900362 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-623f2c63-c0bb-4eb8-978d-de4465459514 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54ab398837894c988b15ddd203a4d9cb'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:53.916172 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1398/2847] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:53 2022] DELETE /identity/v3/users/54ab398837894c988b15ddd203a4d9cb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 24 01:25:54.209088 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:54.210633 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:54.225800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad1ec0-b7ca-4c2d-8028-1badd79b1de0 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:54.284857 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a4236-2a01-4b0a-99b8-7d74dcb0fbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:54.285753 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a4236-2a01-4b0a-99b8-7d74dcb0fbb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:54.286011 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a4236-2a01-4b0a-99b8-7d74dcb0fbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:54.286285 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a4236-2a01-4b0a-99b8-7d74dcb0fbb2 admin admin] PATH_INFO: `/v3/projects/8002e2ec2eae49aab8fbf47a0dc7fe02` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:54.287553 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a4236-2a01-4b0a-99b8-7d74dcb0fbb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8002e2ec2eae49aab8fbf47a0dc7fe02)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:54.289459 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a4236-2a01-4b0a-99b8-7d74dcb0fbb2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:54.340931 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b87a4236-2a01-4b0a-99b8-7d74dcb0fbb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8002e2ec2eae49aab8fbf47a0dc7fe02', 'request_id': 'req-b87a4236-2a01-4b0a-99b8-7d74dcb0fbb2'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:54.347210 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b87a4236-2a01-4b0a-99b8-7d74dcb0fbb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8002e2ec2eae49aab8fbf47a0dc7fe02', 'request_id': 'req-b87a4236-2a01-4b0a-99b8-7d74dcb0fbb2'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:54.354281 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b87a4236-2a01-4b0a-99b8-7d74dcb0fbb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8002e2ec2eae49aab8fbf47a0dc7fe02', 'request_id': 'req-b87a4236-2a01-4b0a-99b8-7d74dcb0fbb2'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:54.369277 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b87a4236-2a01-4b0a-99b8-7d74dcb0fbb2 admin admin] The token cache is being invalidate because project 8002e2ec2eae49aab8fbf47a0dc7fe02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:54.369575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b87a4236-2a01-4b0a-99b8-7d74dcb0fbb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:54.370332 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-b87a4236-2a01-4b0a-99b8-7d74dcb0fbb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:54.372113 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1450/2848] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:54 2022] DELETE /identity/v3/projects/8002e2ec2eae49aab8fbf47a0dc7fe02 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:54.377826 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ed48e-c935-4c05-8235-d4196fce9f6f None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:54.378322 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ed48e-c935-4c05-8235-d4196fce9f6f None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:54.378420 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995ed48e-c935-4c05-8235-d4196fce9f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:54.400058 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-995ed48e-c935-4c05-8235-d4196fce9f6f None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:54.401267 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-995ed48e-c935-4c05-8235-d4196fce9f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:54.446313 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:54.465718 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1399/2849] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:54.474959 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75978c7-9173-4c6b-b85a-bcfdea0bb27f None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:54.475257 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75978c7-9173-4c6b-b85a-bcfdea0bb27f None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:54.475568 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75978c7-9173-4c6b-b85a-bcfdea0bb27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:54.495203 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-f75978c7-9173-4c6b-b85a-bcfdea0bb27f None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:54.496591 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f75978c7-9173-4c6b-b85a-bcfdea0bb27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:54.505571 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1451/2850] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:54.510104 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ed48e-c935-4c05-8235-d4196fce9f6f None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:54.520493 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995ed48e-c935-4c05-8235-d4196fce9f6f None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:54.527989 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baf2ea-3872-4d47-9a97-6caed52ae037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:54.528642 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baf2ea-3872-4d47-9a97-6caed52ae037 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:54.528920 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baf2ea-3872-4d47-9a97-6caed52ae037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:54.529190 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11baf2ea-3872-4d47-9a97-6caed52ae037 admin admin] PATH_INFO: `/v3/domains` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:54.529925 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11baf2ea-3872-4d47-9a97-6caed52ae037 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80520) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:54.530237 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11baf2ea-3872-4d47-9a97-6caed52ae037 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:54.531899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11baf2ea-3872-4d47-9a97-6caed52ae037 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:54.544701 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1400/2851] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:25:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:54.549032 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75978c7-9173-4c6b-b85a-bcfdea0bb27f None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:54.558366 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75978c7-9173-4c6b-b85a-bcfdea0bb27f None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:54.563481 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68048bd6-1ca6-4446-b227-2b3d9ee8146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:54.564122 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68048bd6-1ca6-4446-b227-2b3d9ee8146e admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:54.564417 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68048bd6-1ca6-4446-b227-2b3d9ee8146e admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:54.564686 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68048bd6-1ca6-4446-b227-2b3d9ee8146e admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:54.565370 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68048bd6-1ca6-4446-b227-2b3d9ee8146e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:54.567278 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68048bd6-1ca6-4446-b227-2b3d9ee8146e admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:54.594498 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1452/2852] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:54 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:54.598589 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baf2ea-3872-4d47-9a97-6caed52ae037 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:54.609033 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11baf2ea-3872-4d47-9a97-6caed52ae037 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:54.667834 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5e928-e59e-4932-9818-59c87183088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:54.668525 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5e928-e59e-4932-9818-59c87183088e admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:54.668814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5e928-e59e-4932-9818-59c87183088e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:54.669094 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b5e928-e59e-4932-9818-59c87183088e admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:54.669812 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5e928-e59e-4932-9818-59c87183088e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:54.671849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b5e928-e59e-4932-9818-59c87183088e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:54.696977 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1401/2853] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:54 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 24 01:25:54.701606 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68048bd6-1ca6-4446-b227-2b3d9ee8146e admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:54.712346 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68048bd6-1ca6-4446-b227-2b3d9ee8146e admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:54.719348 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e67765-afae-43a2-b424-637732aac3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:54.720781 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e67765-afae-43a2-b424-637732aac3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:54.721526 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e67765-afae-43a2-b424-637732aac3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:54.721866 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e67765-afae-43a2-b424-637732aac3f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:54.722785 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e67765-afae-43a2-b424-637732aac3f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:54.725633 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e67765-afae-43a2-b424-637732aac3f3 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:54.737964 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1453/2854] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:54.742191 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5e928-e59e-4932-9818-59c87183088e admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:54.752756 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b5e928-e59e-4932-9818-59c87183088e admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:54.758442 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe14937-6165-489a-b4b8-114b02168de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:54.759106 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe14937-6165-489a-b4b8-114b02168de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:54.759434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe14937-6165-489a-b4b8-114b02168de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:54.759707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe14937-6165-489a-b4b8-114b02168de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:54.760431 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe14937-6165-489a-b4b8-114b02168de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:54.762131 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe14937-6165-489a-b4b8-114b02168de5 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:54.772339 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1402/2855] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:54.776361 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e67765-afae-43a2-b424-637732aac3f3 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:54.782753 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:54.786674 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e67765-afae-43a2-b424-637732aac3f3 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:54.793884 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c2f04-898d-434e-a4e6-f0c37018c551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:54.798531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c2f04-898d-434e-a4e6-f0c37018c551 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:54.798531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c2f04-898d-434e-a4e6-f0c37018c551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:54.798531 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8c2f04-898d-434e-a4e6-f0c37018c551 admin admin] PATH_INFO: `/v3/projects/91044024e0dc4c648ec09516205bf948/users/892f17bac60541498dedbea061b3d894/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:54.814429 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c2f04-898d-434e-a4e6-f0c37018c551 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91044024e0dc4c648ec09516205bf948, user_id=892f17bac60541498dedbea061b3d894, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:54.817209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8c2f04-898d-434e-a4e6-f0c37018c551 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:54.833358 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1454/2856] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:54 2022] PUT /identity/v3/projects/91044024e0dc4c648ec09516205bf948/users/892f17bac60541498dedbea061b3d894/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:54.844069 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b31d1-2d63-457b-ac37-052e89915c4e None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:54.844341 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b31d1-2d63-457b-ac37-052e89915c4e None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:54.844681 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797b31d1-2d63-457b-ac37-052e89915c4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:54.872597 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-797b31d1-2d63-457b-ac37-052e89915c4e None None] MFA Rules not processed for user `892f17bac60541498dedbea061b3d894`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:54.873814 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-797b31d1-2d63-457b-ac37-052e89915c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:54.940634 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1403/2857] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:54 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:54.945788 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c2f04-898d-434e-a4e6-f0c37018c551 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:55.007210 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8c2f04-898d-434e-a4e6-f0c37018c551 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:55.013908 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae3251-e492-46a3-80e0-84e0c954ae8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:55.014761 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae3251-e492-46a3-80e0-84e0c954ae8f admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:55.015043 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae3251-e492-46a3-80e0-84e0c954ae8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:55.015465 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebae3251-e492-46a3-80e0-84e0c954ae8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:55.016175 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae3251-e492-46a3-80e0-84e0c954ae8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:55.018117 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebae3251-e492-46a3-80e0-84e0c954ae8f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:55.047874 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1455/2858] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:54 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:55.052169 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b31d1-2d63-457b-ac37-052e89915c4e None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:55.063342 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797b31d1-2d63-457b-ac37-052e89915c4e None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:55.104874 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:55.124202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240acb9-8be0-4d3d-a618-99e31201ac78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:55.124891 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240acb9-8be0-4d3d-a618-99e31201ac78 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:55.125206 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240acb9-8be0-4d3d-a618-99e31201ac78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:55.125486 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d240acb9-8be0-4d3d-a618-99e31201ac78 admin admin] PATH_INFO: `/v3/users` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:55.126192 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240acb9-8be0-4d3d-a618-99e31201ac78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:55.128224 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d240acb9-8be0-4d3d-a618-99e31201ac78 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:55.150183 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1404/2859] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:55 2022] POST /identity/v3/users => generated 297 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:55.154994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae3251-e492-46a3-80e0-84e0c954ae8f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:55.166062 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebae3251-e492-46a3-80e0-84e0c954ae8f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:55.171846 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80142e-c7c2-46cc-b4ab-02bd39acb9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:55.172516 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80142e-c7c2-46cc-b4ab-02bd39acb9bd admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:55.172803 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80142e-c7c2-46cc-b4ab-02bd39acb9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:55.173076 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df80142e-c7c2-46cc-b4ab-02bd39acb9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:55.173817 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80142e-c7c2-46cc-b4ab-02bd39acb9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:55.175482 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df80142e-c7c2-46cc-b4ab-02bd39acb9bd admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:55.186895 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1456/2860] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 24 01:25:55.191175 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240acb9-8be0-4d3d-a618-99e31201ac78 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:55.201799 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d240acb9-8be0-4d3d-a618-99e31201ac78 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:55.207203 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33639bb6-84c3-450d-88c9-74b1c2ead91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:55.208134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33639bb6-84c3-450d-88c9-74b1c2ead91b admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:55.208415 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33639bb6-84c3-450d-88c9-74b1c2ead91b admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:55.208688 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33639bb6-84c3-450d-88c9-74b1c2ead91b admin admin] PATH_INFO: `/v3/projects/3e432b3cd07449008a558fbb82992fa5/users/65c3389c106e42059afba840ed5d4e83/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:55.225052 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33639bb6-84c3-450d-88c9-74b1c2ead91b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e432b3cd07449008a558fbb82992fa5, user_id=65c3389c106e42059afba840ed5d4e83, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:55.227760 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33639bb6-84c3-450d-88c9-74b1c2ead91b admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:55.241246 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1405/2861] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:55 2022] PUT /identity/v3/projects/3e432b3cd07449008a558fbb82992fa5/users/65c3389c106e42059afba840ed5d4e83/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:55.245384 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80142e-c7c2-46cc-b4ab-02bd39acb9bd admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:55.255563 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df80142e-c7c2-46cc-b4ab-02bd39acb9bd admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:55.313589 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a0a90-8656-4d35-8460-d686510bd6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:55.314263 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a0a90-8656-4d35-8460-d686510bd6e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:55.314517 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a0a90-8656-4d35-8460-d686510bd6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:55.314828 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a0a90-8656-4d35-8460-d686510bd6e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:55.315575 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a0a90-8656-4d35-8460-d686510bd6e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:55.317200 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1a0a90-8656-4d35-8460-d686510bd6e4 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:55.327324 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1457/2862] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:55.331705 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33639bb6-84c3-450d-88c9-74b1c2ead91b admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:55.342730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33639bb6-84c3-450d-88c9-74b1c2ead91b admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:55.348636 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b862421-bae9-4b3c-9df4-b55f5b24f605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:55.349557 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b862421-bae9-4b3c-9df4-b55f5b24f605 admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:55.349840 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b862421-bae9-4b3c-9df4-b55f5b24f605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:55.350117 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b862421-bae9-4b3c-9df4-b55f5b24f605 admin admin] PATH_INFO: `/v3/projects/3e432b3cd07449008a558fbb82992fa5/users/65c3389c106e42059afba840ed5d4e83/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:55.352362 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b862421-bae9-4b3c-9df4-b55f5b24f605 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e432b3cd07449008a558fbb82992fa5, user_id=65c3389c106e42059afba840ed5d4e83, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:55.355134 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b862421-bae9-4b3c-9df4-b55f5b24f605 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:55.365872 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1406/2863] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:55 2022] PUT /identity/v3/projects/3e432b3cd07449008a558fbb82992fa5/users/65c3389c106e42059afba840ed5d4e83/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:55.376296 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5c0e0-df05-4ec1-a560-c07ecab960c1 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:55.376590 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5c0e0-df05-4ec1-a560-c07ecab960c1 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:55.376872 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a5c0e0-df05-4ec1-a560-c07ecab960c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:55.405973 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c6a5c0e0-df05-4ec1-a560-c07ecab960c1 None None] MFA Rules not processed for user `65c3389c106e42059afba840ed5d4e83`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:55.407206 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c6a5c0e0-df05-4ec1-a560-c07ecab960c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:55.450422 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:55.480460 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1458/2864] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:55 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:55.493133 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b862421-bae9-4b3c-9df4-b55f5b24f605 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:55.495168 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-9b862421-bae9-4b3c-9df4-b55f5b24f605 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:55.557164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b862421-bae9-4b3c-9df4-b55f5b24f605 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:55.561567 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad453b7-3b5f-4f6d-a3df-6df3ee0fd240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:55.562210 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad453b7-3b5f-4f6d-a3df-6df3ee0fd240 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:55.562493 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad453b7-3b5f-4f6d-a3df-6df3ee0fd240 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:55.562764 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad453b7-3b5f-4f6d-a3df-6df3ee0fd240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:55.572973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad453b7-3b5f-4f6d-a3df-6df3ee0fd240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:55.574493 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad453b7-3b5f-4f6d-a3df-6df3ee0fd240 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:55.584375 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1407/2865] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:55 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:55.901250 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5c0e0-df05-4ec1-a560-c07ecab960c1 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:55.910867 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a5c0e0-df05-4ec1-a560-c07ecab960c1 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:55.917303 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b608a05-9e46-49be-8992-6cd8e702b2da tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c3389c106e42059afba840ed5d4e83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e432b3cd07449008a558fbb82992fa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:55.918004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b608a05-9e46-49be-8992-6cd8e702b2da tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:55.918358 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b608a05-9e46-49be-8992-6cd8e702b2da tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:55.918657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b608a05-9e46-49be-8992-6cd8e702b2da tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:55.919432 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b608a05-9e46-49be-8992-6cd8e702b2da tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:55.919742 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b608a05-9e46-49be-8992-6cd8e702b2da tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:55.921420 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b608a05-9e46-49be-8992-6cd8e702b2da tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:55.933621 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1459/2866] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:55.937995 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad453b7-3b5f-4f6d-a3df-6df3ee0fd240 service cinder] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:55.947421 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad453b7-3b5f-4f6d-a3df-6df3ee0fd240 service cinder] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:55.952884 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b1136-2f8a-4a71-8e30-348558ebbcfc tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c3389c106e42059afba840ed5d4e83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e432b3cd07449008a558fbb82992fa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:55.953539 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b1136-2f8a-4a71-8e30-348558ebbcfc tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:55.953829 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b1136-2f8a-4a71-8e30-348558ebbcfc tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:55.954107 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b1136-2f8a-4a71-8e30-348558ebbcfc tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:55.954797 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b1136-2f8a-4a71-8e30-348558ebbcfc tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:55.956763 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b1136-2f8a-4a71-8e30-348558ebbcfc tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:55.991651 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1408/2867] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:55 2022] POST /identity/v3/projects => generated 353 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:55.995887 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b608a05-9e46-49be-8992-6cd8e702b2da tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:56.005746 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b608a05-9e46-49be-8992-6cd8e702b2da tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:56.064039 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a58f14-abd4-4c7d-a76b-088bd7dd14e2 tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c3389c106e42059afba840ed5d4e83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e432b3cd07449008a558fbb82992fa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:56.064707 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a58f14-abd4-4c7d-a76b-088bd7dd14e2 tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:56.065000 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a58f14-abd4-4c7d-a76b-088bd7dd14e2 tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:56.065273 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a58f14-abd4-4c7d-a76b-088bd7dd14e2 tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:56.066001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a58f14-abd4-4c7d-a76b-088bd7dd14e2 tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:56.066314 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a58f14-abd4-4c7d-a76b-088bd7dd14e2 tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:56.067972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a58f14-abd4-4c7d-a76b-088bd7dd14e2 tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:56.079236 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1460/2868] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:56.114291 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b1136-2f8a-4a71-8e30-348558ebbcfc tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:56.125368 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b1136-2f8a-4a71-8e30-348558ebbcfc tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:56.130574 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a1aa9-7049-49f6-97ae-f5c121fb0d0f tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '65c3389c106e42059afba840ed5d4e83', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3e432b3cd07449008a558fbb82992fa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:56.131463 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a1aa9-7049-49f6-97ae-f5c121fb0d0f tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:56.131752 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a1aa9-7049-49f6-97ae-f5c121fb0d0f tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:56.132044 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a1aa9-7049-49f6-97ae-f5c121fb0d0f tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] PATH_INFO: `/v3/projects/d031a18a7679486da37857b4c9e1804e` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:56.133275 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a1aa9-7049-49f6-97ae-f5c121fb0d0f tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d031a18a7679486da37857b4c9e1804e)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:56.135208 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a1aa9-7049-49f6-97ae-f5c121fb0d0f tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:56.185237 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4e6a1aa9-7049-49f6-97ae-f5c121fb0d0f tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd031a18a7679486da37857b4c9e1804e', 'request_id': 'req-4e6a1aa9-7049-49f6-97ae-f5c121fb0d0f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:56.194541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4e6a1aa9-7049-49f6-97ae-f5c121fb0d0f tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd031a18a7679486da37857b4c9e1804e', 'request_id': 'req-4e6a1aa9-7049-49f6-97ae-f5c121fb0d0f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:56.200676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4e6a1aa9-7049-49f6-97ae-f5c121fb0d0f tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd031a18a7679486da37857b4c9e1804e', 'request_id': 'req-4e6a1aa9-7049-49f6-97ae-f5c121fb0d0f'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:56.207575 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:56.212719 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4e6a1aa9-7049-49f6-97ae-f5c121fb0d0f tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] The token cache is being invalidate because project d031a18a7679486da37857b4c9e1804e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:56.213030 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4e6a1aa9-7049-49f6-97ae-f5c121fb0d0f tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:56.213960 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-4e6a1aa9-7049-49f6-97ae-f5c121fb0d0f tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:56.216437 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1409/2869] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:56 2022] DELETE /identity/v3/projects/d031a18a7679486da37857b4c9e1804e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:56.421717 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a58f14-abd4-4c7d-a76b-088bd7dd14e2 tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:56.423727 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-d1a58f14-abd4-4c7d-a76b-088bd7dd14e2 tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:56.491034 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a58f14-abd4-4c7d-a76b-088bd7dd14e2 tempest-VolumeQuotaClassesTest-1625143933 tempest-VolumeQuotaClassesTest-1625143933-project-admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:56.550476 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71c487-ba76-41fe-8203-24d3e10d3498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:56.551418 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71c487-ba76-41fe-8203-24d3e10d3498 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:56.551719 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71c487-ba76-41fe-8203-24d3e10d3498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:56.552000 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71c487-ba76-41fe-8203-24d3e10d3498 admin admin] PATH_INFO: `/v3/users/892f17bac60541498dedbea061b3d894` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:56.553223 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71c487-ba76-41fe-8203-24d3e10d3498 admin admin] RBAC: Authorizing `identity:delete_user(user_id=892f17bac60541498dedbea061b3d894)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:56.555184 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71c487-ba76-41fe-8203-24d3e10d3498 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:56.560296 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=100 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:56.604829 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e71c487-ba76-41fe-8203-24d3e10d3498 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '892f17bac60541498dedbea061b3d894'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:56.605524 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e71c487-ba76-41fe-8203-24d3e10d3498 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '892f17bac60541498dedbea061b3d894'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:56.614642 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e71c487-ba76-41fe-8203-24d3e10d3498 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '892f17bac60541498dedbea061b3d894'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:56.615371 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e71c487-ba76-41fe-8203-24d3e10d3498 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '892f17bac60541498dedbea061b3d894'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:56.622968 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-6e71c487-ba76-41fe-8203-24d3e10d3498 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '892f17bac60541498dedbea061b3d894'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:56.640226 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1461/2870] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:56 2022] DELETE /identity/v3/users/892f17bac60541498dedbea061b3d894 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:56.644849 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68782ba1-8e72-46e6-ab08-ee8daae99077 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:56.645316 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68782ba1-8e72-46e6-ab08-ee8daae99077 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:56.645430 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68782ba1-8e72-46e6-ab08-ee8daae99077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:56.663358 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-68782ba1-8e72-46e6-ab08-ee8daae99077 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:56.664512 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-68782ba1-8e72-46e6-ab08-ee8daae99077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:56.730597 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1410/2871] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:56.744220 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71c487-ba76-41fe-8203-24d3e10d3498 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:56.746385 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-6e71c487-ba76-41fe-8203-24d3e10d3498 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:56.811161 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71c487-ba76-41fe-8203-24d3e10d3498 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:56.815171 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765424b-1e0b-456e-822c-b93b8168d177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:56.815862 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765424b-1e0b-456e-822c-b93b8168d177 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:56.816151 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765424b-1e0b-456e-822c-b93b8168d177 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:56.816434 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765424b-1e0b-456e-822c-b93b8168d177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:56.826645 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765424b-1e0b-456e-822c-b93b8168d177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:56.828127 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765424b-1e0b-456e-822c-b93b8168d177 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:56.837806 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1462/2872] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:57.126330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68782ba1-8e72-46e6-ab08-ee8daae99077 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:57.128009 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-68782ba1-8e72-46e6-ab08-ee8daae99077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:57.140224 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68782ba1-8e72-46e6-ab08-ee8daae99077 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:57.145109 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12626d20-c3f6-4c58-a4d3-cb20e99deba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:57.145954 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12626d20-c3f6-4c58-a4d3-cb20e99deba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:57.146236 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12626d20-c3f6-4c58-a4d3-cb20e99deba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:57.146644 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12626d20-c3f6-4c58-a4d3-cb20e99deba0 admin admin] PATH_INFO: `/v3/projects/91044024e0dc4c648ec09516205bf948` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:57.148549 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12626d20-c3f6-4c58-a4d3-cb20e99deba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91044024e0dc4c648ec09516205bf948)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:57.150735 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12626d20-c3f6-4c58-a4d3-cb20e99deba0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:57.203116 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-12626d20-c3f6-4c58-a4d3-cb20e99deba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91044024e0dc4c648ec09516205bf948', 'request_id': 'req-12626d20-c3f6-4c58-a4d3-cb20e99deba0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:57.211541 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-12626d20-c3f6-4c58-a4d3-cb20e99deba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91044024e0dc4c648ec09516205bf948', 'request_id': 'req-12626d20-c3f6-4c58-a4d3-cb20e99deba0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:57.217300 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-12626d20-c3f6-4c58-a4d3-cb20e99deba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91044024e0dc4c648ec09516205bf948', 'request_id': 'req-12626d20-c3f6-4c58-a4d3-cb20e99deba0'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:57.229301 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-12626d20-c3f6-4c58-a4d3-cb20e99deba0 admin admin] The token cache is being invalidate because project 91044024e0dc4c648ec09516205bf948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:57.229587 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-12626d20-c3f6-4c58-a4d3-cb20e99deba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:57.230290 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-12626d20-c3f6-4c58-a4d3-cb20e99deba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:57.231928 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1411/2873] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:57 2022] DELETE /identity/v3/projects/91044024e0dc4c648ec09516205bf948 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:57.236123 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765424b-1e0b-456e-822c-b93b8168d177 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:57.245972 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765424b-1e0b-456e-822c-b93b8168d177 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:57.304991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096452d-88f3-4953-92ae-1dcb9facd92f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:57.305878 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096452d-88f3-4953-92ae-1dcb9facd92f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:57.306177 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096452d-88f3-4953-92ae-1dcb9facd92f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:57.306437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096452d-88f3-4953-92ae-1dcb9facd92f admin admin] PATH_INFO: `/v3/users/65c3389c106e42059afba840ed5d4e83` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:57.307803 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096452d-88f3-4953-92ae-1dcb9facd92f admin admin] RBAC: Authorizing `identity:delete_user(user_id=65c3389c106e42059afba840ed5d4e83)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:57.309775 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d096452d-88f3-4953-92ae-1dcb9facd92f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:57.340467 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:57.360373 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d096452d-88f3-4953-92ae-1dcb9facd92f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65c3389c106e42059afba840ed5d4e83'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:57.361017 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d096452d-88f3-4953-92ae-1dcb9facd92f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65c3389c106e42059afba840ed5d4e83'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:57.369354 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d096452d-88f3-4953-92ae-1dcb9facd92f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65c3389c106e42059afba840ed5d4e83'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:57.370010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d096452d-88f3-4953-92ae-1dcb9facd92f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65c3389c106e42059afba840ed5d4e83'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:57.376982 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-d096452d-88f3-4953-92ae-1dcb9facd92f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65c3389c106e42059afba840ed5d4e83'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:57.393581 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1463/2874] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:57 2022] DELETE /identity/v3/users/65c3389c106e42059afba840ed5d4e83 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:57.675330 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12626d20-c3f6-4c58-a4d3-cb20e99deba0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:57.676178 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-12626d20-c3f6-4c58-a4d3-cb20e99deba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:57.689314 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12626d20-c3f6-4c58-a4d3-cb20e99deba0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:57.754711 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f79a7-b37e-4fc5-b713-dce99a57649e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:57.755824 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f79a7-b37e-4fc5-b713-dce99a57649e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:57.756307 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f79a7-b37e-4fc5-b713-dce99a57649e admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:57.756706 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f79a7-b37e-4fc5-b713-dce99a57649e admin admin] PATH_INFO: `/v3/projects/3e432b3cd07449008a558fbb82992fa5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:57.758484 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f79a7-b37e-4fc5-b713-dce99a57649e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e432b3cd07449008a558fbb82992fa5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:57.761574 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f79a7-b37e-4fc5-b713-dce99a57649e admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:57.787677 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:57.814393 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-219f79a7-b37e-4fc5-b713-dce99a57649e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e432b3cd07449008a558fbb82992fa5', 'request_id': 'req-219f79a7-b37e-4fc5-b713-dce99a57649e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:57.823345 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-219f79a7-b37e-4fc5-b713-dce99a57649e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e432b3cd07449008a558fbb82992fa5', 'request_id': 'req-219f79a7-b37e-4fc5-b713-dce99a57649e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:57.829068 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-219f79a7-b37e-4fc5-b713-dce99a57649e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e432b3cd07449008a558fbb82992fa5', 'request_id': 'req-219f79a7-b37e-4fc5-b713-dce99a57649e'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:57.839961 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-219f79a7-b37e-4fc5-b713-dce99a57649e admin admin] The token cache is being invalidate because project 3e432b3cd07449008a558fbb82992fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:25:57.840251 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-219f79a7-b37e-4fc5-b713-dce99a57649e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:57.840928 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-219f79a7-b37e-4fc5-b713-dce99a57649e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:57.842477 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1412/2875] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:25:57 2022] DELETE /identity/v3/projects/3e432b3cd07449008a558fbb82992fa5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:57.847612 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf90782-7866-4b28-94a0-29ba5022116c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:57.848140 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf90782-7866-4b28-94a0-29ba5022116c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:57.848243 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf90782-7866-4b28-94a0-29ba5022116c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:57.867776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-5bf90782-7866-4b28-94a0-29ba5022116c None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:57.869007 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-5bf90782-7866-4b28-94a0-29ba5022116c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:57.933254 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1464/2876] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:57.993958 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29cf73-64bf-4e65-a243-ddd4db188e08 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:57.994227 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29cf73-64bf-4e65-a243-ddd4db188e08 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:57.994539 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29cf73-64bf-4e65-a243-ddd4db188e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.014447 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-da29cf73-64bf-4e65-a243-ddd4db188e08 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:58.015712 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-da29cf73-64bf-4e65-a243-ddd4db188e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:58.024182 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1413/2877] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:58.028643 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf90782-7866-4b28-94a0-29ba5022116c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.038518 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf90782-7866-4b28-94a0-29ba5022116c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:58.044006 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f8dec-27f9-40bf-af08-64802c745edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:58.044664 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f8dec-27f9-40bf-af08-64802c745edd admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.044947 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f8dec-27f9-40bf-af08-64802c745edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.045227 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f8dec-27f9-40bf-af08-64802c745edd admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.045958 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f8dec-27f9-40bf-af08-64802c745edd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:25:58.046258 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f8dec-27f9-40bf-af08-64802c745edd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:58.048001 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f8dec-27f9-40bf-af08-64802c745edd admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:58.059606 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1465/2878] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:25:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:25:58.063868 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29cf73-64bf-4e65-a243-ddd4db188e08 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.073240 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29cf73-64bf-4e65-a243-ddd4db188e08 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:58.078844 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd663885-dae3-443a-93e1-3438ebe9ad89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:58.079531 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd663885-dae3-443a-93e1-3438ebe9ad89 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.079809 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd663885-dae3-443a-93e1-3438ebe9ad89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.080055 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd663885-dae3-443a-93e1-3438ebe9ad89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.080730 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd663885-dae3-443a-93e1-3438ebe9ad89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:58.082628 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd663885-dae3-443a-93e1-3438ebe9ad89 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:58.113447 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1414/2879] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:58 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:58.114666 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f8dec-27f9-40bf-af08-64802c745edd admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.125553 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f8dec-27f9-40bf-af08-64802c745edd admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:58.192486 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2297e-a021-4235-81eb-44163af43f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:58.193246 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2297e-a021-4235-81eb-44163af43f6c admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.193530 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2297e-a021-4235-81eb-44163af43f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.193799 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2297e-a021-4235-81eb-44163af43f6c admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.194468 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2297e-a021-4235-81eb-44163af43f6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:58.196431 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2297e-a021-4235-81eb-44163af43f6c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:58.219807 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1466/2880] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:58 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:58.224103 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd663885-dae3-443a-93e1-3438ebe9ad89 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.234543 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd663885-dae3-443a-93e1-3438ebe9ad89 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:58.239462 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38aa9b-b1f0-40c7-8ae6-1e752ebf5046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:58.240120 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38aa9b-b1f0-40c7-8ae6-1e752ebf5046 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.240400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38aa9b-b1f0-40c7-8ae6-1e752ebf5046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.240676 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca38aa9b-b1f0-40c7-8ae6-1e752ebf5046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.241400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38aa9b-b1f0-40c7-8ae6-1e752ebf5046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:58.243006 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca38aa9b-b1f0-40c7-8ae6-1e752ebf5046 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:58.253529 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1415/2881] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:58.257542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2297e-a021-4235-81eb-44163af43f6c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.267772 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2297e-a021-4235-81eb-44163af43f6c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:58.272477 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f98b7-ea97-46c8-a6bf-de0b1ab07d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:58.273157 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f98b7-ea97-46c8-a6bf-de0b1ab07d36 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.273437 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f98b7-ea97-46c8-a6bf-de0b1ab07d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.273708 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f98b7-ea97-46c8-a6bf-de0b1ab07d36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.274434 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f98b7-ea97-46c8-a6bf-de0b1ab07d36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:58.276076 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f98b7-ea97-46c8-a6bf-de0b1ab07d36 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:58.286065 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1467/2882] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:58.290129 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38aa9b-b1f0-40c7-8ae6-1e752ebf5046 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.300929 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca38aa9b-b1f0-40c7-8ae6-1e752ebf5046 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:58.306409 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed0293-5231-41dd-9c78-4ee64055276d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:58.307346 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed0293-5231-41dd-9c78-4ee64055276d admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.307634 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed0293-5231-41dd-9c78-4ee64055276d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.307906 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ed0293-5231-41dd-9c78-4ee64055276d admin admin] PATH_INFO: `/v3/projects/ef18d4b1348e47ea8f1702de822eb7d5/users/e6d633059be3424a82190b46fb7b465c/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.322973 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed0293-5231-41dd-9c78-4ee64055276d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef18d4b1348e47ea8f1702de822eb7d5, user_id=e6d633059be3424a82190b46fb7b465c, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:58.325658 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ed0293-5231-41dd-9c78-4ee64055276d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:58.341260 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1416/2883] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:58 2022] PUT /identity/v3/projects/ef18d4b1348e47ea8f1702de822eb7d5/users/e6d633059be3424a82190b46fb7b465c/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:58.351628 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52195a7-c2ec-4c20-99ce-f0b7e47bd46e None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.351967 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52195a7-c2ec-4c20-99ce-f0b7e47bd46e None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.352246 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52195a7-c2ec-4c20-99ce-f0b7e47bd46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.371792 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:58.379529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c52195a7-c2ec-4c20-99ce-f0b7e47bd46e None None] MFA Rules not processed for user `e6d633059be3424a82190b46fb7b465c`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:58.381757 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c52195a7-c2ec-4c20-99ce-f0b7e47bd46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:58.453529 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1468/2884] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 24 01:25:58.458156 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed0293-5231-41dd-9c78-4ee64055276d admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.522489 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ed0293-5231-41dd-9c78-4ee64055276d admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:58.527718 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ee5dd-882b-43fb-86b4-ce4660537a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:58.528376 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ee5dd-882b-43fb-86b4-ce4660537a26 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.528657 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ee5dd-882b-43fb-86b4-ce4660537a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.528970 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03ee5dd-882b-43fb-86b4-ce4660537a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.529627 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ee5dd-882b-43fb-86b4-ce4660537a26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:58.531588 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03ee5dd-882b-43fb-86b4-ce4660537a26 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:58.565017 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1417/2885] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:25:58 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:58.571344 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52195a7-c2ec-4c20-99ce-f0b7e47bd46e None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.584018 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52195a7-c2ec-4c20-99ce-f0b7e47bd46e None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:58.641542 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa5c38-dc76-4b27-81c4-a87c3ec52e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:58.642220 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa5c38-dc76-4b27-81c4-a87c3ec52e2c admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.642501 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa5c38-dc76-4b27-81c4-a87c3ec52e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.642784 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aa5c38-dc76-4b27-81c4-a87c3ec52e2c admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.643544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa5c38-dc76-4b27-81c4-a87c3ec52e2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:58.645505 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aa5c38-dc76-4b27-81c4-a87c3ec52e2c admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:58.667328 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1469/2886] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:25:58 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:25:58.671623 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ee5dd-882b-43fb-86b4-ce4660537a26 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.681998 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03ee5dd-882b-43fb-86b4-ce4660537a26 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:58.686712 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5a43b-9cfa-4ab6-b55d-c1a6b97a03a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:58.687445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5a43b-9cfa-4ab6-b55d-c1a6b97a03a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.687731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5a43b-9cfa-4ab6-b55d-c1a6b97a03a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.688007 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b5a43b-9cfa-4ab6-b55d-c1a6b97a03a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.688741 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5a43b-9cfa-4ab6-b55d-c1a6b97a03a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:58.690359 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b5a43b-9cfa-4ab6-b55d-c1a6b97a03a6 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:58.700953 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1418/2887] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:58.704960 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa5c38-dc76-4b27-81c4-a87c3ec52e2c admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.714828 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aa5c38-dc76-4b27-81c4-a87c3ec52e2c admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:58.720044 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895a115-d080-440e-8da6-072464dd7881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:58.720927 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895a115-d080-440e-8da6-072464dd7881 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.721209 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895a115-d080-440e-8da6-072464dd7881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.721506 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895a115-d080-440e-8da6-072464dd7881 admin admin] PATH_INFO: `/v3/projects/35623c815fa54156963fdae2860b0700/users/738b733804cb43e5a185170a2c4eb7a5/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.736428 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895a115-d080-440e-8da6-072464dd7881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35623c815fa54156963fdae2860b0700, user_id=738b733804cb43e5a185170a2c4eb7a5, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:58.739191 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3895a115-d080-440e-8da6-072464dd7881 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:58.754628 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1470/2888] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:58 2022] PUT /identity/v3/projects/35623c815fa54156963fdae2860b0700/users/738b733804cb43e5a185170a2c4eb7a5/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:58.760354 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5a43b-9cfa-4ab6-b55d-c1a6b97a03a6 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.771325 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b5a43b-9cfa-4ab6-b55d-c1a6b97a03a6 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:58.791896 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:58.834215 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac7678-46c8-46ba-9193-c324164fed62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:58.834895 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac7678-46c8-46ba-9193-c324164fed62 admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.835182 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac7678-46c8-46ba-9193-c324164fed62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.835510 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac7678-46c8-46ba-9193-c324164fed62 admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.836243 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac7678-46c8-46ba-9193-c324164fed62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:58.837874 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac7678-46c8-46ba-9193-c324164fed62 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:58.847688 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1419/2889] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:25:58 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:25:58.852100 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895a115-d080-440e-8da6-072464dd7881 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:58.867450 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895a115-d080-440e-8da6-072464dd7881 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:58.874038 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c656d0-6fec-42ab-97e3-9a2da188dbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:58.874969 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c656d0-6fec-42ab-97e3-9a2da188dbc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.875257 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c656d0-6fec-42ab-97e3-9a2da188dbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.875571 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c656d0-6fec-42ab-97e3-9a2da188dbc2 admin admin] PATH_INFO: `/v3/projects/35623c815fa54156963fdae2860b0700/users/738b733804cb43e5a185170a2c4eb7a5/roles/0033a40b55ea484b840c38e3c8e44529` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.877729 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c656d0-6fec-42ab-97e3-9a2da188dbc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=35623c815fa54156963fdae2860b0700, user_id=738b733804cb43e5a185170a2c4eb7a5, role_id=0033a40b55ea484b840c38e3c8e44529)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:58.880546 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c656d0-6fec-42ab-97e3-9a2da188dbc2 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:58.891319 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1471/2890] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:25:58 2022] PUT /identity/v3/projects/35623c815fa54156963fdae2860b0700/users/738b733804cb43e5a185170a2c4eb7a5/roles/0033a40b55ea484b840c38e3c8e44529 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:58.901745 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e322c78-54c2-495a-ba73-7457a20801a1 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:58.902040 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e322c78-54c2-495a-ba73-7457a20801a1 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:58.902324 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e322c78-54c2-495a-ba73-7457a20801a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:58.929742 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-3e322c78-54c2-495a-ba73-7457a20801a1 None None] MFA Rules not processed for user `738b733804cb43e5a185170a2c4eb7a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:58.930959 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-3e322c78-54c2-495a-ba73-7457a20801a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:59.004691 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1420/2891] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:59.016639 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c656d0-6fec-42ab-97e3-9a2da188dbc2 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:59.018740 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-f4c656d0-6fec-42ab-97e3-9a2da188dbc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:59.086924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c656d0-6fec-42ab-97e3-9a2da188dbc2 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:59.091319 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a4fdf-2665-46dd-a204-bbc8fd8476d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:59.091975 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a4fdf-2665-46dd-a204-bbc8fd8476d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:59.092256 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a4fdf-2665-46dd-a204-bbc8fd8476d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:59.092529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a4fdf-2665-46dd-a204-bbc8fd8476d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:59.100103 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:59.102588 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a4fdf-2665-46dd-a204-bbc8fd8476d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:59.104496 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a4fdf-2665-46dd-a204-bbc8fd8476d6 service cinder] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:59.114485 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1472/2892] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:59.203667 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e322c78-54c2-495a-ba73-7457a20801a1 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:59.214296 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e322c78-54c2-495a-ba73-7457a20801a1 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:59.218629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5332a48-c239-411e-a1fe-90db93b3231d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:59.219344 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5332a48-c239-411e-a1fe-90db93b3231d service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:59.219618 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5332a48-c239-411e-a1fe-90db93b3231d service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:59.219899 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5332a48-c239-411e-a1fe-90db93b3231d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:59.276164 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5332a48-c239-411e-a1fe-90db93b3231d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:59.277613 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5332a48-c239-411e-a1fe-90db93b3231d service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:59.287062 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1421/2893] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:25:59.558407 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a4fdf-2665-46dd-a204-bbc8fd8476d6 service cinder] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:59.625937 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a4fdf-2665-46dd-a204-bbc8fd8476d6 service cinder] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:59.630720 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfb101-60e5-4a24-8bbc-ac7cd1bcfddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:59.631660 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfb101-60e5-4a24-8bbc-ac7cd1bcfddb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:59.631954 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfb101-60e5-4a24-8bbc-ac7cd1bcfddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:59.632248 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cfb101-60e5-4a24-8bbc-ac7cd1bcfddb admin admin] PATH_INFO: `/v3/users/e6d633059be3424a82190b46fb7b465c` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:59.633476 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfb101-60e5-4a24-8bbc-ac7cd1bcfddb admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6d633059be3424a82190b46fb7b465c)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:59.635509 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cfb101-60e5-4a24-8bbc-ac7cd1bcfddb admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:59.683436 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-55cfb101-60e5-4a24-8bbc-ac7cd1bcfddb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6d633059be3424a82190b46fb7b465c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:59.684125 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-55cfb101-60e5-4a24-8bbc-ac7cd1bcfddb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6d633059be3424a82190b46fb7b465c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:59.692704 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-55cfb101-60e5-4a24-8bbc-ac7cd1bcfddb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6d633059be3424a82190b46fb7b465c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:59.693381 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-55cfb101-60e5-4a24-8bbc-ac7cd1bcfddb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6d633059be3424a82190b46fb7b465c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:59.700379 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-55cfb101-60e5-4a24-8bbc-ac7cd1bcfddb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6d633059be3424a82190b46fb7b465c'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:25:59.717911 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1473/2894] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:25:59 2022] DELETE /identity/v3/users/e6d633059be3424a82190b46fb7b465c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:25:59.722573 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4ca4-8b44-4d50-a77e-101390799c7d None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:59.723094 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4ca4-8b44-4d50-a77e-101390799c7d None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:59.723207 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ed4ca4-8b44-4d50-a77e-101390799c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:59.740940 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-d8ed4ca4-8b44-4d50-a77e-101390799c7d None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:25:59.742182 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d8ed4ca4-8b44-4d50-a77e-101390799c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:59.781803 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=100 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:25:59.807731 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1422/2895] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:25:59.817951 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfb101-60e5-4a24-8bbc-ac7cd1bcfddb admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:25:59.819551 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-55cfb101-60e5-4a24-8bbc-ac7cd1bcfddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:25:59.878859 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cfb101-60e5-4a24-8bbc-ac7cd1bcfddb admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:25:59.883010 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50f434-a0b6-448e-9716-feeabccd1cd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:25:59.883682 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50f434-a0b6-448e-9716-feeabccd1cd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:25:59.883964 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50f434-a0b6-448e-9716-feeabccd1cd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:25:59.884238 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50f434-a0b6-448e-9716-feeabccd1cd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:25:59.893800 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50f434-a0b6-448e-9716-feeabccd1cd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:25:59.895235 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a50f434-a0b6-448e-9716-feeabccd1cd6 service neutron] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:25:59.904835 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1474/2896] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:00.175891 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed4ca4-8b44-4d50-a77e-101390799c7d None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:00.177522 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-d8ed4ca4-8b44-4d50-a77e-101390799c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:00.190382 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ed4ca4-8b44-4d50-a77e-101390799c7d None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:00.196202 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:00.197113 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:00.197445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:00.197845 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1 admin admin] PATH_INFO: `/v3/projects/ef18d4b1348e47ea8f1702de822eb7d5` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:00.198922 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef18d4b1348e47ea8f1702de822eb7d5)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:00.200914 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:00.249021 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef18d4b1348e47ea8f1702de822eb7d5', 'request_id': 'req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.257434 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef18d4b1348e47ea8f1702de822eb7d5', 'request_id': 'req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.262866 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef18d4b1348e47ea8f1702de822eb7d5', 'request_id': 'req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.274490 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1 admin admin] The token cache is being invalidate because project ef18d4b1348e47ea8f1702de822eb7d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:00.274779 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.275578 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.277267 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1423/2897] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:00 2022] DELETE /identity/v3/projects/ef18d4b1348e47ea8f1702de822eb7d5 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:00.281512 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50f434-a0b6-448e-9716-feeabccd1cd6 service neutron] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:00.291761 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a50f434-a0b6-448e-9716-feeabccd1cd6 service neutron] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:00.305004 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:00.350296 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5bf652-034d-455b-be39-883b88ed818b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:00.351179 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bf652-034d-455b-be39-883b88ed818b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:00.351491 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bf652-034d-455b-be39-883b88ed818b admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:00.351765 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5bf652-034d-455b-be39-883b88ed818b admin admin] PATH_INFO: `/v3/users/738b733804cb43e5a185170a2c4eb7a5` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:00.352957 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bf652-034d-455b-be39-883b88ed818b admin admin] RBAC: Authorizing `identity:delete_user(user_id=738b733804cb43e5a185170a2c4eb7a5)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:00.354899 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5bf652-034d-455b-be39-883b88ed818b admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:00.408249 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5f5bf652-034d-455b-be39-883b88ed818b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738b733804cb43e5a185170a2c4eb7a5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.408927 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5f5bf652-034d-455b-be39-883b88ed818b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738b733804cb43e5a185170a2c4eb7a5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.418219 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5f5bf652-034d-455b-be39-883b88ed818b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738b733804cb43e5a185170a2c4eb7a5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.418857 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5f5bf652-034d-455b-be39-883b88ed818b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738b733804cb43e5a185170a2c4eb7a5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.425728 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-5f5bf652-034d-455b-be39-883b88ed818b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738b733804cb43e5a185170a2c4eb7a5'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.444467 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1475/2898] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:00 2022] DELETE /identity/v3/users/738b733804cb43e5a185170a2c4eb7a5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:00.717190 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:00.719327 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:00.733169 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c239861-ae77-47b1-8663-d8c3ff5fa4f1 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:00.792602 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4f0bb3-5428-4776-a83e-33b8cab7409d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:00.793481 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f0bb3-5428-4776-a83e-33b8cab7409d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:00.793768 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f0bb3-5428-4776-a83e-33b8cab7409d admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:00.794045 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4f0bb3-5428-4776-a83e-33b8cab7409d admin admin] PATH_INFO: `/v3/projects/35623c815fa54156963fdae2860b0700` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:00.795670 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f0bb3-5428-4776-a83e-33b8cab7409d admin admin] RBAC: Authorizing `identity:delete_project(project_id=35623c815fa54156963fdae2860b0700)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:00.797707 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4f0bb3-5428-4776-a83e-33b8cab7409d admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:00.849443 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-de4f0bb3-5428-4776-a83e-33b8cab7409d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35623c815fa54156963fdae2860b0700', 'request_id': 'req-de4f0bb3-5428-4776-a83e-33b8cab7409d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.859942 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-de4f0bb3-5428-4776-a83e-33b8cab7409d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35623c815fa54156963fdae2860b0700', 'request_id': 'req-de4f0bb3-5428-4776-a83e-33b8cab7409d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.866210 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-de4f0bb3-5428-4776-a83e-33b8cab7409d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35623c815fa54156963fdae2860b0700', 'request_id': 'req-de4f0bb3-5428-4776-a83e-33b8cab7409d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.868172 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:00.879163 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-de4f0bb3-5428-4776-a83e-33b8cab7409d admin admin] The token cache is being invalidate because project 35623c815fa54156963fdae2860b0700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80520) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:00.879558 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-de4f0bb3-5428-4776-a83e-33b8cab7409d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.880433 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-de4f0bb3-5428-4776-a83e-33b8cab7409d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:00.882209 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1424/2899] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:00 2022] DELETE /identity/v3/projects/35623c815fa54156963fdae2860b0700 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:00.887442 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032754c-7880-481a-806d-e657cb89817c None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:00.887992 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032754c-7880-481a-806d-e657cb89817c None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:00.887992 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c032754c-7880-481a-806d-e657cb89817c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:00.907351 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-c032754c-7880-481a-806d-e657cb89817c None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:00.908544 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-c032754c-7880-481a-806d-e657cb89817c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:00.969661 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1476/2900] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:00.977599 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da3cb0-5668-4ae4-b055-df477938ed47 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:00.977889 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da3cb0-5668-4ae4-b055-df477938ed47 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:00.978167 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da3cb0-5668-4ae4-b055-df477938ed47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:00.997173 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-f3da3cb0-5668-4ae4-b055-df477938ed47 None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:00.998417 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-f3da3cb0-5668-4ae4-b055-df477938ed47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:01.006845 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1425/2901] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:01.011138 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032754c-7880-481a-806d-e657cb89817c None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:01.021444 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c032754c-7880-481a-806d-e657cb89817c None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:01.026992 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad1b4d-4a47-4f06-bab7-6aa9a846a176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:01.027677 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad1b4d-4a47-4f06-bab7-6aa9a846a176 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:01.027959 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad1b4d-4a47-4f06-bab7-6aa9a846a176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:01.028232 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad1b4d-4a47-4f06-bab7-6aa9a846a176 admin admin] PATH_INFO: `/v3/domains` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:01.028991 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad1b4d-4a47-4f06-bab7-6aa9a846a176 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80519) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 24 01:26:01.029301 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad1b4d-4a47-4f06-bab7-6aa9a846a176 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:01.030944 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad1b4d-4a47-4f06-bab7-6aa9a846a176 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:01.043216 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1477/2902] 10.222.0.42 () {58 vars in 1152 bytes} [Sun Jul 24 01:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 24 01:26:01.047641 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da3cb0-5668-4ae4-b055-df477938ed47 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:01.057060 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da3cb0-5668-4ae4-b055-df477938ed47 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:01.062690 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61b6cf-41dd-4051-9764-bb79226520c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:01.063436 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61b6cf-41dd-4051-9764-bb79226520c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:01.063719 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61b6cf-41dd-4051-9764-bb79226520c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:01.063991 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61b6cf-41dd-4051-9764-bb79226520c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:01.064672 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61b6cf-41dd-4051-9764-bb79226520c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:01.066605 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61b6cf-41dd-4051-9764-bb79226520c0 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:01.093777 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1426/2903] 10.222.0.42 () {60 vars in 1152 bytes} [Sun Jul 24 01:26:01 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:01.099261 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad1b4d-4a47-4f06-bab7-6aa9a846a176 admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:01.110205 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad1b4d-4a47-4f06-bab7-6aa9a846a176 admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:01.130242 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:01.170757 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decd51c-55dc-4205-a630-46410f569a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:01.171498 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decd51c-55dc-4205-a630-46410f569a0f admin admin] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:01.171781 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decd51c-55dc-4205-a630-46410f569a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:01.172053 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4decd51c-55dc-4205-a630-46410f569a0f admin admin] PATH_INFO: `/v3/users` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:01.172883 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decd51c-55dc-4205-a630-46410f569a0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:01.174819 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4decd51c-55dc-4205-a630-46410f569a0f admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:01.197831 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1478/2904] 10.222.0.42 () {60 vars in 1143 bytes} [Sun Jul 24 01:26:01 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 24 01:26:01.199340 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61b6cf-41dd-4051-9764-bb79226520c0 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:01.210108 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61b6cf-41dd-4051-9764-bb79226520c0 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:01.215629 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099f8b4-ac62-4192-9a3f-0c5a2153d61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:01.216297 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099f8b4-ac62-4192-9a3f-0c5a2153d61c admin admin] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:01.216577 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099f8b4-ac62-4192-9a3f-0c5a2153d61c admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:01.216853 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099f8b4-ac62-4192-9a3f-0c5a2153d61c admin admin] PATH_INFO: `/v3/roles` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:01.217576 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099f8b4-ac62-4192-9a3f-0c5a2153d61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:01.219220 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099f8b4-ac62-4192-9a3f-0c5a2153d61c admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:01.230173 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1427/2905] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:01.234043 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decd51c-55dc-4205-a630-46410f569a0f admin admin] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:01.244558 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4decd51c-55dc-4205-a630-46410f569a0f admin admin] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:01.249923 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a61b50-3e37-4570-a7b6-02368e4bafc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:01.250712 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a61b50-3e37-4570-a7b6-02368e4bafc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:01.250994 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a61b50-3e37-4570-a7b6-02368e4bafc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:01.251268 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a61b50-3e37-4570-a7b6-02368e4bafc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:01.252024 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a61b50-3e37-4570-a7b6-02368e4bafc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:01.253657 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a61b50-3e37-4570-a7b6-02368e4bafc7 admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:01.263888 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1479/2906] 10.222.0.42 () {58 vars in 1121 bytes} [Sun Jul 24 01:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 24 01:26:01.268281 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099f8b4-ac62-4192-9a3f-0c5a2153d61c admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:01.278147 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099f8b4-ac62-4192-9a3f-0c5a2153d61c admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:01.283258 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8157d6a-4b78-43f8-8899-1ef7b219a4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:01.284171 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8157d6a-4b78-43f8-8899-1ef7b219a4eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:01.284454 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8157d6a-4b78-43f8-8899-1ef7b219a4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:01.284726 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8157d6a-4b78-43f8-8899-1ef7b219a4eb admin admin] PATH_INFO: `/v3/projects/bf47428691c448a4831a8429eb38c77e/users/5e9c6f767db54de8a047f903ce11c40d/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:01.300090 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8157d6a-4b78-43f8-8899-1ef7b219a4eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf47428691c448a4831a8429eb38c77e, user_id=5e9c6f767db54de8a047f903ce11c40d, role_id=04fc1b4ea69a47f8aeb80ac2c13b57e9)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:01.302750 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8157d6a-4b78-43f8-8899-1ef7b219a4eb admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:01.317808 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1428/2907] 10.222.0.42 () {60 vars in 1482 bytes} [Sun Jul 24 01:26:01 2022] PUT /identity/v3/projects/bf47428691c448a4831a8429eb38c77e/users/5e9c6f767db54de8a047f903ce11c40d/roles/04fc1b4ea69a47f8aeb80ac2c13b57e9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:01.328049 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622485b6-f890-4815-a33c-b390705a7649 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:01.328376 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622485b6-f890-4815-a33c-b390705a7649 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:01.328659 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622485b6-f890-4815-a33c-b390705a7649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:01.355774 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-622485b6-f890-4815-a33c-b390705a7649 None None] MFA Rules not processed for user `5e9c6f767db54de8a047f903ce11c40d`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:01.356990 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-622485b6-f890-4815-a33c-b390705a7649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:01.434417 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1480/2908] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:26:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:01.445703 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8157d6a-4b78-43f8-8899-1ef7b219a4eb admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:01.447677 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a8157d6a-4b78-43f8-8899-1ef7b219a4eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:01.509624 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8157d6a-4b78-43f8-8899-1ef7b219a4eb admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:01.514150 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673b968e-aa04-4f05-be18-94bff8d4a262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fa52d40556494110bf6962e09addfc15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:01.514810 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b968e-aa04-4f05-be18-94bff8d4a262 service cinder] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:01.515099 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b968e-aa04-4f05-be18-94bff8d4a262 service cinder] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:01.515414 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673b968e-aa04-4f05-be18-94bff8d4a262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:01.524458 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b968e-aa04-4f05-be18-94bff8d4a262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:01.526081 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673b968e-aa04-4f05-be18-94bff8d4a262 service cinder] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:01.535157 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1429/2909] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:02.905722 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb0f5d-2611-4eb1-8018-4b3ccc3ee954 None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:02.906265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb0f5d-2611-4eb1-8018-4b3ccc3ee954 None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:02.906265 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb0f5d-2611-4eb1-8018-4b3ccc3ee954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:02.926228 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-86cb0f5d-2611-4eb1-8018-4b3ccc3ee954 None None] MFA Rules not processed for user `5e9c6f767db54de8a047f903ce11c40d`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:02.927477 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-86cb0f5d-2611-4eb1-8018-4b3ccc3ee954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:02.935077 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1481/2910] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:26:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:11.531085 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=55,keystone:INSERT=2 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:12.919510 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=58,keystone:INSERT=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:17.743669 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dc3d0-73dc-4ea2-8021-f177c0bc29a0 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:17.744226 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dc3d0-73dc-4ea2-8021-f177c0bc29a0 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:17.744226 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dc3d0-73dc-4ea2-8021-f177c0bc29a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:17.761975 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-5e7dc3d0-73dc-4ea2-8021-f177c0bc29a0 None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:17.763195 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-5e7dc3d0-73dc-4ea2-8021-f177c0bc29a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:17.825691 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1430/2911] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:26:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:17.873924 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb0f5d-2611-4eb1-8018-4b3ccc3ee954 None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:17.875548 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-86cb0f5d-2611-4eb1-8018-4b3ccc3ee954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:17.945110 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb0f5d-2611-4eb1-8018-4b3ccc3ee954 None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:17.950853 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85667e05-4f3d-43ed-a5db-0cdedda786aa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:17.951529 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85667e05-4f3d-43ed-a5db-0cdedda786aa service swift] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:17.951816 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85667e05-4f3d-43ed-a5db-0cdedda786aa service swift] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:17.952091 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85667e05-4f3d-43ed-a5db-0cdedda786aa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:17.962411 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85667e05-4f3d-43ed-a5db-0cdedda786aa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:17.965149 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85667e05-4f3d-43ed-a5db-0cdedda786aa service swift] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:17.976560 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1482/2912] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:26:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:18.497421 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d9aa9-f034-4ac9-ba73-f704dd4bc2de None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:18.497744 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d9aa9-f034-4ac9-ba73-f704dd4bc2de None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:18.498022 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d9aa9-f034-4ac9-ba73-f704dd4bc2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:18.516415 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-433d9aa9-f034-4ac9-ba73-f704dd4bc2de None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:18.517647 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-433d9aa9-f034-4ac9-ba73-f704dd4bc2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:18.525696 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1431/2913] 10.222.0.42 () {58 vars in 967 bytes} [Sun Jul 24 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:18.538278 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85667e05-4f3d-43ed-a5db-0cdedda786aa service swift] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:18.553411 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85667e05-4f3d-43ed-a5db-0cdedda786aa service swift] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:18.560695 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c1f0b-019e-4921-8f66-c258ede892e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:18.561339 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c1f0b-019e-4921-8f66-c258ede892e8 service swift] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:18.561619 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c1f0b-019e-4921-8f66-c258ede892e8 service swift] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:18.561897 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c1f0b-019e-4921-8f66-c258ede892e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:18.570728 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c1f0b-019e-4921-8f66-c258ede892e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:18.572430 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c1f0b-019e-4921-8f66-c258ede892e8 service swift] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:18.581595 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1483/2914] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:26:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 24 01:26:18.787220 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879b025-f069-4c96-952d-d9d59e9c20aa None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:18.787708 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879b025-f069-4c96-952d-d9d59e9c20aa None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:18.787844 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879b025-f069-4c96-952d-d9d59e9c20aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:18.807563 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-0879b025-f069-4c96-952d-d9d59e9c20aa None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:18.808824 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-0879b025-f069-4c96-952d-d9d59e9c20aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:18.816542 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1432/2915] 10.222.0.42 () {58 vars in 1009 bytes} [Sun Jul 24 01:26:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:18.828577 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c1f0b-019e-4921-8f66-c258ede892e8 service swift] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:18.839613 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c1f0b-019e-4921-8f66-c258ede892e8 service swift] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:18.846229 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361de7c-6315-4459-9463-d18ac610efdb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:18.847118 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361de7c-6315-4459-9463-d18ac610efdb service swift] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:18.847511 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361de7c-6315-4459-9463-d18ac610efdb service swift] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:18.847879 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361de7c-6315-4459-9463-d18ac610efdb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:18.857776 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361de7c-6315-4459-9463-d18ac610efdb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:18.859731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361de7c-6315-4459-9463-d18ac610efdb service swift] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:18.871061 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1484/2916] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:26:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:19.196445 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6ffee-18dd-45dc-aafa-3ac2fdc1ffb2 None None] REQUEST_METHOD: `POST` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:19.196731 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6ffee-18dd-45dc-aafa-3ac2fdc1ffb2 None None] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:19.197034 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e6ffee-18dd-45dc-aafa-3ac2fdc1ffb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:19.215394 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.auth.core [None req-a0e6ffee-18dd-45dc-aafa-3ac2fdc1ffb2 None None] MFA Rules not processed for user `87ce4ba479574d89990e23c157b2801b`. Rule list: `[]` (Enabled: `True`). {{(pid=80520) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:19.216607 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-a0e6ffee-18dd-45dc-aafa-3ac2fdc1ffb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:19.224323 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1433/2917] 10.222.0.42 () {58 vars in 967 bytes} [Sun Jul 24 01:26:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:19.236925 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361de7c-6315-4459-9463-d18ac610efdb service swift] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:19.247989 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361de7c-6315-4459-9463-d18ac610efdb service swift] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:19.254134 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e58348-5d78-466e-9947-78eaed363abd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dea37db9b0f3432093e8fe89d5fcc687', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:19.254778 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e58348-5d78-466e-9947-78eaed363abd service swift] REQUEST_METHOD: `GET` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:19.255053 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e58348-5d78-466e-9947-78eaed363abd service swift] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:19.255342 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e58348-5d78-466e-9947-78eaed363abd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:19.264120 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e58348-5d78-466e-9947-78eaed363abd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:19.265762 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e58348-5d78-466e-9947-78eaed363abd service swift] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:19.274070 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1485/2918] 10.222.0.42 () {60 vars in 1384 bytes} [Sun Jul 24 01:26:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 24 01:26:21.356006 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6ffee-18dd-45dc-aafa-3ac2fdc1ffb2 None None] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:21.425409 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e6ffee-18dd-45dc-aafa-3ac2fdc1ffb2 None None] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:21.431329 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc041a-98e3-47d1-b5b4-17a65dc7dde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:21.432285 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc041a-98e3-47d1-b5b4-17a65dc7dde9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:21.432559 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc041a-98e3-47d1-b5b4-17a65dc7dde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:21.432831 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbc041a-98e3-47d1-b5b4-17a65dc7dde9 admin admin] PATH_INFO: `/v3/users/5e9c6f767db54de8a047f903ce11c40d` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:21.434176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc041a-98e3-47d1-b5b4-17a65dc7dde9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e9c6f767db54de8a047f903ce11c40d)` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:21.436176 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbc041a-98e3-47d1-b5b4-17a65dc7dde9 admin admin] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:21.486772 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dbbc041a-98e3-47d1-b5b4-17a65dc7dde9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e9c6f767db54de8a047f903ce11c40d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.487426 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dbbc041a-98e3-47d1-b5b4-17a65dc7dde9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e9c6f767db54de8a047f903ce11c40d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.488037 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dbbc041a-98e3-47d1-b5b4-17a65dc7dde9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e9c6f767db54de8a047f903ce11c40d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.494907 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dbbc041a-98e3-47d1-b5b4-17a65dc7dde9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e9c6f767db54de8a047f903ce11c40d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.507033 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.notifications [None req-dbbc041a-98e3-47d1-b5b4-17a65dc7dde9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e9c6f767db54de8a047f903ce11c40d'} {{(pid=80520) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.522178 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1434/2919] 10.222.0.42 () {58 vars in 1223 bytes} [Sun Jul 24 01:26:21 2022] DELETE /identity/v3/users/5e9c6f767db54de8a047f903ce11c40d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:21.527055 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6249f-04f0-4d8e-ba3c-f224a98b561a None None] REQUEST_METHOD: `POST` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:21.527656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6249f-04f0-4d8e-ba3c-f224a98b561a None None] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:21.527656 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6249f-04f0-4d8e-ba3c-f224a98b561a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:21.546930 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.auth.core [None req-54e6249f-04f0-4d8e-ba3c-f224a98b561a None None] MFA Rules not processed for user `bd7e825180504b9cb4f914bcf260106f`. Rule list: `[]` (Enabled: `True`). {{(pid=80519) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 24 01:26:21.548158 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-54e6249f-04f0-4d8e-ba3c-f224a98b561a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:21.610205 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1486/2920] 10.222.0.42 () {58 vars in 957 bytes} [Sun Jul 24 01:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 24 01:26:21.620504 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc041a-98e3-47d1-b5b4-17a65dc7dde9 admin admin] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:21.622606 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-dbbc041a-98e3-47d1-b5b4-17a65dc7dde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:21.632805 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:21.688004 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbc041a-98e3-47d1-b5b4-17a65dc7dde9 admin admin] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:21.692179 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3541ff-cb90-4427-801a-cebefbdf3429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3efd3928e334e78b4c87bb695718299', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:21.692833 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3541ff-cb90-4427-801a-cebefbdf3429 service neutron] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:21.693121 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3541ff-cb90-4427-801a-cebefbdf3429 service neutron] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:21.693400 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3541ff-cb90-4427-801a-cebefbdf3429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:21.703337 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3541ff-cb90-4427-801a-cebefbdf3429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:21.704843 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3541ff-cb90-4427-801a-cebefbdf3429 service neutron] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:21.714982 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1435/2921] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:26:21.898460 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6249f-04f0-4d8e-ba3c-f224a98b561a None None] Authenticating user token {{(pid=80519) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:26:21.900012 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.fernet_utils [None req-54e6249f-04f0-4d8e-ba3c-f224a98b561a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80519) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:26:21.914416 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6249f-04f0-4d8e-ba3c-f224a98b561a None None] Validating token access rules against request {{(pid=80519) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:26:21.920767 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57390fca-29b5-4766-bf15-4dac75a2a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd7e825180504b9cb4f914bcf260106f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05a6eda2714c497da6528545bd5b3ebc', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80519) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:26:21.921932 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57390fca-29b5-4766-bf15-4dac75a2a63d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:26:21.922058 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57390fca-29b5-4766-bf15-4dac75a2a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:26:21.922347 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57390fca-29b5-4766-bf15-4dac75a2a63d admin admin] PATH_INFO: `/v3/projects/bf47428691c448a4831a8429eb38c77e` {{(pid=80519) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:26:21.923670 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57390fca-29b5-4766-bf15-4dac75a2a63d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf47428691c448a4831a8429eb38c77e)` {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:26:21.925625 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57390fca-29b5-4766-bf15-4dac75a2a63d admin admin] RBAC: Authorization granted {{(pid=80519) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:26:21.972915 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:21.976457 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-57390fca-29b5-4766-bf15-4dac75a2a63d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf47428691c448a4831a8429eb38c77e', 'request_id': 'req-57390fca-29b5-4766-bf15-4dac75a2a63d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.983135 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-57390fca-29b5-4766-bf15-4dac75a2a63d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf47428691c448a4831a8429eb38c77e', 'request_id': 'req-57390fca-29b5-4766-bf15-4dac75a2a63d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:21.988966 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-57390fca-29b5-4766-bf15-4dac75a2a63d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf47428691c448a4831a8429eb38c77e', 'request_id': 'req-57390fca-29b5-4766-bf15-4dac75a2a63d'} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:22.002731 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-57390fca-29b5-4766-bf15-4dac75a2a63d admin admin] The token cache is being invalidate because project bf47428691c448a4831a8429eb38c77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80519) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 24 01:26:22.003018 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-57390fca-29b5-4766-bf15-4dac75a2a63d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:22.003683 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG keystone.notifications [None req-57390fca-29b5-4766-bf15-4dac75a2a63d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80519) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 24 01:26:22.005245 dv-cinder-master-3-smb devstack@keystone.service[80519]: [pid: 80519|app: 0|req: 1487/2922] 10.222.0.42 () {58 vars in 1232 bytes} [Sun Jul 24 01:26:21 2022] DELETE /identity/v3/projects/bf47428691c448a4831a8429eb38c77e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 24 01:26:31.710455 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=24 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:26:32.000177 dv-cinder-master-3-smb devstack@keystone.service[80519]: DEBUG dbcounter [-] [80519] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 24 01:29:50.893042 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3541ff-cb90-4427-801a-cebefbdf3429 service neutron] Authenticating user token {{(pid=80520) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 24 01:29:50.894619 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-4e3541ff-cb90-4427-801a-cebefbdf3429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:51.045919 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3541ff-cb90-4427-801a-cebefbdf3429 service neutron] Validating token access rules against request {{(pid=80520) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 24 01:29:51.111993 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6184ef74-92fa-4e3f-b76d-cd4c6e1482d1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '333db0711d0f41fe8066ba5b9d91dacc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '604801625292482a9fb4b70c416dc438', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80520) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 24 01:29:51.112568 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184ef74-92fa-4e3f-b76d-cd4c6e1482d1 service placement] REQUEST_METHOD: `GET` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 24 01:29:51.112850 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184ef74-92fa-4e3f-b76d-cd4c6e1482d1 service placement] SCRIPT_NAME: `/identity` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 24 01:29:51.113127 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6184ef74-92fa-4e3f-b76d-cd4c6e1482d1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80520) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 24 01:29:51.115132 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.fernet_utils [None req-6184ef74-92fa-4e3f-b76d-cd4c6e1482d1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80520) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 24 01:29:51.126976 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184ef74-92fa-4e3f-b76d-cd4c6e1482d1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 24 01:29:51.128616 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6184ef74-92fa-4e3f-b76d-cd4c6e1482d1 service placement] RBAC: Authorization granted {{(pid=80520) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 24 01:29:51.138867 dv-cinder-master-3-smb devstack@keystone.service[80520]: [pid: 80520|app: 0|req: 1436/2923] 10.222.0.42 () {60 vars in 1365 bytes} [Sun Jul 24 01:29:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 24 01:30:01.134553 dv-cinder-master-3-smb devstack@keystone.service[80520]: DEBUG dbcounter [-] [80520] Writing DB stats keystone:SELECT=89 {{(pid=80520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}